In the meantime, I tweaked the LSC spider a bit to continue scanning character profiles and linkshells. They include:
If the character count of a linkshell doesn't match the number at the top of the memberlist page, it will be skipped. This indicates the page had an error.
Character profiles will be skipped if presented with the "server is currently busy" error. The character LSC URL will be preserved.
In both instances, fail or not, the page will be considered "updated" to push it to the back of the queue. Hopefully it will be successful next time around.
Character and linkshell pages are still accessible with the correct URL. Many of them error out and it's my goal to determine when that happens.
Larger linkshell pages on the LSC are more likely to error out. This error occurs immediately if a single member is currently using one of the new jobs (rune fencer or geomancer). This causes the page to be truncated and subsequent members are not present. This is exactly what caused FFXIAH linkshells to be missing members.