[Bug] Import soft locked on Loading Documents

[jpole1]

When clicking "Load all documents" for a handful of the volumes, progress never proceeds past a certain point. Things soft lock after some of the documents have been imported. Clicking restart load doesn't do anything, and the site keeps spinning, even after refreshes.

Examples:
https://oldinsurancemaps.net/map/sanborn06787_006
https://oldinsurancemaps.net/map/sanborn06764_004
https://oldinsurancemaps.net/map/sanborn06787_007
https://oldinsurancemaps.net/map/sanborn06784_005

[mradamcox]

I actually think this is the same as the issue in #328. It may have more to do with the particular volumes, as I think these were all added to the system quite a while ago, and the download links for each document may need to be updated. I'll likely just completely remove all of these partial loaded and re-add the maps.

[jpole1]

Is this a task that can be offloaded to someone else (me) in any way? If I can take any of this loading/auditing/re-working off your plate, I’m happy to.

[mradamcox]

@jpole1 Thanks for asking, yes, I've done a little more checking around and I do think you can help. I've given you staff status on the site so you should be able to use the "force reload" button to reload each individual page. Marion, OH is a good example that I just tested.

1. Click "force reload", wait 5-10 seconds, and the loading should complete.
2. Hard refresh the page (ctrl/cmd+F5) and the thumbnail should update. You can also check by going to the document page itself after the reload has finished.

For other volumes in this batch that got stuck partway through loading, I think you'll be able to use the "restart load" one-by-one on each page that is "loading".

Then, once no more of the pages still say loading, the overall "Load documents" button should reappear. I'd say at that point don't click the button, just make a list that still need to finish loading. I'll address #328 at that time, and then we won't get any errors when we do the final "Load documents" on each one.

[jpole1]

Awesome! I’ll see what I can do tonight.

[mradamcox]

Excellent, thank you!

[jpole1]

Ok, here's the list of all the ones that were stuck on loading. I've since fixed them all, so they're ready to be reimported, per your note about #328. I have not imported any additional documents on them.

https://oldinsurancemaps.net/map/sanborn09345_005
https://oldinsurancemaps.net/map/sanborn06656_003
https://oldinsurancemaps.net/map/sanborn06656_005
https://oldinsurancemaps.net/map/sanborn02345_008
https://oldinsurancemaps.net/map/sanborn06820_008
https://oldinsurancemaps.net/map/sanborn06820_007
https://oldinsurancemaps.net/map/sanborn06787_007
https://oldinsurancemaps.net/map/sanborn06784_005
https://oldinsurancemaps.net/map/sanborn08580_027
https://oldinsurancemaps.net/map/sanborn00436_008
https://oldinsurancemaps.net/map/sanborn08580_016
https://oldinsurancemaps.net/map/sanborn06787_006
https://oldinsurancemaps.net/map/sanborn06764_004
https://oldinsurancemaps.net/map/sanborn06962_005

[jpole1]

Very weird follow-up bug happening on this Santa Monica volume. When you try to split the last page, a weird bounding box is created that doesn't apply to the actual width of the page.

I tried making the lines extend to the edge of the new bounding box, but then the splits were not in the right location after it processed. I tried force reloading again, and the same issue occurs.

https://oldinsurancemaps.net/map/sanborn00836_008

Edit: same issue happening on these pages:
https://oldinsurancemaps.net/document/62428
https://oldinsurancemaps.net/document/63734
https://oldinsurancemaps.net/document/63735
https://oldinsurancemaps.net/document/63738
https://oldinsurancemaps.net/document/63741
https://oldinsurancemaps.net/document/63746
https://oldinsurancemaps.net/document/63756
https://oldinsurancemaps.net/document/63541
https://oldinsurancemaps.net/document/62360
https://oldinsurancemaps.net/document/62398
https://oldinsurancemaps.net/document/62412
https://oldinsurancemaps.net/document/64765
https://oldinsurancemaps.net/document/64766
https://oldinsurancemaps.net/document/64767

[mradamcox]

Great catch, I see exactly what you mean:

I think I know what's going on here, the dimensions of the page are cached and I guess for some reason the source file size has changed (?) since the first attempt at loading, or the dimensions were calculated in a different way. I just need to put these on my list to spend some extra time on cleaning them up, probably best for you to not spend more time on them in case I end up needing to undo some of the work. Thanks!

[jpole1]

Ok yes, the dimensions being cached makes sense. Some of the previous failed imports pulled in pages from other volumes, or some that were clearly different shapes.

In some cases it was markedly noticeable. In others it was barely noticeable, but now that you phrase it like that, it all checks out.

I've more or less declared my preparation work complete for now until you get around to updating those other imports. No rush, genuinely.