Export all books as TSV stalls at 0 books
DiscussieBug Collectors
Sluit je aan bij LibraryThing om te posten.
1bnielsen
I'm trying to export my books as TSV but it seems stuck on 0 books :-(
Normally it exports without any trouble, so something broke yesterday, methinks.
Normally it exports without any trouble, so something broke yesterday, methinks.
2kristilabrie
Thanks for the report, checking.
3kristilabrie
Okay, ccatalfo thinks he has this fixed, if you want to try again?
4bnielsen
0 books, 100 books, 200 books, yes it's working much better now.
I'll report when it has finished, but so far it seems like it's fixed!
Thanks!
ETA: all books exported as TSV without a hitch. I'm closing this bug report.
I'll report when it has finished, but so far it seems like it's fixed!
Thanks!
ETA: all books exported as TSV without a hitch. I'm closing this bug report.
5frebbe
Sorry to say, this error still occurs here (Google Chrome Version 91.0.4472.77) when I try to export my ~ 250 books to whatever format. I see the rotating wheel "Bücher verarbeitet" for hours without any output. Also tried with latest versions of MS Edge and Mozilla Firefox. The same. There is absolutely no progress in exporting. I do not receive a file with zero content, I can't get any output. Please let me know, what I'm doing wrong or how to solve the problem. Thank you very much.
6kristilabrie
>5 frebbe: Hi frebbe, both ccatalfo (one of our developers) and myself are able to export on the .de site for your account. I presume you're using librarything.de, is that correct?
Do you mind clearing your browser's cache/cookies and trying the export once more? If they're still failing for you, please let me know which export/s you're trying and also perhaps your current IP address: you can find your IP by going to https://www.whatsmyip.org and finding the series of numbers and periods at the top of the page. We can take a closer look with that. Thanks.
Do you mind clearing your browser's cache/cookies and trying the export once more? If they're still failing for you, please let me know which export/s you're trying and also perhaps your current IP address: you can find your IP by going to https://www.whatsmyip.org and finding the series of numbers and periods at the top of the page. We can take a closer look with that. Thanks.
7frebbe
>6 kristilabrie: I was using https://www.librarything.de/export.php?export_type=xls and - following your advice - was able to download the librarything_frebbe.xls file. Thank you very much for your help!
8kristilabrie
Excellent! Glad to hear it.
9Lisa2013
I still can't export books. Stalls at 0 books expoeted. For Excel, for Tab-delimited text too.
On a Mac in Firefox 89.0 up to date. Haven't tried other browsers yet but this is repeatable. Several tries so far.
Thanks.
On a Mac in Firefox 89.0 up to date. Haven't tried other browsers yet but this is repeatable. Several tries so far.
Thanks.
10bnielsen
>9 Lisa2013: I get the same behaviour. No errors, just stuck at 0 books. I've reopened this bug report and messaged ccatalfo
12ccatalfo
>9 Lisa2013: >10 bnielsen: Sorry folks, still working out what is *sometimes* causing a memory issue.
>9 Lisa2013: Can you please try once again and we'll see if this next code change gets it through? If not, I will up it once more and we can see where threshold needs to be.
Sorry for the inconvenience.
>9 Lisa2013: Can you please try once again and we'll see if this next code change gets it through? If not, I will up it once more and we can see where threshold needs to be.
Sorry for the inconvenience.
13ccatalfo
>10 bnielsen: When your export failed but later succeeded - was it the very same collection or set of books you were exporting?
14bnielsen
>13 ccatalfo: The same. But I tried various versions in between to see if I could interrupt the "0 books" stall. But I didn't succeed in anything until suddenly the full export worked again.
15ccatalfo
>14 bnielsen: Thanks. How peculiar. Digging deeper.
16ccatalfo
>14 bnielsen: Aha. The consumer process is eating up memory like it's candy, until it's eaten it all. And thus the eventual memory problem.
I should have checked that sooner, but your before and after example lead me to that. Thanks!
Now, to figure out why.
I should have checked that sooner, but your before and after example lead me to that. Thanks!
Now, to figure out why.
17ulmannc
I tried running the export again and I'm stalled again. It worked after it worked as described in >11 bnielsen:. Now nothing. All I have right now is an Android v 6 phone with the current vesion of Google Chrome. Will not get back to a pc until tonight.
18ccatalfo
>17 ulmannc: Ok I've made some more adjustments - principally attempting to get rid of an apparent memory leak in the excel library we use.
How are things now? I do not see the same error rate as before these changes, so I am hopeful this will fix it completely...
How are things now? I do not see the same error rate as before these changes, so I am hopeful this will fix it completely...
19ulmannc
>18 ccatalfo: I just tried it. It's been running for about 5 minutes and it is sitting on zero. I'm running Windows 10 Pro with the current version of Google Chrome.
Just for ha ha's, I also tried an export with a tag filter of "Charles Marion Russell" and got nothing as well. The count on those tags is 185
Just for ha ha's, I also tried an export with a tag filter of "Charles Marion Russell" and got nothing as well. The count on those tags is 185
22kristilabrie
Yes, ccatalfo added in some improvements that should (fingers crossed) fix these export issues we've been having. Please post here if you're still seeing trouble! Thanks for your patience, all.
24LibraryDraytonHall
Hello - haven't gotten Export (to EXCEL) to work at all today. Tried clearing cache (using Chrome) and still, no go...is there something else I should be trying or is Export "broken"....let Export run a few minutes (on a library of less than 800 books) but stuck at "0 books processed". Please fix. I love this app and need to generate a spreadsheet! Thanks very much for your attention to this matter.
25bnielsen
Currently stalled at the perpetual "0 books processed". (That's after a system update and reboot of my machine, so I don't think anything browser related survived that :-)
My latest succesful export was >21 bnielsen:.
My latest succesful export was >21 bnielsen:.
26ccatalfo
Ok once again thanks for your patience - I'm tweaking the logic around it and figuring out how quickly we can process them. A bit of a queue was worked up overnight, unfortunately. I've cleared it this morning and am watching to see how it behaves.
28ulmannc
Just tried it again and after 5 min it is sitting at zero. The number normally starts going after about 10 sec
29kristilabrie
>28 ulmannc: Noted, passing to ccatalfo!
30ccatalfo
Yes, ok, we've made some more changes to help XLS export along - I'm not seeing failures in the logs right now, even with larger libraries.
We're also looking at the speed (of XLS in particular) to see if we can improve that.
We're also looking at the speed (of XLS in particular) to see if we can improve that.
31LibraryDraytonHall
Success! I was just able to export all my books (>700) via Excel. (I come from a software development background and really appreciate the prompt support!) Thanks, again!
32ulmannc
Just ran a full tab delimited export (approx 8400 entries) and it worked. Took a bit under 10 minutes which was about where it was before the "excitement" . I appreciate your persistence on this!
"The Electronic Luddite"
"The Electronic Luddite"