Looks like file parsing is stuck...

Notes regarding project status and info

19 posts • Page 1 of 2
...and it's been down for quite a while. There are now 371 files in the queue for processing.

Has the script been taken offline for some heretofore unmentioned database maintenance?
Image
Team: G. B. Y. M.

Postby uhtu » Fri Sep 28, 2012 10:14 am

it is progressing, just busy.
Was it choking on a large file?
Image
Team: G. B. Y. M.
It is not parsing. Uploaded 2 files and they are not reflected in my stats, nor in the map.
I am surprised that no site-admin has put up an update or explanation.

Postby uhtu » Sun Sep 30, 2012 10:31 pm

<- site admin :-)
/me goes looking for the PokingStick<tm>...
Hello, I'm New to WiGLE.
I'd say it looks like it's stuck :)

It would be great if there was some rudimentary info about the current file being processed.

Also, the webmap does not work anymore.
Wow, 2190 files queued. Did somebody stumble-bomb the system?

Poor kittens...looks like someone ate a bad mouse last night:

Total Files parsed: 568,060
Files from today processed: 0
Files 1 day ago / 2 days ago: 426 / 484
Files queued to process: 2190
Registered Users: 128,858
Image
Had a disk failure, turned off file processing as backup came online. File processing now running again.
-bobzilla - WiGLE.net just a little bit
Image

Postby Whig » Thu Dec 27, 2012 4:28 pm

Had a disk failure, turned off file processing as backup came online. File processing now running again.
Yay! Not for disk failure of course =)
That was back in October, we're just running some big end-of-year processing jobs, slows down regular file processing a bit.
-bobzilla - WiGLE.net just a little bit
Image
Bump. -
1:30 AM (UTC) - 425 files queued for processing.
Image
Bump. -
1:30 AM (UTC) - 425 files queued for processing.
Heh, I was about to comment on this as well. It's up to 782 now.

Postby uhtu » Sun Mar 10, 2013 11:27 pm

regular file processing is online, and processing. just running slow behind some other jobs.
everything will be processed in the order they were received.

-uhtu
When we're running large batch jobs and file processing falls behind it's good to keep an eye not just on the queue size but on the "Files 1 day ago / 2 days ago:" which is a stat that is always updated so you can see that additional files are being processed. Most other stats operate on batches of files for efficiency so may take a while to reflect changes in the dataset.
-bobzilla - WiGLE.net just a little bit
Image

19 posts • Page 1 of 2

Return to “WiGLE News”

Who is online

Users browsing this forum: No registered users and 11 guests