Page 1 of 5

File parsing seems to be halted...

Posted: Tue Jun 11, 2013 7:08 am
by rsandu
Hello,

File parsing seems to be halted from last night. There are about 500 files in queque in this moment.

Friendly regards,
Răzvan

Re: File parsing seems to be halted...

Posted: Tue Jun 11, 2013 10:11 am
by uhtu
everything is running. just slow (and the files processed is updated when the batch completes)

-uhtu

Re: File parsing seems to be halted...

Posted: Tue Jun 11, 2013 12:12 pm
by rsandu
That's interesing, thanks !
For the sake of curiosity, is there a massive file in queque or a massive wardriving operation undergoing ?

Răzvan

Re: File parsing seems to be halted...

Posted: Wed Jun 12, 2013 6:47 am
by rsandu
I may confirm, now, that file processing is stucked, since one of my files (not vey large) is #1 in queue for many hours, and other files keep coming...

Re: File parsing seems to be halted...

Posted: Thu Jun 13, 2013 9:43 am
by orland
It's just dead
Files from today processed: 0
Files 1 day ago / 2 days ago: 53 / 522

Files queued to process: 896

Re: File parsing seems to be halted...

Posted: Thu Jun 13, 2013 11:15 am
by rsandu
Yes, ît's stucked ! Admins, please help... !

According to stats: Unique wifi networks in DB: 99,232,637 (not changing) New unique networks today: 0 (not changing) New today with location: 0 (not changing) Total Files parsed: 794,449 (not changing for 48 h now; one of my files happens to be #1 in queue since then, so I can see) Files queued to process: 925 (goes up pretty quickly).

Best regards,
Răzvan

Re: File parsing seems to be halted...

Posted: Fri Jun 14, 2013 2:11 pm
by daveemtb
Looks like it's processing files again now. Pretty big backlog tho!

Re: File parsing seems to be halted...

Posted: Sat Jun 15, 2013 8:28 am
by rsandu
Hello, file processing is up again, but now (Saturday, June 15, 2013, 08:27 GMT) the map displays „Plot error, apollogies”...

Re: File parsing seems to be halted...

Posted: Fri Jul 19, 2013 5:33 pm
by toothpaste
If the queue is long there is reason for it. If a user uploads a file that has 50,000+ wifi to process it will slow down all the other files hence the queue will grow. This will also effect the plotting of wifi on the map, so it just takes some patience.

Upload your files and go do something else for a while. Sometimes that while is for hours, but it will complete. I doubt that the admins could really do anything to speed this up, aside from more servers, blah blah blah.......

Re: File parsing seems to be halted...

Posted: Sat Feb 15, 2014 4:09 pm
by ccie4526
And again... 700+ in the queue with no movement...

Re: File parsing seems to be halted...

Posted: Sat Feb 15, 2014 7:07 pm
by khmann
Per the "offtopic" feature-request thread from yesterday, (here in this necropost... ; )
we're aware.
everything will be processed by cold, calculating datakittens in the order it was received.
My first upload of the month has been hanging out at #390 for 24 hours. If anybody was going to clog the queue for days at a time, I would assume you ccie4526.

Re: File parsing seems to be halted...

Posted: Sat Feb 15, 2014 10:04 pm
by ccie4526
Per the "offtopic" feature-request thread from yesterday, (here in this necropost... ; )
we're aware.
everything will be processed by cold, calculating datakittens in the order it was received.
My first upload of the month has been hanging out at #390 for 24 hours. If anybody was going to clog the queue for days at a time, I would assume you ccie4526.
Nice to know I have a reputation.. ;-)

Srsly, I've only got about 16 files in the queue right now, so it's someone else that has it constipated..

Re: File parsing seems to be halted...

Posted: Tue Feb 18, 2014 12:49 am
by khmann
Just to post an update... the kittens finally gnawed through my upload (the time per file shows 50% to 100% longer than I would usually expect), but the "stats" page has not updated either my last upload date, nor my newly detected APs. Nearly 1000 files in the queue right now.

Re: File parsing seems to be halted...

Posted: Tue Feb 18, 2014 2:55 am
by ccie4526
Just to post an update... the kittens finally gnawed through my upload (the time per file shows 50% to 100% longer than I would usually expect), but the "stats" page has not updated either my last upload date, nor my newly detected APs. Nearly 1000 files in the queue right now.
I hopped on the Wigle IRC channel and "encouraged" the folks to feed the kittens some ex-lax... Bobzilla said they had some maintenance tasks running in the background that was dogging the server pretty hard (my general interpretation). Obviously that stuff is somewhat done.

Re: File parsing seems to be halted...

Posted: Wed Feb 19, 2014 3:36 am
by garnet
This gives a better view of how well the kittens are being fed: https://wigle.net/gps/gps/main/stats/?p ... asttransid