Page 1 of 1

How long should it take for stats to refresh?

Posted: Wed Jun 29, 2016 1:54 am
by TheWraith
I uploaded approximately 1,500 nodes and it's been an hour... My personal stats haven't updated. Am I just being impatient and it takes 'x' minutes per hundred?

Thanks.

Re: How long should it take for stats to refresh?

Posted: Wed Jun 29, 2016 2:13 am
by TheWraith
Within the Wigle Uploads, these are a couple of files I uploaded:
20160628-00878 Queued for Processing 88 to go 2016-06-28 18:09:43 WigleWifi_20160628200941.csv 925
20160628-00873 Queued for Processing 83 to go 2016-06-28 18:00:47 WigleWifi_20160628200043.csv 243,583
20160628-00842 Queued for Processing 52 to go 2016-06-28 16:43:11 WigleWifi_20160628184309.csv 45,978

The stats have said "105 files to process" for quite some time. The other night I uploaded this file:

2016-06-26 18:28:40 WigleWifi_20160626202836.csv 333,624 2,892 230 230 760 762 2,867

It says it took 9 seconds to process. With a file size (in bytes) of 333,624, taking 9 seconds. I'm uncertain why a file size of any of my other files would be taking so long - unless something is hung up.

Re: How long should it take for stats to refresh?

Posted: Wed Jun 29, 2016 2:18 am
by TheWraith
Well, my uploads appear to be processing...and I'm just impatient. The "% to go" is changing:

20160628-00878 Queued for Processing 85 to go 2016-06-28 18:09:43 WigleWifi_20160628200941.csv 925
20160628-00873 Queued for Processing 80 to go 2016-06-28 18:00:47 WigleWifi_20160628200043.csv 243,583
20160628-00842 Queued for Processing 49 to go 2016-06-28 16:43:11 WigleWifi_20160628184309.csv 45,978

Re: How long should it take for stats to refresh?

Posted: Wed Jun 29, 2016 1:13 pm
by TheWraith
When my first file completed:
20160628-00842 Completed Successfully 100% 13 2016-06-28 16:43:11 WigleWifi_20160628184309.csv 45,978 381 19 19 235 235 380

...my personal stats updated with new information.

When my second file completed (about an hour later):
20160628-00873 Completed Successfully 100% 865 2016-06-28 18:00:47 WigleWifi_20160628200043.csv 243,583 1,958 576 576 1,338 1,338 1,957

...my personal stats didn't change. Are personal stats not refreshed on completion of each file upload?

Re: How long should it take for stats to refresh?

Posted: Wed Jun 29, 2016 1:20 pm
by TheWraith
And, unless I'm reading the numbers incorrectly...my first file contained 19 new wifi w/GPS. My second file contained 576 new wifi w/GPS. I would have expected my second file to adjust my personal stats.

Re: How long should it take for stats to refresh?

Posted: Sun Jul 03, 2016 3:00 pm
by bobzilla
It's an eventually-consistent pipeline, personal stats are updated at a later stage so they won't necessarily be updated the moment a file finishes its processing.