[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[EquisMetaStock Group] Re: Lengthy Download


  • Date: Wed, 16 Dec 2009 01:38:20 -0000
  • From: superfragalist <no_reply@xxxxxxxxxxxxxxx>
  • Subject: [EquisMetaStock Group] Re: Lengthy Download

PureBytes Links

Trading Reference Links

I download around 12,000 symbols a night. The time it takes varies. Reuters servers can get very busy. The best time to download is between 10:00 pm and 11:00 pm eastern time. 

Sometimes it takes 45 minutes, sometimes it takes 2 hours, and every once in awhile I have to redo the whole download because the servers were flakie. 

The collection report has to append the data onto each file and then save the file so you've got 12,000 file overwrites alone. Have you tried to overwrite 12,000 files with 12,000 new files? I have and it ain't fast.

If your history only goes back say 4 years, it takes less time. Mine is 20 years so I get no joy on that issue. 

If you ran MS on a solid state drive like an Intel X25-E Extreme SATA, it will go faster. (Not all solid state drives are equally as good or as fast!) In fact, your laptop will be smoking fast on hd read/writes, and the battery life will jump up. 

On my desktop I can do other work while the download runs in the background. I usually don't because I run the downloads when I'm normally busy with other stuff. 

Sorry there isn't a really good solution, cheap, easy solution. 

Super




--- In equismetastock@xxxxxxxxxxxxxxx, "rickbw" <rickbw@xxx> wrote:
>
> Currently my laptop is taking 2+ hours to download my daily price updates.  The number of symbols is around 10,000 and what seems to be taking the most time is the portion of the update called "Building Collection Report" (last part of the process).  I have attempted to turn off Norton Antivirus to see if that was slowing the process and it does not seem to have any effect.
> 
> My system follwos:
> 
> Windows Vista
> Intel Core 2 Solo Processor (1.4 GHz, 800 MHZ)
> 4GB Memory
> 250 GB HDD with about 120 GB free.
> 
> Should it take this long?  Any ideas if it shouldn't on how I can improve the time?  It is frustrateing waiting this long each evening :(
> 
> Rick
>




------------------------------------

Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/equismetastock/

<*> Your email settings:
    Individual Email | Traditional

<*> To change settings online go to:
    http://groups.yahoo.com/group/equismetastock/join
    (Yahoo! ID required)

<*> To change settings via email:
    equismetastock-digest@xxxxxxxxxxxxxxx 
    equismetastock-fullfeatured@xxxxxxxxxxxxxxx

<*> To unsubscribe from this group, send an email to:
    equismetastock-unsubscribe@xxxxxxxxxxxxxxx

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo.com/info/terms/