[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [EquisMetaStock Group] Re: Lengthy Download


  • Date: Wed, 16 Dec 2009 12:13:36 +0800
  • From: Richard Dale <richard@xxxxxxxxxxxxxxx>
  • Subject: Re: [EquisMetaStock Group] Re: Lengthy Download

PureBytes Links

Trading Reference Links



Perhaps consider a different data vendor.

One of my PCs for updating data on AMEX, NASDAQ, NYSE, OTC and US Indices takes around 10 minutes.  If I take out the OTC securities so we perform an apples-for-apples comparison against Reuters it's more like 8 minutes.  I bet if I defragmented my drive it would also reduce it significantly too.

This is on a 2 year old PC (dual core AMD with 4GB RAM on Windows 7 64 bit edition on a 7200RPM WD Caviar Black hard drive).

The history on this goes back 59 years so it does take a bit longer to read and write those files too.

Best regards,
Richard Dale.
Norgate Investor Services
- Premium quality Stock, Futures and Foreign Exchange Data for
  markets in Australia, Asia, Canada, Europe, UK & USA -
www.premiumdata.net


-------- Original Message  --------
Subject: [EquisMetaStock Group] Re: Lengthy Download
From: superfragalist <no_reply@xxxxxxxxxxxxxxx>
To: equismetastock@xxxxxxxxxxxxxxx
Date: Wed, 16 Dec 2009 01:38:20 -0000
 

I download around 12,000 symbols a night. The time it takes varies. Reuters servers can get very busy. The best time to download is between 10:00 pm and 11:00 pm eastern time.

Sometimes it takes 45 minutes, sometimes it takes 2 hours, and every once in awhile I have to redo the whole download because the servers were flakie.

The collection report has to append the data onto each file and then save the file so you've got 12,000 file overwrites alone. Have you tried to overwrite 12,000 files with 12,000 new files? I have and it ain't fast.

If your history only goes back say 4 years, it takes less time. Mine is 20 years so I get no joy on that issue.

If you ran MS on a solid state drive like an Intel X25-E Extreme SATA, it will go faster. (Not all solid state drives are equally as good or as fast!) In fact, your laptop will be smoking fast on hd read/writes, and the battery life will jump up.

On my desktop I can do other work while the download runs in the background. I usually don't because I run the downloads when I'm normally busy with other stuff.

Sorry there isn't a really good solution, cheap, easy solution.

Super

--- In equismetastock@yahoogroups.com, "rickbw" <rickbw@xxx> wrote:
>
> Currently my laptop is taking 2+ hours to download my daily price updates. The number of symbols is around 10,000 and what seems to be taking the most time is the portion of the update called "Building Collection Report" (last part of the process). I have attempted to turn off Norton Antivirus to see if that was slowing the process and it does not seem to have any effect.
>
> My system follwos:
>
> Windows Vista
> Intel Core 2 Solo Processor (1.4 GHz, 800 MHZ)
> 4GB Memory
> 250 GB HDD with about 120 GB free.
>
> Should it take this long? Any ideas if it shouldn't on how I can improve the time? It is frustrateing waiting this long each evening :(
>
> Rick
>





__._,_.___


Your email settings: Individual Email|Traditional
Change settings via the Web (Yahoo! ID required)
Change settings via email: Switch delivery to Daily Digest | Switch to Fully Featured
Visit Your Group | Yahoo! Groups Terms of Use | Unsubscribe

__,_._,___