[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[EquisMetaStock Group] Re: Lengthy Download


  • Date: Wed, 16 Dec 2009 05:49:52 -0000
  • From: superfragalist <no_reply@xxxxxxxxxxxxxxx>
  • Subject: [EquisMetaStock Group] Re: Lengthy Download

PureBytes Links

Trading Reference Links

Okay, Richard, if you can guarantee the 10 minute time for the download  and the collection report on 12,000 US stock symbols, I'll sign up after the first of the year. I'll buy the historical data back to 1950 and the delisted symbols as well. 

Super

--- In equismetastock@xxxxxxxxxxxxxxx, Richard Dale <richard@xxx> wrote:
>
> Perhaps consider a different data vendor.
> 
> One of my PCs for updating data on AMEX, NASDAQ, NYSE, OTC and US 
> Indices takes around 10 minutes.  If I take out the OTC securities so we 
> perform an apples-for-apples comparison against Reuters it's more like 8 
> minutes.  I bet if I defragmented my drive it would also reduce it 
> significantly too.
> 
> This is on a 2 year old PC (dual core AMD with 4GB RAM on Windows 7 64 
> bit edition on a 7200RPM WD Caviar Black hard drive).
> 
> The history on this goes back 59 years so it does take a bit longer to 
> read and write those files too.
> 
> Best regards,
> Richard Dale.
> Norgate Investor Services
> - Premium quality Stock, Futures and Foreign Exchange Data for
>    markets in Australia, Asia, Canada, Europe, UK&  USA -
> www.premiumdata.net
> 
> 
> 
> -------- Original Message  --------
> Subject: [EquisMetaStock Group] Re: Lengthy Download
> From: superfragalist <no_reply@xxxxxxxxxxxxxxx>
> To: equismetastock@xxxxxxxxxxxxxxx
> Date: Wed, 16 Dec 2009 01:38:20 -0000
> >
> > I download around 12,000 symbols a night. The time it takes varies. 
> > Reuters servers can get very busy. The best time to download is 
> > between 10:00 pm and 11:00 pm eastern time.
> >
> > Sometimes it takes 45 minutes, sometimes it takes 2 hours, and every 
> > once in awhile I have to redo the whole download because the servers 
> > were flakie.
> >
> > The collection report has to append the data onto each file and then 
> > save the file so you've got 12,000 file overwrites alone. Have you 
> > tried to overwrite 12,000 files with 12,000 new files? I have and it 
> > ain't fast.
> >
> > If your history only goes back say 4 years, it takes less time. Mine 
> > is 20 years so I get no joy on that issue.
> >
> > If you ran MS on a solid state drive like an Intel X25-E Extreme SATA, 
> > it will go faster. (Not all solid state drives are equally as good or 
> > as fast!) In fact, your laptop will be smoking fast on hd read/writes, 
> > and the battery life will jump up.
> >
> > On my desktop I can do other work while the download runs in the 
> > background. I usually don't because I run the downloads when I'm 
> > normally busy with other stuff.
> >
> > Sorry there isn't a really good solution, cheap, easy solution.
> >
> > Super
> >
> > --- In equismetastock@xxxxxxxxxxxxxxx 
> > <mailto:equismetastock%40yahoogroups.com>, "rickbw" <rickbw@> wrote:
> > >
> > > Currently my laptop is taking 2+ hours to download my daily price 
> > updates. The number of symbols is around 10,000 and what seems to be 
> > taking the most time is the portion of the update called "Building 
> > Collection Report" (last part of the process). I have attempted to 
> > turn off Norton Antivirus to see if that was slowing the process and 
> > it does not seem to have any effect.
> > >
> > > My system follwos:
> > >
> > > Windows Vista
> > > Intel Core 2 Solo Processor (1.4 GHz, 800 MHZ)
> > > 4GB Memory
> > > 250 GB HDD with about 120 GB free.
> > >
> > > Should it take this long? Any ideas if it shouldn't on how I can 
> > improve the time? It is frustrateing waiting this long each evening :(
> > >
> > > Rick
> > >
> >
> >
>




------------------------------------

Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/equismetastock/

<*> Your email settings:
    Individual Email | Traditional

<*> To change settings online go to:
    http://groups.yahoo.com/group/equismetastock/join
    (Yahoo! ID required)

<*> To change settings via email:
    equismetastock-digest@xxxxxxxxxxxxxxx 
    equismetastock-fullfeatured@xxxxxxxxxxxxxxx

<*> To unsubscribe from this group, send an email to:
    equismetastock-unsubscribe@xxxxxxxxxxxxxxx

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo.com/info/terms/