[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [amibroker] Why does it take so long to apply edits?



PureBytes Links

Trading Reference Links

Hello,

You should look inside broker.params file. 
I guess that thousands of different (now unused)
parameter names were created by the formula.

Best regards,
Tomasz Janeczko
amibroker.com
----- Original Message ----- 
From: "Dennis Brown" <see3d@xxxxxxxxxxx>
To: <amibroker@xxxxxxxxxxxxxxx>
Sent: Tuesday, November 20, 2007 2:45 AM
Subject: Re: [amibroker] Why does it take so long to apply edits?


> Hello,
> 
> I just wanted to let everyone know that I found how to fix this  
> problem.  Somehow my chart had become corrupted in such a way that  
> every edit I made would progressively add a little bit more to the  
> time it took to "Apply Indicator".  I was up to 15 minutes today  
> before I found it was not my AFL that was doing it.  AB Support tried  
> my AFL and let me know that it was not the problem which got me  
> looking in the right direction.  Copying my AFL to another sheet  
> fixed the problem.  It actually takes less than a second to do this  
> operation now.
> 
> Best regards,
> Dennis
> 
> On Nov 8, 2007, at 9:09 PM, Dennis Brown wrote:
> 
>> Tomasz,
>>
>> Thank you for your response on the forum.  Since this problem seems
>> to have gone way beyond the purpose of the forum at this point, I am
>> switching to AB Support to debug this issue.  I have included this
>> whole thread as background with that email.
>>
>> But to answer your questions here for the completeness of this thread:
>>
>> Yes, I am talking about "Apply Indicator" taking so long and it did
>> not make sense to me either that it should take so long.
>>
>> If I do a "Verify syntax" it takes less than a second.
>>
>> Normal operation mode is .25 seconds and resulted in the following:
>>
>> Using constant volume bar mode resulted in an "Apply" time of 8.5
>> minutes.
>> Switching to daily mode resulted in an "Apply" time of 9.5 minutes --
>> so not an improvement.
>> Commenting out ALL 2700 lines of my AFL code resulted in an apply
>> time of 3 minutes.
>>
>> The Profiler runs instantly and shows .01 seconds execution time, but
>> consists of only 6 functions that are checked because most of the AFL
>> is conditionally executed in indicator mode only.
>>
>> I edited out my indicator mode wrapper and used the Profiler again.
>> This time it showed the results on the screen for about 2 seconds,
>> then the window disappeared and none of the AB windows could be
>> selected, as if the profiler model dialog box was still open but now
>> invisible.  I was able to catch the AFL run time from the window
>> before it disappeared.  One time it said .45 seconds, another time it
>> was 1.1 seconds.
>>
>> I took screen shots of the Task Manager while it is doing an "Apply
>> indicator" and sent them along with my AFL code to the AB support  
>> email.
>>
>> Thank you for all you do for us.
>> Best regards,
>>
>> Dennis
>>
>> On Nov 7, 2007, at 4:26 PM, Tomasz Janeczko wrote:
>>
>>> Dennis,
>>>
>>> If you speak about "Apply indicator" - it should be sub-second time.
>>> Minutes mean that something is wrong.
>>> "Applying indicator" executes the code for ALL bars with selected
>>> symbol and selected interval.
>>>
>>> Your formula needs to be doing some weird things if that takes that
>>> much time.
>>> Use built in Profiler (in 5.0.1) to find out which functions that
>>> you are using cause such long times.
>>>
>>> Other than looking at your formula I can only suggest to switch to
>>> daily interval when applying the code during editing.
>>>
>>> Best regards,
>>> Tomasz Janeczko
>>> amibroker.com
>>> ----- Original Message -----
>>> From: "Dennis Brown" <see3d@xxxxxxxxxxx>
>>> To: <amibroker@xxxxxxxxxxxxxxx>
>>> Sent: Wednesday, November 07, 2007 6:24 PM
>>> Subject: Re: [amibroker] Why does it take so long to apply edits?
>>>
>>>
>>>> Ok,
>>>>
>>>> This has totally frustrated me.  I am ready to abandon the built-in
>>>> AFL editor.  It is taking forever to debug code when I have to wait
>>>> 4-8 minutes for every typo.
>>>>
>>>> However, I need to keep my AB chart running while editing the AFL
>>>> (because my AB startup setup is complicated).
>>>>
>>>> Can I use an external editor as a *direct* replacement for the  
>>>> built-
>>>> in editor?
>>>> Alternatively, is there a way to disable the checking done by the  
>>>> AFL
>>>> formula editor when applying?
>>>> Actually the syntax checking is fast, it is what it does after that
>>>> that takes so long.
>>>>
>>>> Am I the only one who sees this problem?
>>>>
>>>> Best regards,
>>>> Dennis
>>>>
>>>> On Oct 30, 2007, at 10:21 AM, Dennis Brown wrote:
>>>>
>>>>> Tomasz,
>>>>>
>>>>> As time has gone on, I have increased the complexity of my AFL to
>>>>> 2500 lines and my database to 200K.  The time to apply edits has
>>>>> also
>>>>> gone up to 8 minutes even though I have wrapped the code so that
>>>>> most
>>>>> only executes in indicator mode.  Finally today I became frustrated
>>>>> enough to track down the offending AFL.  I started by commenting  
>>>>> out
>>>>> my entire AFL.  Time to apply --4 minutes for 2500 lines of
>>>>> comments!  I am at a loss for how to track down what is causing the
>>>>> long apply edits now.  Do you know how I might approach this?
>>>>>
>>>>> Best regards,
>>>>> Dennis
>>>>>
>>>>> On Sep 4, 2007, at 9:16 PM, Dennis Brown wrote:
>>>>>
>>>>>> Tomasz,
>>>>>>
>>>>>> Thank you for your insights.
>>>>>>
>>>>>> I wrapped my code today as you suggested below and in an earlier
>>>>>> post
>>>>>> today, so unwrapped are only the uncalled functions and a few
>>>>>> variables initialized to keep out syntax errors.  I am using a
>>>>>> 90,000
>>>>>> bar 5 second database, but the chart timeframe is run at about
>>>>>> 7,000
>>>>>> bars, and my complex loop processing is limited by parameter to
>>>>>> less
>>>>>> than 2,000 bars.  Changing that parameter to 200 bars reduces the
>>>>>> execution time from 1 second to .2 seconds, but as you suggested,
>>>>>> does not seem to have much affect on the apply time --which now
>>>>>> varies from 35 to 65 seconds.  I also tried different tickers with
>>>>>> fewer bars (30,000) and it did made the apply time longer.  So I
>>>>>> would say my edit apply time is no longer dependent on my database
>>>>>> size or AFL complexity.
>>>>>>
>>>>>> Even though I am glad to have under a minute apply time now, it
>>>>>> seems
>>>>>> as though there is still something else that is slowing it
>>>>>> down.  Do
>>>>>> any other possibilities come to mind?
>>>>>>
>>>>>> One thing that I noticed, is that it is a consistent 35 seconds to
>>>>>> apply when I start up AB and just do a lot of applies.  Switching
>>>>>> symbols, more edits, enabling complex AFL sections, etc. cause the
>>>>>> time to lengthen up to the 55 second area and it does not go back
>>>>>> down until I quit AB.  I am guessing that these things take memory
>>>>>> that does not get released and it reduces the RAM available for
>>>>>> processing the apply.
>>>>>>
>>>>>> PS.  When I turn on ALL of my formula (enabled in sections with
>>>>>> multiple timeframes and indicators) it takes about 5 seconds to
>>>>>> execute with all the speed-up tricks so far --which is why I am
>>>>>> obsessed with getting the most speed I can out of AFL by clever
>>>>>> programming tricks.
>>>>>>
>>>>>> Best regards,
>>>>>> Dennis
>>>>>>
>>>>>> On Sep 4, 2007, at 6:00 PM, Tomasz Janeczko wrote:
>>>>>>
>>>>>>> Dennis,
>>>>>>>
>>>>>>> If you are "applying" the code - it is for the first time  
>>>>>>> executed
>>>>>>> with ALL bars, regardless of QuickAFL and SetBarsRequired
>>>>>>> settings.
>>>>>>>
>>>>>>> Now *if* your formula is complex and uses looping and you are
>>>>>>> using
>>>>>>> for example tick database with hundreds of thousands of bars
>>>>>>> it may take a while. Usually it is non-issue as people are not
>>>>>>> using such complex formulas.
>>>>>>> (1 second is *very* long for execution under normal  
>>>>>>> circumstances.
>>>>>>> My formulas usually execute well below 0.1 sec).
>>>>>>>
>>>>>>> You may wrap your code into
>>>>>>>
>>>>>>> if( Status("action")==actionIndicator)
>>>>>>> {
>>>>>>> ...
>>>>>>> }
>>>>>>>
>>>>>>> and this will prevent this effect.
>>>>>>>
>>>>>>> Best regards,
>>>>>>> Tomasz Janeczko
>>>>>>> amibroker.com
>>>>>>> ----- Original Message -----
>>>>>>> From: "Dennis Brown" <see3d@xxxxxxxxxxx>
>>>>>>> To: <amibroker@xxxxxxxxxxxxxxx>
>>>>>>> Sent: Tuesday, September 04, 2007 11:25 PM
>>>>>>> Subject: [amibroker] Why does it take so long to apply edits?
>>>>>>>
>>>>>>>
>>>>>>>> Hello,
>>>>>>>>
>>>>>>>> I have noticed that the time it takes to apply an edit to my
>>>>>>>> large
>>>>>>>> indicator AFL takes a long but variable amount of time.  It  
>>>>>>>> might
>>>>>>>> take 15 seconds one time and 3 minutes another time.  It usually
>>>>>>>> takes about 2.5 minutes to apply an edit, though if there is a
>>>>>>>> syntax
>>>>>>>> error, it comes back right away.  The AFL itself has an
>>>>>>>> execution of
>>>>>>>> about 1 second per pass and starts up right away from scratch.
>>>>>>>>
>>>>>>>> I was wondering if there were any general rules that I should be
>>>>>>>> aware of that would make applying edits faster and more
>>>>>>>> consistent?
>>>>>>>>
>>>>>>>> Another thing that is interesting is that if I click anywhere on
>>>>>>>> the
>>>>>>>> chart or UI while the edit is being applied, it runs even  
>>>>>>>> slower,
>>>>>>>> and
>>>>>>>> always resets all the params.
>>>>>>>>
>>>>>>>> Insights anyone?
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Dennis
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> Please note that this group is for discussion between users  
>>>>>>>> only.
>>>>>>>>
>>>>>>>> To get support from AmiBroker please send an e-mail directly to
>>>>>>>> SUPPORT {at} amibroker.com
>>>>>>>>
>>>>>>>> For NEW RELEASE ANNOUNCEMENTS and other news always check  
>>>>>>>> DEVLOG:
>>>>>>>> http://www.amibroker.com/devlog/
>>>>>>>>
>>>>>>>> For other support material please check also:
>>>>>>>> http://www.amibroker.com/support.html
>>>>>>>>
>>>>>>>> Yahoo! Groups Links
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> Please note that this group is for discussion between users only.
>>>>>>>
>>>>>>> To get support from AmiBroker please send an e-mail directly to
>>>>>>> SUPPORT {at} amibroker.com
>>>>>>>
>>>>>>> For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
>>>>>>> http://www.amibroker.com/devlog/
>>>>>>>
>>>>>>> For other support material please check also:
>>>>>>> http://www.amibroker.com/support.html
>>>>>>>
>>>>>>> Yahoo! Groups Links
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> Please note that this group is for discussion between users only.
>>>>>>
>>>>>> To get support from AmiBroker please send an e-mail directly to
>>>>>> SUPPORT {at} amibroker.com
>>>>>>
>>>>>> For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
>>>>>> http://www.amibroker.com/devlog/
>>>>>>
>>>>>> For other support material please check also:
>>>>>> http://www.amibroker.com/support.html
>>>>>>
>>>>>> Yahoo! Groups Links
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> Please note that this group is for discussion between users only.
>>>>>
>>>>> To get support from AmiBroker please send an e-mail directly to
>>>>> SUPPORT {at} amibroker.com
>>>>>
>>>>> For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
>>>>> http://www.amibroker.com/devlog/
>>>>>
>>>>> For other support material please check also:
>>>>> http://www.amibroker.com/support.html
>>>>>
>>>>> Yahoo! Groups Links
>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>>
>>>> Please note that this group is for discussion between users only.
>>>>
>>>> To get support from AmiBroker please send an e-mail directly to
>>>> SUPPORT {at} amibroker.com
>>>>
>>>> For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
>>>> http://www.amibroker.com/devlog/
>>>>
>>>> For other support material please check also:
>>>> http://www.amibroker.com/support.html
>>>>
>>>> Yahoo! Groups Links
>>>>
>>>>
>>>>
>>>>
>>>>
>>>
>>>
>>> Please note that this group is for discussion between users only.
>>>
>>> To get support from AmiBroker please send an e-mail directly to
>>> SUPPORT {at} amibroker.com
>>>
>>> For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
>>> http://www.amibroker.com/devlog/
>>>
>>> For other support material please check also:
>>> http://www.amibroker.com/support.html
>>>
>>> Yahoo! Groups Links
>>>
>>>
>>>
>>
>>
>>
>> Please note that this group is for discussion between users only.
>>
>> To get support from AmiBroker please send an e-mail directly to
>> SUPPORT {at} amibroker.com
>>
>> For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
>> http://www.amibroker.com/devlog/
>>
>> For other support material please check also:
>> http://www.amibroker.com/support.html
>>
>> Yahoo! Groups Links
>>
>>
>>
> 
> 
> 
> Please note that this group is for discussion between users only.
> 
> To get support from AmiBroker please send an e-mail directly to 
> SUPPORT {at} amibroker.com
> 
> For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
> http://www.amibroker.com/devlog/
> 
> For other support material please check also:
> http://www.amibroker.com/support.html
> 
> Yahoo! Groups Links
> 
> 
> 
> 
>


Please note that this group is for discussion between users only.

To get support from AmiBroker please send an e-mail directly to 
SUPPORT {at} amibroker.com

For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
http://www.amibroker.com/devlog/

For other support material please check also:
http://www.amibroker.com/support.html
 
Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/amibroker/

<*> Your email settings:
    Individual Email | Traditional

<*> To change settings online go to:
    http://groups.yahoo.com/group/amibroker/join
    (Yahoo! ID required)

<*> To change settings via email:
    mailto:amibroker-digest@xxxxxxxxxxxxxxx 
    mailto:amibroker-fullfeatured@xxxxxxxxxxxxxxx

<*> To unsubscribe from this group, send an email to:
    amibroker-unsubscribe@xxxxxxxxxxxxxxx

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo.com/info/terms/