Index | Recent Threads | Who's Online | Search

Posts: 90    Pages: 9    Prev 1 2 3 4 5 6 7 8 9 Next
Last Post
This topic has been viewed 3033 times and has 89 replies
atw
Re: New engine released

Do any subscribers use quickratioq in their simulations or screens?

An immediate (and insufficient) comparison of quickratioq in 25 companies using today's data revealed 3 differences between values produced by what is now the default engine w/preliminary data vs. the "legacy" option.

AABVF shows N/A in the legacy and 63.96 in the default
AAME shows N/A in the legacy and 3.45 in the default
AB shows N/A in the legacy and 1.10 in the default

It's not possible, from the outside, to investigate this issue properly. However, these results are consistent with the previous study I ran showing approximately 12% inconsistent data values either feeding or produced by the legacy vs. Beta engines.

Although I am unable to investigate this properly, I don't believe the Beta site was ready to be promoted to default status.

Hugh

May 7, 2020 1:24:31 PM       
marco
Re: New engine released

Hugh. this is a nasty one. The new engine is always filling in missing line items with the last previous values until the new one is reported.

Normally this is not as bad as it sounds since that is what our fallback mechanism does. Missing values in preliminary reports are replaced with previous values. But in the examples you gave above a very old value is being carried forward indefinitely since the company apparently stopped reporting Current Liabilities in the interim reports.

We'll have a fix very soon.

Thank You!

Portfolio123 Staff.

May 7, 2020 2:10:09 PM       
Nicoletta
Re: New engine released

Many SIM have drastically changed. Some are better some are worse. This changed drammatically ...Why?

Attachment Old.JPG (126070 bytes) (Download count: 109)


Attachment New.JPG (117151 bytes) (Download count: 109)


May 7, 2020 2:15:00 PM       
atw
Re: New engine released

Thank you, Marco. I know it's not easy and I am appreciative for what p123 does. I am a fan.

Here is another issue I reported in brief the other day. However, I don't believe a trouble ticket was created:

MScoreSGAI...
AACG is 0.15 in the Current (Beta) vs. 0.11 in the Legacy
AAMF is 0.25 in the Current (Beta) vs. N/A in the Legacy
AAWW is 1.08 in the Current (Beta) vs 1.09 in the Legacy

If these differences were caused by FactSet vs. CompuStat data, it would be one thing. But these are differences between CompuStat and CompuStat involving today's data, no less!

Also, of great concern... I noticed the trouble ticket for WeeksIntoQ has apparently been closed for the second time. I just ran a check on 25 tickers and 40% of the values generated on the Current(Beta) site are different than the values on the Legacy site, again for today's data. Has that issue really been fixed?

Thank you.

Hugh

May 7, 2020 3:01:13 PM       
dnevin123
Re: New engine released

I am seeing significant differences across the different possible engines for my various strategies. There is no apparent trend, sometimes the model is significantly worse sometimes better. I have attached a screen capture of my test results below. For reference, FactSet and FactSet Cons represent FactSet with and without Prelim data, respectively. I'll start digging into the details as time permits, but as you can imagine it is hard to know where to start.

Thanks,

Daniel

Attachment P123 FactSet Test Cases.PNG (63437 bytes) (Download count: 105)


May 7, 2020 3:08:05 PM       
philjoe
Re: New engine released

I don't understand, will this change any of my models on the regular site?

May 7, 2020 3:20:13 PM       
marco
Re: New engine released

philjoe, the regular site (production) by default now points to the new engine. We are fixing a few issues so yes, your models could be affected. You can point to the "Legacy" engine from the icon on the top right of the screen and there will be no changes

dnevin123, Did you run the strategies on the legacy engine or the new one ? there are issues right now with the new engine. Also, please note the Factset will have a different taxonomy called RBICS. We hope to have it up and running next week so you can compare it with Compustat taxonomy GICS

Hugh, lets wait till the new fix is in for MScoreSGAI. Re. WeeksIntoQ there has bee a small change. It's now calculated since the "earliest date" for a filing which could be either compustat effective date (when they process some data) or filing date of the SEC. I believe the differences are for cases where there the filing date is before compustat effective date. Like when a company files with the SEC and Compustat takes 1 week to process. We could go either way on this one.

Thank You

Portfolio123 Staff.

May 7, 2020 3:39:06 PM       
Edit 1 times, last edit by marco at May 7, 2020 3:39:53 PM
dnevin123
Re: New engine released


dnevin123, Did you run the strategies on the legacy engine or the new one ? there are issues right now with the new engine. Also, please note the Factset will have a different taxonomy called RBICS. We hope to have it up and running next week so you can compare it with Compustat taxonomy GICS


I ran each of the models on the follwing engines

Compustat Legacy
Compustat Current
FactSet (w/ Prelims)
FactSet Conservative (w/o Prelims)

May 7, 2020 3:49:57 PM       
philjoe
Re: New engine released

What does engine mean in this context :S

May 7, 2020 3:53:15 PM       
dnevin123
Re: New engine released

While running the Current Compustat or FactSet engine, I receive the following error when attempting to download the result of running Ranks on any of the Ranking Systems I have tested (even the P123 provided Ranking Systems). I do not receive this error when I use the Legacy engine

Factor CompleteStmt does not exist

Thanks,

Daniel

May 7, 2020 4:00:46 PM       
Posts: 90    Pages: 9    Prev 1 2 3 4 5 6 7 8 9 Next
 Last Post