Index | Recent Threads | Who's Online | Search

Posts: 90    Pages: 9    Prev 1 2 3 4 5 6 7 8 9 Next
Last Post
This topic has been viewed 3043 times and has 89 replies
yuvaltaylor
Re: New engine released

Thank you very much, Yuval.

First, please do run your experiment on each of the Legacy, Current w/prelim and on FactSet w/prelim engines to make sure you are generating the same list of stocks. If not, we may have stumbled on an issue, yes?

You wouldn't get the same list of stocks unless you're using a rather small universe because if you put WeeksIntoQ on its own line with no qualifications it'll exclude stocks with WeeksIntoQ = 0 or NA, and the stocks with those values for WeeksIntoQ are going to differ between one server and another and between data providers.

Second, just to be clear... If stock ZZZZZ announces preliminary information on February 15th, 2020, files on May 1st, 2020, and S&P took a week in each case to process, its dates would be...

Press Release Date: February 15th, 2020
Effective Preliminary Date: February 22nd, 2020
Filing Date: May 1st, 2020
Effective Filing Date: May 8th, 2020

...correct?

Correct.

You wrote above that WeeksIntoQ used to be based on the Effective Preliminary Date. I don't think that is so. I think it was based on the Effective Filing Date. Are you sure it was based on the Effective Preliminary Date?

Yes. Take ACU, for instance. It announced on April 17 and filed on May 8. WeeksIntoQ on Legacy is 3.

Third, I would discourage any subscriber from relying on LatestActualDays unless it turns out that FactSet is doing a much better job with this data point. Based on previous investigations, I'd say that this variable is theoretically perfect, but far from being so in practice. There are two issues, I believe. The first - and I admit I'm speculating based on my exploration - is that prior year values were not really point in time. The second is that analysts do NOT always update their EPS actuals on the date of the press release. They usually update their EPS actuals AS OF the date of the press release, but often at a later date. And sometimes they screw up and don't update or their updates are not captured. This is especially so when analysts drop coverage.

Point taken.

Fourth, regarding FactSet, if the data we will have to work with is a) the press release date and b) the filing date, I strongly encourage p123 to create separate WeeksIntoQ variables based on each. WeeksIntoQ based on the press release date will allow subscribers to judge most accurately how early a company first presented information about a quarter. WeeksIntoQ based on the filing date will allow subscribers to judge where the company currently stands in relation to its last quarterly filing. DaysIntoQ would probably be better than WeeksIntoQ, by the way, since WeeksIntoQ can be derived from DaysIntoQ but not the other way around. If companies always released the same information on the press release and filing dates, perhaps the two data points would be redundant. But companies don't. As mentioned before, I think it's an unnecessary argument to debate which of the two dates is more useful. They each provide potential incremental value.

Couldn't you use DaysSince(LatestFilingDate)?

Yuval Taylor
Product Manager, Portfolio123
invest(igations)
Any opinions or recommendations in this message are not opinions or recommendations of Portfolio123 Securities LLC.

May 13, 2020 6:28:19 PM       
Edit 1 times, last edit by yuvaltaylor at May 14, 2020 11:51:24 AM
atw
Re: New engine released

Yuval,

Thank you very much - once again - for your detailed reply.

I have some work to do on my end but this is very helpful and much appreciated.

Hugh

May 14, 2020 1:13:47 PM       
Edit 1 times, last edit by atw at May 14, 2020 1:14:13 PM
paulnovell
Re: New engine released

Finally had a good chunk of time this weekend to dig into differences in my Strategy Sims between Legacy Engine Compustat and Current Engine Factset databases. I'll focus on one specific big difference for now since it affect a bunch of my strategies.

I have a risk management rule that is based on economic data and price performance of the index. Buy rule would be as follows:
Eval(Close(0,#UNEMP)>1.1*SMA(12,0,#UNEMP),Eval(BenchClose(0)>SMA(120,0,#Bench),1,0),1)

Sell rule would be similar but the opposite:
Eval(Close(0,#UNEMP)>1.1*SMA(12,0,#UNEMP),Eval(BenchClose(0)>SMA(120,0,#Bench),0,1),0)

These rules are causing large performance differences in strategies run on the Legacy engine with the Compustat data and the new engine with the Facset database. The results are even quite different if I use the Current Engine with the Compustat database. If I turn these rules off to test the fundamental part of the strategies, the results are close, not the same, but at least way way closer than with these simple rules turned on.

This is concerning to say the least.

Paul

May 18, 2020 5:07:58 AM       
yuvaltaylor
Re: New engine released

Finally had a good chunk of time this weekend to dig into differences in my Strategy Sims between Legacy Engine Compustat and Current Engine Factset databases. I'll focus on one specific big difference for now since it affect a bunch of my strategies.

I have a risk management rule that is based on economic data and price performance of the index. Buy rule would be as follows:
Eval(Close(0,#UNEMP)>1.1*SMA(12,0,#UNEMP),Eval(BenchClose(0)>SMA(120,0,#Bench),1,0),1)

Sell rule would be similar but the opposite:
Eval(Close(0,#UNEMP)>1.1*SMA(12,0,#UNEMP),Eval(BenchClose(0)>SMA(120,0,#Bench),0,1),0)

These rules are causing large performance differences in strategies run on the Legacy engine with the Compustat data and the new engine with the Facset database. The results are even quite different if I use the Current Engine with the Compustat database. If I turn these rules off to test the fundamental part of the strategies, the results are close, not the same, but at least way way closer than with these simple rules turned on.

This is concerning to say the least.

Paul


Good catch. It looks like the buy rule gets activated on 4/6/09 on Legacy and 12/7/09 on Current, which explains the difference. We're investigating and will report back soon.

Yuval Taylor
Product Manager, Portfolio123
invest(igations)
Any opinions or recommendations in this message are not opinions or recommendations of Portfolio123 Securities LLC.

May 18, 2020 10:03:16 AM       
yuvaltaylor
Re: New engine released

Good catch. It looks like the buy rule gets activated on 4/6/09 on Legacy and 12/7/09 on Current, which explains the difference. We're investigating and will report back soon.


This will be fixed by tomorrow.

Yuval Taylor
Product Manager, Portfolio123
invest(igations)
Any opinions or recommendations in this message are not opinions or recommendations of Portfolio123 Securities LLC.

May 18, 2020 4:47:44 PM       
Edit 1 times, last edit by yuvaltaylor at May 18, 2020 6:42:51 PM
paulnovell
Re: New engine released

Thanks a bunch Yuval.

Paul

May 19, 2020 1:43:54 AM       
paulnovell
Re: New engine released

OK, on to the next issue I've noticed in my strategies.

A strategy that ranks stock by a custom shareholder yield formula produces substantially different (over 3% in terms of annual return) results on the Current Engine between Compustat and Factset. The custom formulas is:

((DivPaid(0,ann)+( EqPurch(0,ann)-EqIssued(0,ann)))/mktcap)*100

The custom formula is used in a custom ranking which is then used in the strategy. The strategy it is used in is "QEDGE: Large Stocks SHY Top 25 - 04".

I tried to see if there was any big discrepancies in the individual stocks but didn't really notice anything.

Paul

May 19, 2020 3:22:02 AM       
atw
Re: New engine released

What is the difference between FactSet Fundamentals and FactSet Coverage?

Also, will p123 be changing data providers for short interest information? If so, will that go live on the new engine prior to July 1st?

Thank you.

Hugh

May 19, 2020 8:42:02 AM       
progscon
Re: New engine released

Can someone restate what the settings mean for the below. I have gotten confused on what the different combinations mean and how to use them for running current rules as well as a backtest. thanks. David V

Attachment Screen Shot 2020-05-19 at 8.06.13 AM.png (20611 bytes) (Download count: 69)


David Vornholt

May 19, 2020 9:10:29 AM       
Edit 1 times, last edit by progscon at May 19, 2020 9:11:23 AM
rodbarcv2
Re: New engine released

Since last weekend (which got the engine to use FactSet estimates), many of my sims that rely on sentiments are performing much worse with FactSet. For example, take "core: sentiment" and "basic: sentiment" ranks from portfolio123. The ranking graphs are different between Current Compustat and Current FactSet. (Current Compustat and Legacy Compustat look the same).

I didn't have a chance to go through the factors / formula used in these ranking, is this something that can be investigated by p123 team?

May 19, 2020 1:28:21 PM       
Posts: 90    Pages: 9    Prev 1 2 3 4 5 6 7 8 9 Next
 Last Post