Greenblatt Ranking?

Was the Greenblatt ranking system changed yet again? One of my best models just tanked again (after tanking previously with the change to FactSet). The backtest performance has dropped roughly in half from the last time I checked, maybe a week ago.

Please advise, and if so please advise of what the changes were to the ranking.

Thanks.

I just tested on 3 of my sims and I note a marginally worse perf for 2 of them i.e. -0.3% annualized.

However, one of them shows a difference of -1.30% per year annualized - which after 20 years does start to make a difference.

All 3 are large caps SP500 or R1000

Jerome

Yes, it’s my large cap model that is limited to S&P 500 stocks that is affected.

No changes to the ranking system or any of the items it uses have been made.

I’m seeing some differences in simulation results between yesterday and today. They’re bigger than I usually see but not necessarily alarming. Perhaps the weekend data update is the root-cause of the reported problem.

Walter

I am seeing some major differences between my live sims (built when compustat was default) and equivalent simulations. Since I use mostly fundamental factors I wonder where the differences come from

I know there was talk of retaining compustat database for an extra fee. has anyone done that? and have the results held?

A few others and myself did complain about massive differences on GB (or close affiliates) ranking systems back in May / June when shifting from Compustat to Factset. As of today, I have not found a way to make it more “Factset-compatible”. Any bright idea welcomed…

See for example → https://www.portfolio123.com/mvnforum/viewthread_thread,12306#!#74021
or https://www.portfolio123.com/mvnforum/viewthread_thread,12249_offset,180#73929

Jerome

I have no problems with this ranking system.
See: Profiting From Trading Stocks Of The Technology Select Sector SPDR Fund - iM-Top5 XLK Select
https://seekingalpha.com/article/4375350-profiting-from-trading-stocks-of-technology-select-sector-spdr-fund-im-top5-xlk-select

I was otherwise distracted in June. But if anyone has kept record of the ranking during that time, we could try to see which companies were ranked differently and why

@RTNL:

look at this post and the discussion that followed → https://www.portfolio123.com/mvnforum/viewthread_thread,12249_offset,190#73994
The numbers are just completely different between Factset and compustat.

As for Greenblatt, $EV in particular is vastly different if my memory serves me correctly.

Yuval also pointed out that Financial Services are treated very differently between Factset and Compustat. Apparently Compustat “massages” the numbers for FS to make them comparable. Whatever they did, it was working well for me and the Factset change remains an issue.

Jerome

@Georg:

Interesting article as usual (I just skimmed through but will take the time to do it well later). Thank you.

But to answer the question in this thread, you would need to compare the results of your system using Factset vs Compustat, no?
(I assume you only used Factset here)

Jerome

I believe I found the issue - Enterprise Value/Sales has been disabled again for financials. I do recall a long discussion on this earlier, with Yuval’s opposition, but in any event this metric was working again - until last week anyway. Now this ratio no longer works for financials. I understand that Greenblatt didn’t include financials in his initial model, but I found that this metric was indeed very very helpful. And for what it’s worth my “bank” strategy, which doesn’t use Greenblatt at all, has stopped working completely, because using Enterprise Value/Sales is disabled. Again, I found this metric, as a secondary input, had proven to be very helpful. Frustrating, as having to work within the “academic” constraints would mean poorer returns for my strategies.

Can we please enable the Enterprise Value/Sales for all stocks? If caveat emptor applies, so be it, I’ll take responsibility for my results.

Thanks.

Hi Jerome - actually I do not use financials in my greenblatt model.

In those that I do - i measure valuation differently (earnings metric/mktcap)

But still I am seeing changes in results.

I’m afraid I don’t understand the problem here. EV/SalesTTM functions just as it should, whether it’s a financial company or not. It hasn’t been “disabled” as far as I can tell.

There are a few companies for which EV = NA, but not that many.

This is just a quick example of what I see. I could provide more, but not sure it’s necessary.


Hi mm123.

Was looking at your post - not sure what’s happening, but wanted to let you know I’m getting results for EV and Sales for BAC and JPM.


Also please see https://www.portfolio123.com/mvnforum/viewthread_thread,12468 which pertains to the Greenblatt ranking system.

I do too, which makes this such a mystery as to why the ratio fails. Fwiw a cursory review suggests it only fails for these industries within financials:

BANKSUSA
BANKSINTL
INVESTSVCE

See attached.

It works for most insurers, except some international ones.

There’s a bug somewhere.


Maybe try inputing a new formula, just to test if it’s something with that particular custom formula being corrupted? I created a custom EV2SalesTTM formula for the view shown above (see column at far right of my screenshot) and the calculation worked at least for me. Makes me wonder if something about the custom formula is bugged? Anyhow, hope you can find the issue.