A discussion on replicating the Magic Formula

I have been asked numerous times about Joel Greenblatt’s Magic Formula ( https://www.magicformulainvesting.com/ ) in reference to quantitative investing.

In this blog post, I’ll share the most recent email exchange I had regarding the topic, and an excerpt from my book that covers the Magic Formula (MF). I think the exchange is informative as to how I view replicating other practitioner and scholarly work … to sum it up, exact replication is not only likely impossible, but could be a gigantic waste of time – data sources are often different, minuscule differences in analytical methods  lead to significantly different results.

I think this email exchange is instructive for understanding some of the issues and some of the goals quant investors often start with,. These goals of replication before creation are noble, but beyond a point, perfect replication is not particularly useful.

Initial email:

“I stumbled across your book, Principles of Quantitative Equity Investing, on Google Scholar while looking for more information on the work of Joel Greenblatt. Your book sounds like it focuses on his much acclaimed stock screen. I am looking for research on proving out his back-testing (essentially a “second test of his back-testing”). As you are undoubtedly aware he does not go into the finer details of how he sets up his screen. Is this something you show in detail in the book using Equities Lab?”

My 1st reply:

“Hi <interested investor>,

I do have a section on the MF (although that’s not the “focus” of the book). I do show how to replicate it, although both backtests and holdings don’t always line up exactly with those from the website and book.

You can look at my backtest below and the text preceding it (and actually, if you buy the book, it includes the software to do the backtest yourself).

pastedImage

Hope this helps – let me know if you need anything else.”

Reply to my email:

“Thanks for your response and the exert (sic) from your book, Sugata, much appreciated!

You mention you are able to return up to half of the stocks he does. Have you managed to improve on this since writing the book? I should also ask, do you use any of the quantitative methods you wrote about to manage your own portfolio? Given the apparent strength of the Greenblatt formula, it is strange to not see it publicised more. You show great results with it yourself, were you convinced?

Using S&P Capital IQ (I have an account through my employer) I manage to return about 2/3s of his list. Though I seem to have maxed out increasing this number by tinkering with the screen, hence my search for research done by others. I am also keen to apply it to other countries (in particular, the UK, <redacted>). I can’t do this until I have done the back-test myself. …”

My reply with answers:

“Answers below.

I’m happy to discuss further.

SR”

and then I answered my reader’s questions in-line in the email:

You mention you are able to return up to half of the stocks he does. Have you managed to improve on this since writing the book?

No – but I don’t really care to – why bother?

I should also ask, do you use any of the quantitative methods you wrote about to manage your own portfolio?

Yes.

Given the apparent strength of the Greenblatt formula, it is strange to not see it publicised more. You show great results with it yourself, were you convinced?

There are many other “formulas” out there – I think MF is an ok value based screen and value investing definitely works. I use simple PE ratios for my value screening, which also works very well. But then, value is only 1 of the 6 or 7 things I look for.

Using S&P Capital IQ (I have an account through my employer) I manage to return about 2/3s of his list. Though I seem to have maxed out increasing this number by tinkering with the screen, hence my search for research done by others.

Why try to recreate his list? I don’t see the point. I think a 2/3 match is good enough to know you’ve got the general idea right.

I am also keen to apply it to other countries (in particular, the UK, <redacted>). I can’t do this until I have done the back-test myself. Coming across historic index data is difficult though.

I’ve done little international work – I use Bloomberg – they have a powerful (if somewhat clunky) screening and backtesting product. The commands are EQS and EQBT if you’re interested.”

What is backtesting

Backtecting is simulating how a strategy would have performed, had we been following it historically

For example, if our strategy were: buy all profitable stocks in equal amounts, and rebalance quarterly ….

  1. Backtesting over 10 years would start in Oct 19th 2005,
  2. divide our money equally between all stocks that were profitable then,
  3. hold them until Jan 19th 2006,
  4. sell them at prices from Jan 19th 2006,
  5. reinvest the proceeds into stocks profitable in Jan 2006
  6. rinse and repeat until today … 40 quarters later

The report for the backtest would present how this strategy would have performed historically, and we could compare this to the index returns or other returns.