Following the evidence has become an increasingly important idea in investing in recent years. If we want to make informed decisions, it makes sense to understand what the evidence tells us. Unfortunately, following the evidence will not lead us to a definitive, correct answer – financial markets are far too messy and capricious for that. What evidence we choose to use and how we apply it is highly subjective and involves a host of trade-offs, which can lead reasonable people to disagree.
Of course, not all evidence is created equal, some is robust and compelling – fees matter a lot to long-term returns and trying to time markets is a bad idea – but much of it is imperfect. A robust piece of evidence may directly contradict another equally strong argument. Investment decision making is about understanding what we are trying to achieve, assessing the available evidence and drawing a necessarily uncertain conclusion.
To give a sense of how difficult it is to just ‘follow the evidence’, I wanted to give some examples of how the inescapable complexity of financial markets means that investors are perennially forced to make a whole host of subjective calls:
Static asset allocation versus valuation sensitivity: There is plenty of evidence that holding a static 60/40 portfolio allocation is an approach that is hard to beat over time. This idea, however, is probably outweighed by the evidence that valuations are a crucial driver of long-term return and risk. If we are following the evidence, what should we do? If we decide on fixed allocations, we ignore the evidence on valuations, if we make allocation adjustments over time based on changing valuations we ignore the evidence on the cost of taking active views. It is possible to argue either side and cite strong evidence – and this means we need to take a view.
Market cap equity versus equal weight equity: In 2013, a group of academics published a paper looking at alternatives to market cap weighting in equity indices and they found that doing ‘anything’ was better than a cap weighted approach – including portfolios ‘selected by monkeys’. At the time of publication, someone following the evidence could have quite justifiably preferred an equal weighted equity index fund compared to a traditional market cap weighted index fund. If they had done so, their relative performance would have been absolutely trounced in the years that followed. A lovely reward for taking heed of the evidence available.
Not only would following the evidence have cost them, but the consensus now would be that market cap is superior to other approaches. So, with the benefit of hindsight, it would look like we were not guided by the evidence at all.
Global allocation and private markets: Many long-term investors reasonably take the view that the most prudent approach is to own something akin to the ‘global market portfolio’ and tailor it to their risk appetite. Given that private markets are a decent slice of the investable universe and more feasible access routes are emerging, does that mean these investors should now incorporate such strategies? Maybe. Or perhaps they should consider the evidence that expensive and complex products tend to come at a cost to clients over the long-run. There is an explicit choice to be made.
The small cap effect: On reading Fama and French’s seminal 1992 paper, an evidence-minded investor may have titled their equity portfolio towards smaller firms. The problem is that the evidence since publication has suggested that the size effect is only present in micro-caps, that it only works if you control for quality, or may not exist at all. Not only might seemingly compelling evidence be unreliable, it can also change based on better methods or new information. If you still believe in a small cap premium you are underweighting more recent evidence – which is fine – but it is an active choice that needs to be justified.
Domestic bias: What does the evidence say about holding a domestic bias in our portfolios? It is a bad idea for most people, unless you happen to live in the US – then it looks like a great one. If I am in the US, should I rely more on the general rule about the cost and risk of a domestic bias, or the specific case of being a US investor? I have an opinion on this, but there will be plenty of people who disagree because of the evidence they choose to use.
—
There are many more examples of this I could give but the broad point is that very few things are simple or easy in the world of investing. The evidence about the investment decisions we should make is opaque, changeable and often conflicting. Even if we have all the relevant information to hand, it still requires us to have opinions and own them. We will never alight upon the right answer, just the one we think makes the most sense to us based on what we observe and who we are.
I am worried that by writing this I am giving a charter to make poor decisions and justify them by saying that because the evidence is incomplete anything goes. This is not the case. It is critical to filter out the nonsense and noise as best we can (and there is a lot of it). Even when we do, however, and are left with only high-quality information, we still have to discard or underweight some parts and emphasise others.
Judging the quality of the evidence available is not just a challenge due to the sheer scale of material available, but the fact that it changes (or at least can appear to). Does twenty years of data that conflicts with the prior eighty years overwhelm it? When have markets sufficiently changed so that certain information is no longer valid? How valid is that 120-year data set today? Are we in a different regime now? Not only is it difficult to know what evidence should really matter, it is difficult to stick with something that is well-supported by the evidence available because – inevitably – there will be spells when it looks utterly incorrect.
Taking the time to assess the evidence and incorporate it into our decision making is crucial and the key underpinning of any investment process. It doesn’t, however, guarantee that it will lead to positive results – even if we do it well. We should, of course, still try, but we will need a little dose of good luck as well. All we can try to do is get the odds on our side.
I have focused here on the complexity and noisiness of financial market evidence. I have not started to touch upon the way in which we as individuals source, interpret and employ evidence – incentives, experience, temperament, environment and many other factors will all have a huge influence on how we engage with it. We are as muddled as the information we use.
Using evidence well is integral to good investment decision making but, unfortunately, there is not only one way to do it nor only one sensible answer to find.
—
My first book has been published. The Intelligent Fund Investor explores the beliefs and behaviours that lead investors astray, and shows how we can make better decisions. You can get a copy here (UK) or here (US).
All opinions are my own, not that of my employer or anybody else. I am often wrong, and my future self will disagree with my present self at some point. Not investment advice.