The world’s leading publication for data science, AI, and ML professionals.

Do Stocks Provide a Positive Expected Return?

We use Statistics and Simulation to Quantify how Confident we can be that the S&P 500 will Beat Cash (Treasury Bills)

Photo by Mark Finn on Unsplash
Photo by Mark Finn on Unsplash

If you would like to run the code yourself, you can find it on my Github here.


One of the bedrock assumptions of investing and retirement Finance is that stocks will deliver a higher return over time versus safer investment assets like cash or Treasury bonds. But do they?

In this post, we will examine the numbers, run some simulations, and ultimately quantify our confidence level that the S&P 500 (an investible index of large U.S. firms) will provide us a positive expected return in excess of U.S. Treasury Bills (cash).

A few definitions:

Nominal Returns = Investment returns that are NOT inflation adjusted

Real Returns = Investment returns that ARE inflation adjusted


Why Should We Care?

Despite all the investment options we have today, the S&P 500 is still the workhorse of most portfolios. For example, the popular SPY, an ETF (Exchange Traded Fund) that tracks the S&P 500, has net assets of over $278 Billion as of May 23, 2019. And it is just one of many funds that track the S&P 500.

Even if you didn’t buy the S&P 500 outright, you probably own some. Let’s assume you are currently 30 years old and invested in the Vanguard 2055 Target Date Fund in your 401k plan (designed for people planning to retire in the year 2055). That fund invests 54% of its assets in the Total Stock Market Index Fund which is just about the same thing as the S&P 500.

So basically everyone has at least some of their money in it.


The Flip Side of Return is Risk

One thing that you will hear a lot working in finance is that "There is no free lunch." (Except at Google, sorry lame joke) What finance folk mean when they say this is that there is no excess return without some accompanying risk.

Let’s think about what this means.

Risk Free Benchmark Rate

First, why did I say excess return? There is never only one thing we can invest in with our money. Every decision is a tradeoff – if I invest in the S&P 500 then that money becomes tied up and can no longer be invested in gold, Treasury Bonds, Japanese stocks, crude oil, or anything else (until we sell).

Every financial decision that we make should be benchmarked appropriately. And the most fundamental benchmark in finance is the risk free rate – the rate of return that we can earn with zero effort and zero risk.

The risk free rate that we generally use is the Treasury Bill Rate (I use the One Year T-Bill rate in this post). Treasury Bills are short term debt instruments (maturing in one year or less) issued by the U.S. government and regarded as default free. Going forward, I will refer to the One Year Treasury Bill and cash interchangeably, as T-Bills are widely considered a cash equivalent. Let’s take a look at what this rate looks like:

One Year Treasury Bill Rate
One Year Treasury Bill Rate

As you can see, the cash rate has varied quite a bit going from double digits during the high inflation 1970s to nearly zero over the past decade (in response to the Financial Crisis). One thing to note is that the One Year T-Bill rate is not truly risk free in real terms – if inflation is higher than the rate you earn, you will end up with a negative real return. TIPS (Treasury Inflation Protected Securities) would be a good candidate for the risk free asset but they were not widely adopted until the 1990s (so less data).

You should Demand More Return for Taking on More Risk

Second, the more risk you take on, the higher the return you should expect. Otherwise why risk your money? The following plot illustrates this risk vs. return relationship.

Always demand more bang for your buck!
Always demand more bang for your buck!

So why should we believe that something risky like U.S. stocks will provide us a positive expected return over cash? The classic answer is that when we buy a share of the company, we are providing financial capital to help grow and run the business – we are performing a service and should expect to be paid for it.

And like making a personal loan to a friend, there is a risk that you may get only a portion of your money back or none at all. So in essence the higher expected return of stocks, much like the interest rate on a loan, is there to compensate you for that risk. But does it?

Mean Annual Return of S&P 500 Including Dividends (1962–2017): 10.9%

Mean Risk Free Rate (1962–2017): 5.2%

The average returns look decent but just looking at averages can trick us. The following chart compares annual stock returns to the risk free rate. Three things jump out:

  1. S&P 500 returns exhibit much higher volatility than cash returns.
  2. Cash has outperformed the S&P 500 many times.
  3. Pre-1990, cash seemed to outperform stocks more often than post-1990.
  4. Post 2008, stocks have easily beat cash because risk free rates have been locked to zero by the Federal Reserve.
Stocks returns vary much more than cash returns
Stocks returns vary much more than cash returns

Testing our Hypothesis with some Simulations

Instead of calculating test statistics and running a formal hypothesis test, let’s visualize the process by running some simulations (a very similar analysis in spirit).

I ran 5,000 one year simulations with the following assumptions:

  • Stock returns are normally distributed with an expected return of 10.9% and standard deviation of 15.2%.
  • The risk free rate (cash return) has an expected value of 5.2% and standard deviation of 3.4% but cannot go below 0%.
  • The above values were estimated using historical data (1962–2017). One could argue that the high inflation (and high interest rate) 1970s were an anomaly but we are already data constrained so I have decided to use as much data as possible in my analysis.
  • Stock and cash returns are independent.
  • I did not inflation adjust any of these values (everything is in nominal terms).

Cash beats stocks in 35% of the simulations that I ran! That’s not great. So in any given year, the chances that the S&P 500 will outperform cash is just 2 out of 3.

For a visualization, check out the histogram of my simulation results below. Note the vertical orange line at x=0; that happens because I don’t allow the nominal return of cash to go below 0% (and neither should you, if your bank tries to charge you for holding onto your money, it is time to change banks). Thus, there is a large amount of instances where cash return equals 0%.

Stocks look pretty risky...
Stocks look pretty risky…

That’s not all. Recall that we estimated our expected returns and standard deviations using only 56 years of history – that is not a lot of data. So there is a second level of uncertainty – uncertainty around our estimates of the population parameters (for simplicity, we will focus on addressing the uncertainty around expected returns and ignore the uncertainty around the standard deviations).

We can attempt to capture this uncertainty by applying a standard error to our estimates of expected returns. The standard error is basically the standard deviation of our estimate of the true mean. That is, the standard error tries to answer the question – if we ran this experiment many times (pretend we can) and calculated the expected return each time, how much variation would we observe in this expected return estimate?

We can calculate the standard error (SE) as:

SE = Sample_Standard_Deviation / sqrt(Sample_Size)

SE_S&P500 = 15.22% / sqrt(56) = 2.03%

SE_Cash = 3.36% / sqrt(56) = 0.45%

Modifying our Simulation for Uncertainty Around Our Parameters

Since there is no practical limit to the number of simulations we can run, let’s just express our uncertainty around the true value of the expected returns as an additional source of randomness. Here is our setup:

  • Run 5,000 experiments.
  • Where each experiment consists itself of 5,000 one year simulations. Except now the expected returns of the S&P 500 and cash are no longer fixed; rather they are themselves random variables (that are distributed according to the Student’s t distribution) whose standard deviation is equal to their respective standard errors.

So we are just repeating what we did earlier (the earlier histogram) 5,000 times (like a nested loop), each time allowing the variables we are uncertain about (expected returns) to change. Let’s take a look to see how that looks (remember the vertical orange line is there because I don’t allow negative cash returns, thus there are many instances where cash return = 0%). The shape looks about the same as before, just smoother because we ran so many simulations.

Looks about the same as before
Looks about the same as before

Looking at the stats, nothing has really changed (cash still wins 35% of the time on an annual basis).

So was this all for nothing (it was actually useful for my own intuition to check whether uncertainty around estimates would drive even more variance – seems like it did not)?

Or maybe we didn’t ask the right question…


Stocks Look Better when you Extend your Investment Horizon

Buy and hold is a popular investment strategy for a reason. We shouldn’t judge our investments in terms of days, weeks, or even months. We are Investing to build long term wealth and to fund our retirements.

Recall that previously we found that cash wins 35% of the time (out of our 5,000 simulations). Let’s take a look at how the amount of time that we buy and hold for (the holding period) impacts the cash win percentage:

The longer your holding period, the more likely that stocks will beat cash
The longer your holding period, the more likely that stocks will beat cash

If we buy and hold stocks for 5 years, the probability that cash wins drops from 35% to 25%. If we buy and hold for 10 years, it drops to 18%. And if we buy and hold for 20 years, the probability of stocks underperforming cash goes all the way down to 12%. Still not ideal, but that is significantly better.

So at a long enough horizon, it seems like a reasonable bet to say that stocks will return better than cash – with a 20 year investment horizon, stocks beat cash 7 out of 8 times.

Let’s build some intuition into why a longer holding period makes stocks more attractive relative to cash. The main reason is that as you increase your holding period, expected returns start to matter more than volatility (standard deviation). Let’s look at the equation for expected return over a five year holding period:

5_yr_return = (1 + annual_return)⁵ – 1

And here is the standard deviation (stdev) of your cumulative return if you held an investment asset for five years:

5_yr_stdev = annual_stdev * sqrt(5)

Notice anything cool? If you take away just one thing from this post, I want it to be the following point. This is probably the most important concept in all of finance:

Expected returns compound exponentially with time but volatility (standard deviation) scales with just the square root of time.

This means that as more years pass, the volatility of your investments get swamped by the returns, provided that the expected returns are high enough (returns outweigh volatility over long periods of time). You will hear this referred to as the Power of Compounding. Let’s check this out visually:

Return starts to take off relative to volatility
Return starts to take off relative to volatility

The previous chart makes stocks seem like a no brainer but remember, we care less about the absolute return of stocks and more about the excess return of stocks over cash. And the same compounding benefits that benefit stocks help cash as well.


Stress Test

It would be too easy to just say, "Hold stocks for 20 years and you are good to go." So let us stress test our assumptions a little bit.

Earlier, we calculated the standard error for stocks (the standard deviation around our estimate of the expected return) to be 2.03%. So it would not be surprising at all if the actual realized return for stocks turned out to be 1.0% lower (9.9% instead of the 10.9% we estimated).

What happens to our probabilities of cash beating stocks across various investment horizons if stock returns turned out lower than we expected? Unsurprisingly, things get worse across the board and now even at a 20 year horizon, cash beats the S&P 500 nearly 1 out of 5 times.

Gets worse but longer holding periods still help
Gets worse but longer holding periods still help

Conclusion

So does the S&P 500 tend to outperform One Year Treasury Bills? Generally yes. But in any given year, we should expect wildly diverging results (stocks win only approximately 2 times out of 3). And even held over 20 years, we cannot be extremely confident that we are better off investing in stocks (stocks win roughly 7 times out of 8).

So why bother with stocks then? As I mentioned above, while cash is risk free in the nominal sense, it is extremely exposed to the ravages of inflation.

Stocks, on the other hand, because of their higher expected return and the ability of companies to raise prices on their goods and services are relatively less exposed to inflation.

So stocks remain one of our better bets to build real (inflation adjusted) wealth over long time horizons – but as we have seen, they are in no way a sure bet.


Sources:

Data for S&P 500 returns obtained from Robert Shiller’s website.

Data for Treasury Bill rates obtained from FRED.


Related Articles

Some areas of this page may shift around if you resize the browser window. Be sure to check heading and document order.