Expected Shortfall in a Prediction Market Setting
How bad can things get? A risk measure provides an answer.
Suppose you are presented with a wager costing 0.4 which returns 1 with probability 0.5 and otherwise zero. Such a wager has an expected return of 25%. You can make this wager once a day over the next 10 days. Suppose you do. How bad can things get? We know that there's a small probability ($0.5^{10}$) that you lose 4 (i.e., you lose all 10 wagers). And there's a larger probability, $10 \cdot 0.5^{10}$, that you lose 3 (i.e., win one, lose 9). Although these are useful pieces of information, we might wish for a single-number summary of the riskiness of our planned series of bets. Expected shortfall is one such measure of risk. It describes how much you should expect to lose if things go bad. $\newcommand{\VaR}{\text{VaR}} \newcommand{\E}{\text{E}}$
Expected shortfall, also known as conditional value at risk, is typically defined in terms of value at risk (VaR). Let's begin by defining value at risk. (VaR is also a risk measure, just not a particularly good one.) For a given set of wagers (“portfolio”) over a defined period of time and a specified confidence level α, the VaR is the (1-α)-quantile of the portfolio's loss distribution. If the profit-and-loss distribution is X then $\VaR_α(X)$ is the (1-α)-quantile of Y := -X. (Losses are negative, profits positive.) Suppose our portfolio X has a standard normal distribution. Then the VaR at level 0.05 of our portfolio is 1.645. 1.645 is the 0.95-quantile of -X. Suppose, alternatively, that our portfolio Z has a probability of 0.05 of losing 2 million or more. The VaR at level 0.05 of the portfolio is 2 million. 2 million is the 0.95-quantile of -Z.
Expected shortfall, like value at risk, is defined with respect to a period of time and a confidence level α. It is the expected loss in the worst α of cases. If the profit-and-loss distribution is X and X follows a continuous probability distribution then the expected shortfall of X at level α is the E Sα = E[– X | X ≤ – VaRα(X)]. This is the left-tail conditional expectation below –$\VaR_α(X)$. Suppose again that our portfolio X has a standard normal distribution. Then the expected shortfall at level 0.05 of our portfolio is 2.0627. Expected shortfall, like value at risk, is a single-number measurement of how much we should expect to lose if things go bad.
Expected shortfall is a better measure of downside risk than VaR because expected shortfall gives us the average loss when things go bad. VaR, by contrast, tells you a single example of a bad outcome. Consider the following example of a portfolio X which has an expected 2% return. The portfolio costs 1 to acquire and returns 1.6 with probability 0.95, 0 with probability 0.04, and -50 with probability 0.01. The VaR at level 0.05 of this portfolio is 0. The expected shortfall at level 0.05 is 10. 0 is an example of a bad outcome (VaR). 10 is a measure of the average badness, given a bad outcome. Expected shortfall provides a richer description of downside risk than VaR. For this reason people tend to prefer it whenever it is available.
In a prediction market setting, use expected shortfall to characterize the downside risk of a portfolio of wagers. Consider the example of a portfolio which consists of 10 independent wagers. Each wager costs 0.5 and pays out 1 with probability 0.51. (This portfoilio has an expected return of 2%.) To calculate the expected shortfall we calculate the left-tail conditional expectation below $-\VaR_α(X) = 2$. Calculating this can be accomplished in at least two ways. Simulating the portfolio is likely the easiest way. We arrive at an expected shortfall of 3.21.
When considering different portfolios which we might purchase, it is natural to ask about the typical case: How much do we stand to gain (or lose) on average? It is also natural—or should be natural—to ask how bad things can get. Expected shortfall provides an answer. Expected shortfall describes how much you should expect to lose if things go bad.
This post is part of a series. The most recent post in the series is “Virtues of prediction markets: Useful baselines”. Learn when new posts appear by subscribing (RSS). You may also follow @prediction-markets@write.as in Mastodon or subscribe for email updates.
#predictionmarkets #expectedshortfall #conditionaltailrisk #valueatrisk
Figure 1: The probability of one of these five candidates winning is 87%, in the judgement of PredictIt participants in late May 2019. There are many other candidates in this race. The prediction market here tells us that some candidates stand a far better chance than other candidates.
Figure 1: A sure bet on PredictIt. The sure bet shown here was available during several days in May 2019. This sure bet consists of wagering against the Republican candidate winning and also against the Democratic candidate winning. (This second wager is equivalent to betting on the Republican candidate winning.) Making these wagers costs less than 1. The bet against Republican costs 43¢ (100¢ – 58¢ + 1¢) and the bet against Democrat costs 56¢ (100¢ – 45¢ + 1¢). (The spread, in both cases, was 1¢.) Purchasing one of each contract costs 99¢.
Figure 1: Return on two different repeated (independent) gambles. Each figure shows the return associated with making a specific bet 100 times where the outcome of each bet is independent. The expected return of both bets is the same.
Figure 1: Bid-offer spreads for three contracts concerning the 2020 United States presidential election. Bid and offer prices are not labeled according to standard conventions. The price in the second column of prices is associated with the lowest offer. The price in the third column is associated with the highest bid. The bid-offer spread for all three contracts is 0.01 USD.