The Fundamentals of Heavy Tails: Properties, Emergence, & Estimation

By Jayakrishnan Nair, Adam Wierman, and Bert Zwart

Available for pre-order at Amazon and Cambridge University Press.

Abstract

Heavy tails–extreme events or values more common than expected–emerge everywhere: the economy, natural events, and social and information networks are just a few examples. Yet after decades of progress, they are still treated as mysterious, surprising, and even controversial, primarily because the necessary mathematical models and statistical methods are not widely known. This book, for the first time, provides a rigorous introduction to heavy-tailed distributions accessible to anyone who knows elementary probability. It tackles and tames the zoo of terminology for models and properties, demystifying topics such as the generalized central limit theorem and regular variation. It tracks the natural emergence of heavy-tailed distributions from a wide variety of general processes, building intuition. And it reveals the controversy surrounding heavy tails to be the result of flawed statistics, then equips readers to identify and estimate with confidence.

A pre-publication version of the book can be downloaded here.

Table of contents

  1. Introduction
    • Defining heavy-tailed distributions
    • Examples of heavy-tailed distributions
    • What’s next?

Part I: Properties

  1. Scale invariance, power laws, and regular variation
    • Scale invariance and power laws
    • Approximate scale invariance and regular variation
    • Analytic properties of regularly varying functions
    • An example: Closure properties of regularly varying distributions
    • An example: Branching processes
  2. Catastrophes, conspiracies, and subexponential distributions
    • Conspiracies and catastrophes
    • Subexponential distributions
    • An example: Random Sums
    • An example: Conspiracies and catastrophes in random walks
  3. Residual lives, hazard rates, and long tails
    • Residual lives and hazard rates
    • Heavy tails and residual lives
    • Long-tailed distributions
    • An example: Random extrema

Part II: Emergence

  1. Additive processes
    • The central limit theorem
    • Generalizing the central limit theorem
    • Understanding stable distributions
    • The generalized central limit theorem
    • A variation: The emergence of heavy-tails in random walks
  2. Multiplicative processes
    • The multiplicative central limit theorem
    • Variations on multiplicative processes
    • An example: Preferential attachment and Yule processes
  3. Extremal processes
    • A limit theorem for maxima
    • Understanding max-stable distributions
    • The extremal central limit theorem
    • An example: Extremes of random walks
    • A variation: The time between record breaking events

Part III: Estimation

  1. Estimating power-law distributions: Listen to the body
    • Parametric estimation of power-laws using linear regression
    • Maximum likelihood estimation of power-law distributions
    • Properties of the maximum likelihood estimator
    • Visualizing the MLE via regression
    • A recipe for parametric estimation of power-law distributions
  2. Estimating power-law tails: Let the tail do the talking
    • The failure of parametric estimation
    • The Hill estimator
    • Properties of the Hill estimator
    • The Hill plot
    • Beyond Hill and regular variation
    • Where does the tail begin?
    • Guidelines for estimating heavy-tailed phenomena
Contact

California Institute of Technology
1200 E. California Boulevard
MC 305-16
Pasadena, CA 91125

215 Annenberg
(626) 395-6569

adamw@caltech.edu

Assistant

Jolene Brink
345 Annenberg
(626) 395-2813
jbrink@caltech.edu

Centers/Groups

RSRGDOLCITCSISCMI
ISTRSICAST