Forecasting time series with complex seasonal patterns using exponential smoothing

Alysha M De Livera and Rob J Hyndman

Abstract
A new innovations state space modeling framework, incorporating Box-Cox transformations, Fourier series with time varying coefficients and ARMA error correction, is introduced for forecasting complex seasonal time series that cannot be handled using existing forecasting models. Such complex time series include time series with multiple seasonal periods, high frequency seasonality, non-integer seasonality and dual-calendar effects. Our new modelling framework provides an alternative to existing exponential smoothing models, and is shown to have many advantages. The methods for initialization and estimation, including likelihood evaluation, are presented, and analytical expressions for point forecasts and interval predictions under the assumption of Gaussian errors are derived, leading to a simple, comprehensible approach to forecasting complex seasonal time series. Our trigonometric formulation is also presented as a means of decomposing complex seasonal time series, which cannot be decomposed using any of the existing decomposition methods. The approach is useful in a broad range of applications, and we illustrate its versatility in three empirical studies where it demonstrates excellent forecasting performance over a range of prediction horizons. In addition, we show that our trigonometric decomposition leads to the identification and extraction of seasonal components, which are otherwise not apparent in the time series plot itself.

Keywords: exponential smoothing, Fourier series, prediction intervals, seasonality, state space models, time series decomposition.

Download pdf

Exponential smoothing and non-negative data

Md. Akram1, Rob J. Hyndman1 and J. Keith Ord2
Australian and New Zealand Journal of Statistics (2009), 51(4), 415-432.
  1. Department of Econometrics and Business Statistics, Monash University, VIC 3800, Australia.
  2. McDonough School of Business, Georgetown University, Washington, DC20057, USA.

Abstract The most common forecasting methods in business are based on exponential smoothing and the most common time series in business are inherently non-negative. Therefore it is of interest to consider the properties of the potential stochastic models underlying exponential smoothing when applied to non-negative data. We explore exponential smoothing state space models for non-negative data under various assumptions about the innovations, or error, process.

We first demonstrate that prediction distributions from some commonly used state space models may have an infinite variance beyond a certain forecasting horizon. For multiplicative error models which do not have this flaw, we show that sample paths will converge almost surely to zero even when the error distribution is non-Gaussian. We propose a new model with similar properties to exponential smoothing, but which does not have these problems, and we develop some distributional properties for our new model.

We then explore the implications of our results for inference, and compare the short-term forecasting performance of the various models using data on the weekly sales of over three hundred items of costume jewelry.

The main findings of the research are that the Gaussian approximation is adequate for estimation and one-step-ahead forecasting. However, as the forecasting horizon increases, the approximate prediction intervals become increasingly problematic.  When the model is to be used for simulation purposes, a suitably specified scheme must be employed.

Keywords: forecasting; time series; exponential smoothing; positive-valued processes; seasonality; state space models.

Online paper

Contributions to the International Encyclopedia of Statistical Science

Rob J Hyndman
International Encyclopedia of Statistical Science, ed. Miodrag Lovric, Springer (2010)

I have written three articles for this new encyclopedia:

Nonparametric time series forecasting with dynamic updating

Han Lin Shang and Rob J Hyndman
Abstract

We present a nonparametric method to forecast a seasonal univariate time series, and propose four dynamic updating methods to improve point forecast accuracy. Our methods consider a seasonal univariate time series as a functional time series. We propose first to reduce the dimensionality by applying functional principal component analysis to the historical observations, and then to use univariate time series forecasting and functional principal component regression techniques. When data in the most recent year are partially observed, we improve point forecast accuracy using dynamic updating methods. We also introduce a nonparametric approach to construct prediction intervals of updated forecasts, and compare the empirical coverage probability with an existing parametric method. Our approaches are data-driven and computationally fast, and hence they are feasible to be applied in real time high frequency dynamic updating. The methods are demonstrated using monthly sea surface temperatures from 1950 to 2008.

Keywords: Functional time series, Functional principal component analysis, Ordinary least squares, Penalized least squares, Ridge regression, Sea surface temperatures, Seasonal time series.

Online paper

ftsa package for R

The ftsa package provides tools for modelling and forecasting functional time series.

Read the rest of this entry »

fds package for R

The fds package provides functional data sets useful for testing new methods.

Read the rest of this entry »

expsmooth package for R

The expsmooth package for R provides data sets from the book “Forecasting with exponential smoothing: the state space approach” by Hyndman, Koehler, Ord and Snyder (Springer, 2008).

Read the rest of this entry »

Mcomp package for R

The Mcomp package for R provides the 1001 time series from the M-competition (Makridakis et al. 1982) and the 3003 time series from the IJF-M3 competition (Makridakis and Hibon, 2000). Read the rest of this entry »

fma package for R

The fma package for R provides all data sets from “Forecasting: methods and applications” by Makridakis, Wheelwright & Hyndman (Wiley, 3rd ed., 1998). Read the rest of this entry »

forecast package for R

The forecast package for R provides methods and tools for displaying and analysing univariate time series forecasts including exponential smoothing via state space models and automatic ARIMA modelling. It also includes a handful of data sets from the Time Series Data Library. The package is described in Hyndman and Khandakar (2008). Read the rest of this entry »