Yanfei Kang1, Rob J Hyndman2, Kate Smith-Miles3

  1. School of Statistics, Renmin University of China.
  2. Department of Econometrics and Business Statistics, Monash University, Australia.
  3. School of Mathematical Sciences, Monash University, Australia.

International Journal of Forecasting (2017). 33(2), 345-358.

It is common practice to evaluate the strength of forecasting methods using collections of well-studied time series datasets, such as the M3 data. But how diverse are these time series, how challenging, and do they enable us to study the unique strengths and weaknesses of different forecasting methods? In this paper we propose a visualisation method for a collection of time series that enables a time series to be represented as a point in a 2-dimensional instance space. The effectiveness of different forecasting methods can be visualised easily across this space, and the diversity of the time series in an existing collection can be assessed. Noting that the M3 dataset is not as diverse as we would ideally like, this paper also proposes a method for generating new time series with controllable characteristics to fill in and spread out the instance space, making generalisations of forecasting method performance as robust as possible.

Download working paper

Online paper