Source author record

A. Ian McLeod

A. Ian McLeod appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

12works
4topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

12 published item(s)

preprint2016arXiv

Computer Algebra Derivation of the Bias of Burg Estimators

A symbolic method is discussed which can be used to obtain the asymptotic bias and variance to order $O(1/n)$ for estimators in stationary time series. Using this method the bias to $O(1/n)$ of the Burg estimator in AR(1) and AR(2) models is shown to be equal to that of the least squares estimators in both the known and unknown mean cases. Previous researchers have only been able to obtain simulation results for this bias because this problem is too intractable without using computer algebra.

preprint2016arXiv

Faster ARMA maximum likelihood estimation

A new likelihood based AR approximation is given for ARMA models. The usual algorithms for the computation of the likelihood of an ARMA model require $O(n)$ flops per function evaluation. Using our new approximation, an algorithm is developed which requires only $O(1)$ flops in repeated likelihood evaluations. In most cases, the new algorithm gives results identical to or very close to the exact maximum likelihood estimate (MLE). This algorithm is easily implemented in high level Quantitative Programming Environments (QPEs) such as {\it Mathematica\/}, MatLab and R. In order to obtain reasonable speed, previous ARMA maximum likelihood algorithms are usually implemented in C or some other machine efficient language. With our algorithm it is easy to do maximum likelihood estimation for long time series directly in the QPE of your choice. The new algorithm is extended to obtain the MLE for the mean parameter. Simulation experiments which illustrate the effectiveness of the new algorithm are discussed. {\it Mathematica\/} and R packages which implement the algorithm discussed in this paper are available (McLeod and Zhang, 2007). Based on these package implementations, it is expected that the interested researcher would be able to implement this algorithm in other QPE's.

preprint2016arXiv

Fitting MA(q) Models in the Closed Invertible Region

The use of reparameterization in the maximization of the likelihood function of the MA(q) model is discussed. A general method for testing for the presence of a parameter estimate on the boundary of an MA(q) model is presented. This test is illustrated with a brief simulation experiment for the MA(q) for q=1,2,3,4 in which it is shown that the probability of an estimate being on the boundary increases with q.

preprint2016arXiv

Hyperbolic decay time series

Hyperbolic decay time series such as, fractional Gaussian noise (FGN) or fractional autoregressive moving-average (FARMA) process, each exhibit two distinct types of behaviour: strong persistence or antipersistence. Beran (1994) characterized the family of strongly persistent time series. A more general family of hyperbolic decay time series is introduced and its basic properties are characterized in terms of the autocovariance and spectral density functions. The random shock and inverted form representations are derived. It is shown that every strongly persistent series is the dual of an antipersistent series and vice versa. The asymptotic generalized variance of hyperbolic decay time series with unit innovation variance is shown to be infinite which implies that the variance of the minimum mean-square error one-step linear predictor using the last $k$ observations decays slowly to the innovation variance as $k$ gets large.

preprint2016arXiv

Improved multivariate portmanteau test

A new portmanteau diagnostic test for vector autoregressive moving average (VARMA) models that is based on the determinant of the standardized multivariate residual autocorrelations is derived. The new test statistic may be considered an extension of the univariate portmanteau test statistic suggested by Pena and Rodriguez (2002, A Powerful Portmanteau Test of Lack of Test for Time Series, Journal of American Statistical Association) The asymptotic distribution of the test statistic is derived as well as a chi-square approximation. However, the Monte-Carlo test is recommended unless the series is very long. Extensive simulation experiments demonstrate the usefulness of this test as well as its improved power performance compared to widely used previous multivariate portmanteau diagnostic check. Two illustrative applications are given.

preprint2016arXiv

Improved Pena-Rodriguez Portmanteau Test

Several problems with the diagnostic check suggested by Pena and Rodriguez [2002. A powerful portmanteau test of lack of fit for time series. J. Amer. Statist. Assoc. 97, 601-610.] are noted and an improved Monte-Carlo version of this test is suggested. It is shown that quite often the test statistic recommended by Pena and Rodriguez [2002. A powerful portmanteau test of lack of fit for time series. J. Amer. Statist. Assoc. 97, 601-610.] may not exist and their asymptotic distribution of the test does not agree with the suggested gamma approximation very well if the number of lags used by the test is small. It is shown that the convergence of this test statistic to its asymptotic distribution may be quite slow when the series length is less than 1000 and so a Monte-Carlo test is recommended. Simulation experiments suggest the Monte-Carlo test is usually more powerful than the test given by Pena and Rodriguez [2002. A powerful portmanteau test of lack of fit for time series. J. Amer. Statist. Assoc. 97, 601-610.] and often much more powerful than the Ljung-Box portmanteau test. Two illustrative examples of enhanced diagnostic checking with the Monte-Carlo test are given.

preprint2016arXiv

Improved spread-location visualization

The spread-location plot has often been used as a diagnostic plot suitable for many types of fitted statistical models. The spread-location plot which plots the absolute residual or square-root absolute residual versus fitted value along with a robust loess smooth is a useful replacement for the customary practice of plotting residuals versus fitted values. In this note, we show that neither absolute residual or square-root absolute residual is always appropriate for error distributions likely to be encountered in actual applications. Hence we recommend a multipanel display showing a suitable transformation of the absolute residual versus fitted value along with a boxplot to judge the symmetry achieved by the transformation. We conclude with an illustrative example.

preprint2016arXiv

Parsimony, model adequacy and periodic correlation in forecasting time series

The merits of the modelling philosophy of Box \& Jenkins (1970) are illustrated with a summary of our recent work on seasonal river flow forecasting. Specifically, this work demonstrates that the principle of parsimony, which has been questioned by several authors recently, is helpful in selecting the best model for forecasting seasonal river flow. Our work also demonstrates the importance of model adequacy. An adequate model for seasonal river flow must incorporate seasonal periodic correlation. The usual autoregressive-moving average (ARMA) and seasonal ARMA models are not adequate in this respect for seasonal river flow time series. A new diagnostic check, for detecting periodic correlation in fitted ARMA models is developed in this paper. This diagnostic check is recommended for routine use when fitting seasonal ARMA models. It is shown that this diagnostic check indicates that many seasonal economic time series also exhibit periodic correlation. Since the standard forecasting methods are inadequate on this account, it can be concluded that in many cases, the forecasts produced are sub-optimal. Finally, a limitation of the arbitrary combination of forecasts is also illustrated. Combining forecasts from an adequate parsimonious model with an inadequate model did not improve the forecasts whereas combining the two forecasts of two inadequate models did yield an improvement in forecasting performance. These findings also support the model building philosophy of Box \& Jenkins. The non-intuitive findings of Newbold \& Granger (1974) and Winkler \& Makridakis (1983) that the apparent arbitrary combination of forecasts from similar models will lead to forecasting performance is not supported by our case study with river flow forecasting.

preprint2016arXiv

Partial autocorrelation parameterization for subset autoregression

A new version of the partial autocorrelation plot and a new family of subset autoregressive models are introduced. A comprehensive approach to model identification, estimation and diagnostic checking is developed for these models. These models are better suited to efficient model building of high-order autoregressions with long time series. Several illustrative examples are given.

preprint2016arXiv

Portmanteau Tests for ARMA Models with Infinite Variance

Autoregressive and moving-average (ARMA) models with stable Paretian errors is one of the most studied models for time series with infinite variance. Estimation methods for these models have been studied by many researchers but the problem of diagnostic checking fitted models has not been addressed. In this paper, we develop portmanteau tests for checking randomness of a time series with infinite variance and as a diagnostic tool for checking model adequacy of fitted ARMA models. It is assumed that least-squares or an asymptotically equivalent estimation method, such as Gaussian maximum likelihood in the case of AR models, is used. And it is assumed that the distribution of the innovations is IID stable Paretian. It is seen via simulation that the proposed portmanteau tests do not converge well to the corresponding limiting distributions for practical series length so a Monte-Carlo test is suggested. Simulation experiments show that the proposed test procedure works effectively. Two illustrative applications to actual data are provided to demonstrate that an incorrect conclusion may result if the usual portmanteau test based on the finite variance assumption is used.

preprint2016arXiv

Power Computations for Intervention Analysis

In many intervention analysis applications time series data may be expensive or otherwise difficult to collect. In this case the power function is helpful since it can be used to determine the probability that a proposed intervention analysis application will detect a meaningful change. Assuming that an underlying ARIMA or fractional ARIMA model is known or can be estimated from the pre-intervention time series, the methodology for computing the required power function is developed for pulse, step and ramp interventions with ARIMA and fractional ARIMA errors. Convenient formulae for computing the power function for important special cases are given. Illustrative applications in traffic safety and environmental impact assessment are discussed.