Hidden Markov Models as a Tool for the Assessment of Dependence of Phenomena of Economic Nature

Michał Bernardelli

doi:10.18778/0208-6018.338.01

Authors

Michał Bernardelli Warsaw School of Economics, College of Economic Analysis, Institute of Econometrics

DOI:

https://doi.org/10.18778/0208-6018.338.01

Keywords:

dependence measure, correlation, hidden Markov model, Viterbi path

Abstract

The assessment of dependence between time series is a common dilemma, which is often solved by the use of the Pearson’s correlation coefficient. Unfortunately, sometimes, the results may be highly misleading. In this paper, an alternative measure is presented. It is based on hidden Markov models and Viterbi paths. The proposed method is in no way universal but seems to provide quite an accurate image of the similarities between time series, by disclosing the periods of convergence and divergence. The usefulness of this new measure is verified by specially crafted examples and real‑life macroeconomic data. There are some definite advantages to this method: the weak assumptions of applicability, ease of interpretation of the results, possibility of easy generalization, and high effectiveness in assessing the dependence of different time series of an economic nature. It should not be treated as a substitute for the Pearson’s correlation, but rather as a complementary method of dependence measure.

Downloads

Download data is not yet available.

Author Biography

Michał Bernardelli, Warsaw School of Economics, College of Economic Analysis, Institute of Econometrics

References

Baum L.E., Petrie T., Soules G., Weiss N. (1870), A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains, “The Annals of Mathematical Statistics”, vol. 41, no. 1, pp. 164–171.
Google Scholar

Bernardelli M. (2013), Non‑classical Markov Models in the Analysis of Business Cycles in Poland, “Annals the Collegium of Economic Analysis”, vol. 30, pp. 59–74.
Google Scholar

Cappé O., Moulines E., Rydén T. (2005), Inference in Hidden Markov Models, Springer Series in Statistics, Springer‑Verlag, New York.
Google Scholar

Dhrymes P.J. (1997), Time Series, Unit Roots, and Cointegration, Academic Press, San Diego.
Google Scholar

Guilford J.P. (1956), Fundamental statistics in psychology and education, McGraw‑Hill, New York.
Google Scholar

Hamilton J.D. (1989), A New Approach to the Economic Analysis of Non‑stationary Time Series and Business Cycle, “Econometrica”, no. 57, pp. 357–384.
Google Scholar

Joe H. (1997), Multivariate Models and Dependence Concepts, Monographs in Statistics and Applied Probability (Book 73), Chapman and Hall, London.
Google Scholar

Kendall M.G., Stuart A. (1973), The Advanced Theory of Statistics, vol. 2: Inference and Relationship, Griffin, New York.
Google Scholar

Lhermitte S., Verbesselt J., Verstraeten W.W., Coppin P. (2011), A comparison of time series similarity measures for classification and change detection of ecosystem dynamics, “Remote Sensing of Environment”, vol. 115(12), pp. 3129–3152.
Google Scholar

Maddala G.S., Kim I. (1998), Unit Roots, Cointegration, and Structural Change, Cambridge University Press, Cambridge, pp. 155–248.
Google Scholar

Nelsen R.B. (2006), An Introduction to Copulas, Second Edition, Springer‑Verlag New York.
Google Scholar

Parzen E., Mukhopadhyay S. (2012), Modeling, dependence, classification, united statistical science, many cultures, https://arxiv.org/abs/1204.4699 [accessed: 20.01.2018].
Google Scholar

Pearson K. (1895), Notes on regression and inheritance in the case of two parents, “Proceedings of the Royal Society of London”, vol. 58, pp. 240–242.
Google Scholar

Serrà J., Arcos J.L. (2014), An Empirical Evaluation of Similarity Measures for Time Series Classification, Knowledge‑Based Systems, vol. 67, pp. 305–314.
Google Scholar

Soper H.E., Young A.W., Cave B.M., Lee A., Pearson K. (1917), On the distribution of the correlation coefficient in small samples. Appendix II to the papers of “Student” and R.A. Fisher. A co‑operative study, “Biometrika”, vol. 11, pp. 328–413.
Google Scholar

Székely G.J., Rizzo M.L., Bakirov N.K. (2007), Measuring and testing dependence by correlation of distances, “The Annals of Statistics”, vol. 35, no. 6, pp. 2769–2794.
Google Scholar

Tjostheim D., Hufthammer K.O. (2013), Local Gaussian correlation: A new measure of dependence, “Journal of Econometrics”, vol. 172, issue 1, pp. 33–48.
Google Scholar

Viterbi A. (1967), Error Bounds for Convolutional Codes and an Asymptotically Optimum Decoding Algorithm, “IEEE Transactions on Information Theory”, vol. 13, pp. 260–269.
Google Scholar

Walesiak M. (2016), The choice of groups of variable normalization methods in multidimensional scaling, “Przegląd Statystyczny”, R. LXIII, no. 1, pp. 7–18.
Google Scholar

Wu Y., Agrawal D., Abbadi A.E. (2000), A comparison of DFT and DWT based similarity search in time‑series databases, Proceedings of the 9th International Conference on Information and Knowledge Management, McLean.
Google Scholar