Hybrid Modeling of Arima, ANN and SVM for Macro Variables Forecasting in Pakistan
Abstract
Time series forecasting remains a challenging task owing to its nonlinear, complex and chaotic behavior. The purpose of this paper is to analyze the forecast performance of different models for Pakistan’s macroeconomic variables such as inflation, exchange rate and stock return. In which linear Autoregressive integrated moving average (ARIMA) model and nonlinear models like artificial neural networks (ANN) and Support vector machines (SVM) are employed. Then a hybrid methodology is used which combines the linear ARIMA with nonlinear models of ANN and SVM. The forecasting performance of all models i.e., ARIMA, ANN, SVM, ARIMA-ANN and ARIMA-SVM are compared on the basis of RMSE and MAE. The results indicate that the best forecasting model to achieve high forecast accuracy is the hybrid ARIMA-SVM.
Downloads
References
Al-hnaity, B., & Abbod, M. (2016). Predicting financial time series data using hybrid model. In Intelligent Systems and Applications (pp. 19-41). Springer, Cham.
Awan, S. M., Khan, Z. A., Aslam, M., Mahmood, W., & Ahsan, A. (2012). Application of NARX based FFNN, SVR and ANN Fitting models for long term industrial load forecasting and their comparison. In Industrial Electronics (ISIE), IEEE International Symposium on (pp. 803-807).
Babu, C. N., & Reddy, B. E. (2014). A moving-average filter based hybrid ARIMA–ANN model for forecasting time series data. Applied Soft Computing, 23, 27-38.
Barrow, D., & Kourentzes, N. (2018). The impact of special days in call arrivals forecasting: A neural network approach to modelling special days. European Journal of Operational Research, 264(3), 967-977.
Breiman, L. (1996). Stacked regressions. Machine learning, 24(1), 49-64.
Burney, S. M. A., Jilani, T. A., & Ardil, C. (2005). Levenberg-Marquardt algorithm for Karachi Stock Exchange share rates forecasting. International Journal of Computational Intelligence, 1(3), 144-149.
Cao, L. J., & Tay, F. E. H. (2003). Support vector machine with adaptive parameters in financial time series forecasting. IEEE Transactions on neural networks, 14(6), 1506-1518.
Cao, L., & Tay, F. E. (2001). Financial forecasting using support vector machines. Neural Computing & Applications, 10(2), 184-192.
Chen, K. Y., & Wang, C. H. (2007). A hybrid SARIMA and support vector machines in forecasting the production values of the machinery industry in Taiwan. Expert Systems with Applications, 32(1), 254-264.
Claveria, O., Monte, E., & Torra, S. (2015). Regional Forecasting with Support Vector Regressions: The Case of Spain.
Cocianu, C. L., & Grigoryan, H. (2015). An artificial neural network for data forecasting purposes. Informatica Economica, 19(2), 34.
Cortes, C., & Vapnik, V. (1995). Support-vector networks. Machine learning, 20(3), 273-297.
Farooqi, A. (2014). ARIMA model building and forecasting on Imports and Exports of Pakistan. Pakistan Journal of Statistics and Operation Research, 10(2), 157-168.
Fletcher, R. (1989). Practical Methods of Optimization.
Frain, J. (1992). Lecture Notes on Univariate Time Series Analysis and Box Jenkins Forecasting. Economic Analysis, Research and Publications.
Guajardo, J., Weber, R., & Miranda, J. (2006). A forecasting methodology using support vector regression and dynamic feature selection. Journal of Information & Knowledge Management, 5(04), 329-335.
Haider, A., & Hanif, M. N. (2009). Inflation forecasting in Pakistan using artificial neural networks. Pakistan economic and social review, 123-138.
Jafri, Y. Z., Sami, M., Waseem, A., Murtaza, G., & Akbar, S. (2012). Stochastic approaches for time series forecasting of rate of dust fall: A case study of northwest of Balochistan, Pakistan. International Journal of Physical Sciences, 7(4), 676-686.
Karathanasopoulos, A., & Osman, M. (2019). Forecasting the Dubai financial market with a combination of momentum effect with a deep belief network. Journal of Forecasting.
Khashei, M., & Bijari, M. (2010). An artificial neural network (p, d, q) model for timeseries forecasting. Expert Systems with applications, 37(1), 479-489.
Khashei, M., & Bijari, M. (2011). Which methodology is better for combining linear and nonlinear models for time series forecasting?. Journal of Industrial and Systems Engineering, 4(4), 265-285.
Kim, K. J. (2003). Financial time series forecasting using support vector machines. Neurocomputing, 55(1-2), 307-319.
Kumar, M., & Thenmozhi, M. (2014). Forecasting stock index returns using ARIMA-SVM, ARIMA-ANN, and ARIMA-random forest hybrid models. International Journal of Banking, Accounting and Finance, 5(3), 284-308.
Kuntoji, Geetha & Rao, Subba & Mandal, Sukomal. (2017). Application of Support Vector Machine Technique for Damage Level Prediction of Tandem Breakwater. International Journal of Earth Sciences and Engineering.
LeBlanc, M., & Tibshirani, R. (1996). Combining estimates in regression and classification. Journal of the American Statistical Association, 91(436), 1641-1650.
McCulloch, W. S., & Pitts, W. (1943). A logical calculus of the ideas immanent in nervous activity. The bulletin of mathematical biophysics, 5(4), 115-133.
Meyer, D., & Wien, F. T. (2001). Support vector machines. R News, 1(3), 23-26.
Meyer, D., & Wien, F. T. (2015). Support vector machines. The Interface to libsvm in package e1071, 28.
Meyler, A., Kenny, G., & Quinn, T. (1998). Forecasting Irish inflation using ARIMA models.
Mojirsheibani, M. (1999). Combining classifiers via discretization. Journal of the American Statistical Association, 94(446), 600-609.
Moshiri, S., & Cameron, N. (2000). Neural network versus econometric models in forecasting inflation. Journal of forecasting, 19(3), 201-217.
Mukherjee, S., Osuna, E., & Girosi, F. (1997). Nonlinear prediction of chaotic time series using support vector machines. In Neural Networks for Signal Processing. Proceedings of the IEEE Workshop (pp. 511-520).
Pai, P. F., & Lin, C. S. (2005). A hybrid ARIMA and support vector machines model in stock price forecasting. Omega, 33(6), 497-505.
Papatla, P., Zahedi, M., & Zekic‐Susac, M. (2002). Leveraging the strengths of choice models and neural networks: A multiproduct comparative analysis. Decision Sciences, 33(3), 433-461.
Patterson, J. C. (2012). Managing a real-time massively-parallel neural architecture (Doctoral dissertation, The University of Manchester (United Kingdom)).
Petruseva, S., Zileska-Pancovska, V., Žujo, V., & Brkan-Vejzović, A. (2017). Construction costs forecasting: comparison of the accuracy of linear regression and support vector machine models. Tehnicki Vjesnik-Technical Gazette, 24(5), 1431-1438.
Saeed, N., Saeed, A., Zakria, M., & Bajwa, T. M. (2000). Forecasting of wheat production in Pakistan using ARIMA models. International Journal of Agricultural Biology, 2(4), 352-353.
Shamim, M. A., Ghumman, A. R., & Ghani, U. (2004, December). Forecasting groundwater contamination using artificial neural networks. In 1st International Conference on Water Resources and Arid Environments (pp. 5-8).
Sharma, A., & Bhardwaj, K. (2015). Identification of normal and abnormal ECG using neural network. Int. J. Inf. Res. Rev, 2, 695-700.
Smola, A. J., & Schölkopf, B. (2004). A tutorial on support vector regression. Statistics and computing, 14(3), 199-222.
Stone, M. (1974). Cross-validatory choice and assessment of statistical predictions. Journal of the royal statistical society. Series B (Methodological), 111-147.
Sultana, K., Rahim, A., Moin, N., Aman, S., & Ghauri, S. P. (2013). Forecasting inflation and economic growth of pakistan by using two time series metho ds. International Journal of Business and Economics Research, 2(6), 174-178.
Tkacz, G., & Hu, S. (1999). Forecasting GDP growth using artificial neural networks (pp. 99-3). Ottawa: Bank of Canada.
Trafalis, T. B., & Ince, H. (2000). Support vector machine for regression and applications to financial forecasting. In Neural Networks, 2000. IJCNN 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on (Vol. 6, pp. 348-353).
Zhang, G. P. (2003). Time series forecasting using a hybrid ARIMA and neural network model. Neurocomputing, 50, 159-175.
Zhang, G., Hu, M. Y., Patuwo, B. E., & Indro, D. C. (1999). Artificial neural networks in bankruptcy prediction: General framework and cross-validation analysis. European journal of operational research, 116(1), 16-32.
Zhu, B., & Wei, Y. (2013). Carbon price forecasting with a novel hybrid ARIMA and least squares support vector machines methodology. Omega, 41(3), 517-524.
Copyright (c) 2022 Hafsa Hina, Rizwan Ali, Amena Urooj
This work is licensed under a Creative Commons Attribution 4.0 International License.
JQM follows an open-access publishing policy and full text of all published articles is available free, immediately upon publication of an issue. The journal’s contents are published and distributed under the terms of the Creative Commons Attribution 4.0 International (CC-BY 4.0) license. Thus, the work submitted to the journal implies that it is original, unpublished work of the authors (neither published previously nor accepted/under consideration for publication elsewhere). On acceptance of a manuscript for publication, a corresponding author on the behalf of all co-authors of the manuscript will sign and submit a completed Copyright and Author Consent Form.
