Stock Price Prediction: An Incremental Learning Approach Model of Multiple Linear Regression
Main Article Content
Abstract
The endeavour of predicting stock prices using different mathematical and technological methods and tools is not new. But the recent advancements and curiosity regarding big data and machine learning have added a new dimension to it. In this research study, we investigated the feasibility and performance of the multiple linear regression method in the prediction of stock prices. Here, multiple regression was used on the basis of the incremental machine learning setting. The study conducted an experiment to predict the closing price of stocks of six different organizations enlisted in the Dhaka Stock Exchange (DSE). Three years of historical stock market data (2017-2019) of these organizations have been used. Here, the Multiple Regression, Squared Loss Function, and Stochastic Gradient Descent (SGD) algorithms are used as a predictor, loss function, and optimizer respectively. The model incrementally learned from the data of several stock-related attributes and predicted the closing price of the next day. The performance of prediction was then analysed and assessed on the basis of the rolling Mean Absolute Error (MAE) metric. The rolling MAE scores found in the experiment are quite promising.
Article Details
How to Cite
[1]
M. T. Mahtab, A. G. M. Zaman, Montasir Rahman Mahin, Mohammad Nazim Mia, and Md. Tanjirul Islam, “Stock Price Prediction: An Incremental Learning Approach Model of Multiple Linear Regression”, AJSE, vol. 21, no. 3, pp. 159 - 166, Dec. 2022.
Section
Articles
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
AJSE contents are under the terms of the Creative Commons Attribution License. This permits anyone to copy, distribute, transmit and adapt the worknon-commercially provided the original work and source is appropriately cited.
References
[1] Bruno M. Henrique, Vinicius A. Sobreiro, H. Kimura, “Stock price prediction using support vector regression on daily and up to the minute prices,” The Journal of Finance and Data Science 4(3), April 2018, DOI: 10.1016/j.jfds.2018.04.003.
[2] Z. Iqbal et al., “Efficient machine learning techniques for stock market prediction,” International Journal of Engineering Research and Applications, ISSN: 2248-9622, Vol. 3, Issue 6, Nov-Dec 2013, pp.855-867.
[3] S. Nann, J. Krauss, D. Schoder, “Predictive Analytics on Public Data – The Case of Stock Markets,” in Proceedings of the 21st European Conference on Information Systems, June 2013.
[4] H. He, S. Chen, K. Li and X. Xu, "Incremental Learning From Stream Data," in IEEE Transactions on Neural Networks, vol. 22, no. 12, pp. 1901-1914, Dec. 2011, doi: 10.1109/TNN.2011.2171713.
[5] H. Murilo Gomes et al., “Machine learning for streaming data: state of the art, challenges, and opportunities,” ACM SIGKDD Explorations Newsletter 21(2):6-22, November 2019, DOI: 10.1145/3373464.3373470.
[6] R. Seethalakshmi, “Analysis of stock market predictor variables using Linear Regression,” International Journal of Pure and Applied Mathematics, vol. 119, pp. 369-377, Jan. 2018.
[7] A. Qomaruddin Munir, R. Wardoyo, “Comparison Analysis of Time Series Data Algorithm Complexity for Forecasting of Dengue Fever Occurrences,” International Journal of Advanced Computer Research 6(7), October 2015.
[8] “Dhaka Stock Exchange Limited,” Accessed on: Feb. 17, 2021. [Online]. Available: https://www.dsebd.org/
[9] V. Murthy, K. Washer, John R Wingender, “Are Stock Prices in the US Nonstationary? Evidence from Contemporary Unit Root Tests,” Applied Financial Economics 21(22):1703-1709, November 2011, DOI: 10.1080/09603107.2011.591731.
[10] Luke K. Rose, T. Gartner, “Automated Stock Market Trading Using Machine Learning,” April 2018, DOI: 10.13140/RG.2.2.19887.59045.
[11] “How AI Trading Technology is Making Stock Market Investors Smarter,” March 16, 2019. Accessed on: April 17, 2021. [Online]. Available: https://builtin.com/artificial-intelligence/ai-trading-stock-market-tech
[12] M. Usmani, S. H. Adil, K. Raza and S. S. A. Ali, "Stock market prediction using machine learning techniques," 2016 3rd International Conference on Computer and Information Sciences (ICCOINS), 2016, pp. 322-327, doi: 10.1109/ICCOINS.2016.7783235.
[13] M. Faruquee, S. Haque, “Impact of fundamental factors on stock price: a case based approach on pharmaceutical companies listed with Dhaka stock exchange,” International Journal of Business and Management Invention, ISSN (Online): 2319 – 8028, ISSN (Print): 2319 – 801X, vol. 2, Issue 9, September 2013, PP. 34-41.
[14] B. Purcell, “The Emergence of “Big Data” Technology and Analytics,” Journal of Technology Research, vol. 4, Jan. 2012.
[15] H. Koscielniak, A. Puto, “Big Data in Decision Making Processes of Enterprises,” in Procedia Computer Science, ISSN 1877-0509, vol. 65, pp. 1052-1058, December 2015.
[16] “Incremental Learning,” Accessed on: March 21, 2021. [Online]. Available: https://en.wikipedia.org/wiki/Incremental_learning
[17] Y. Luo et al., “An appraisal of incremental learning methods,” Entropy, ISSN 1099-4300, vol. 22, number 11, article number 1190, October 2020.
[18] V. Losing, B. Hammer, H. Wersing, “Incremental On-line Learning: A Review and Comparison of State of the Art Algorithms,” Neurocomputing, ISSN 0925-2312, vol. 275, pp. 1261-1274, Sept. 2017, DOI: 10.1016/j.neucom.2017.06.084.
[19] A. Pradhan, “Support vector machine-A survey,” International Journal of Emerging Technology and Advanced Engineering, ISSN 2250-2459, Vol. 2, Issue 8, Aug. 2012.
[20] “Ensemble Learning,” Accessed on: March 21, 2021. [Online]. Available: https://en.wikipedia.org/wiki/Ensemble_learning
[21] E. Grossi, M. Buscema, “Introduction to artificial neural networks,” European Journal of Gastroenterology & Hepatology, vol. 19, Issue 12, pp. 1046-1054. Dec. 2007, DOI: 10.1097/MEG.0b013e3282f198a0.
[22] N. Malik, “Artificial Neural Networks and their Applications,” in National Conference on ‘Unearthing Technological Developments & their Transfer for Serving Masses’, GLA ITM, Mathura, India, 17-18 April 2005.
[23] Z. Zhang, “A gentle introduction to artificial neural networks,” Annals of Translational Medicine, ISSN 2305-5847, vol. 4 – No. 19, Oct. 2016, DOI: 10.21037/atm.2016.06.20.
[24] S. Banerjee, N. Dabeeru and R. Lavanya, “Stock market prediction,” International Journal of Innovative Technology and Exploring Engineering, ISSN 2278-3075, vol. 9, Issue 9, July 2020, DOI:10.35940/ijitee.I7642.079920.
[25] Md. Farhad Hossain, P. Chakraborty and S. Islam, “Predicting Daily Closing Prices of Selected Shares of Dhaka Stock Exchange (DSE) Using Support Vector Machines,” Internet of Things and Cloud Computing , vol. 8, pp. 46-51, Dec. 2020.
[26] N. Hasan and R. I. Rasel, “Artificial Neural Network Approach for Stock Price and Trend Prediction,” in International conference on advanced information & communication technology, May 2016.
[27] Mustain B. Rubel et al., “Predicting Closing Stock Price using Artificial Neural Network and Adaptive Neuro Fuzzy Inference System (ANFIS): The Case of the Dhaka Stock Exchange,” International Journal of Computer Applications, vol. 129 – No. 11, Nov. 2015, DOI: 10.5120/ijca2015906952.
[28] D. M. Q. Nelson, A. C. M. Pereira and R. A. de Oliveira, "Stock market's price movement prediction with LSTM neural networks," 2017 International Joint Conference on Neural Networks (IJCNN), 2017, pp. 1419-1426, doi: 10.1109/IJCNN.2017.7966019.
[29] G. Montana, F. Parrella, “Learning to Trade with Incremental Support Vector Regression Experts,” in Hybrid Artificial Intelligence Systems, Third International Workshop, HAIS 2008, Burgos, Spain, September 24-26, 2008, vol. 5271, pp. 591-598, DOI: 10.1007/978-3-540-87656-4_73.
[30] B. Pavlyshenko, “Machine-Learning Models for Sales Time Series Forecasting,” Data, vol. 4, no. 1, p. 15, Jan. 2019, doi: 10.3390/data4010015. [Online]. Available: http://dx.doi.org/10.3390/data4010015
[31] L. Sindayigaya, “Machine Learning Algorithms: A Review,” Information Systems Journal, vol. ISJ-RA-3392, sp. 6, Aug. 2022.
[32] M. Haque “Dhaka Stock Exchange (Historical prices of stocks),” Version 3, Updated on: Jan. 24, 2021. Accessed on: Feb. 17, 2021. [Online]. Available: https://www.kaggle.com/mahmudulhaque/dsebd
[33] Andrew Ng, “Machine Learning,” Accessed on: May 24, 2021. [Online]. Available: https://www.coursera.org/lecture/machine-learning/multiple-features-6Nj1q
[34] “Data Science 101: Introduction to Cost Function,” Mar. 4, 2021. Accessed on: Apr. 17, 2021. [Online]. Available: https://www.analyticsvidhya.com/blog/2021/03/data-science-101-introduction-to-cost-function/
[35] “Introduction to optimizers,” May 7, 2018. Accessed on: Apr. 24, 2021. [Online]. Available: https://algorithmia.com/blog/introduction-to-optimizers
[36] “CS 2750 Machine Learning Lecture 8-9,” Accessed on: May 19, 2021. [Online]. Available: https://people.cs.pitt.edu/~milos/courses/cs2750-Spring2020/Lectures/Class8.pdf
[37] “A Gentle Introduction to Concept Drift in Machine Learning,” Dec. 10, 2020. Accessed on: Apr. 13, 2021. [Online]. Available: https://machinelearningmastery.com/gentle-introduction-concept-drift-machine-learning/
[38] “Pandas Documentation,” Accessed on: Mar. 11, 2021. [Online]. Available: https://pandas.pydata.org/docs/
[39] “NumPy v1.20.0,” Accessed on: Mar. 11, 2021. [Online]. Available: https://numpy.org/
[40] “Matplotlib v3.4.2,” Accessed on: Mar. 13, 2021. [Online]. Available: https://matplotlib.org/
[41] J. Montiel et al.,“River: machine learning for streaming data in Python,” year- 2020, eprint- 2012.04740, archivePrefix- arXiv, primaryClass- cs.LG
[2] Z. Iqbal et al., “Efficient machine learning techniques for stock market prediction,” International Journal of Engineering Research and Applications, ISSN: 2248-9622, Vol. 3, Issue 6, Nov-Dec 2013, pp.855-867.
[3] S. Nann, J. Krauss, D. Schoder, “Predictive Analytics on Public Data – The Case of Stock Markets,” in Proceedings of the 21st European Conference on Information Systems, June 2013.
[4] H. He, S. Chen, K. Li and X. Xu, "Incremental Learning From Stream Data," in IEEE Transactions on Neural Networks, vol. 22, no. 12, pp. 1901-1914, Dec. 2011, doi: 10.1109/TNN.2011.2171713.
[5] H. Murilo Gomes et al., “Machine learning for streaming data: state of the art, challenges, and opportunities,” ACM SIGKDD Explorations Newsletter 21(2):6-22, November 2019, DOI: 10.1145/3373464.3373470.
[6] R. Seethalakshmi, “Analysis of stock market predictor variables using Linear Regression,” International Journal of Pure and Applied Mathematics, vol. 119, pp. 369-377, Jan. 2018.
[7] A. Qomaruddin Munir, R. Wardoyo, “Comparison Analysis of Time Series Data Algorithm Complexity for Forecasting of Dengue Fever Occurrences,” International Journal of Advanced Computer Research 6(7), October 2015.
[8] “Dhaka Stock Exchange Limited,” Accessed on: Feb. 17, 2021. [Online]. Available: https://www.dsebd.org/
[9] V. Murthy, K. Washer, John R Wingender, “Are Stock Prices in the US Nonstationary? Evidence from Contemporary Unit Root Tests,” Applied Financial Economics 21(22):1703-1709, November 2011, DOI: 10.1080/09603107.2011.591731.
[10] Luke K. Rose, T. Gartner, “Automated Stock Market Trading Using Machine Learning,” April 2018, DOI: 10.13140/RG.2.2.19887.59045.
[11] “How AI Trading Technology is Making Stock Market Investors Smarter,” March 16, 2019. Accessed on: April 17, 2021. [Online]. Available: https://builtin.com/artificial-intelligence/ai-trading-stock-market-tech
[12] M. Usmani, S. H. Adil, K. Raza and S. S. A. Ali, "Stock market prediction using machine learning techniques," 2016 3rd International Conference on Computer and Information Sciences (ICCOINS), 2016, pp. 322-327, doi: 10.1109/ICCOINS.2016.7783235.
[13] M. Faruquee, S. Haque, “Impact of fundamental factors on stock price: a case based approach on pharmaceutical companies listed with Dhaka stock exchange,” International Journal of Business and Management Invention, ISSN (Online): 2319 – 8028, ISSN (Print): 2319 – 801X, vol. 2, Issue 9, September 2013, PP. 34-41.
[14] B. Purcell, “The Emergence of “Big Data” Technology and Analytics,” Journal of Technology Research, vol. 4, Jan. 2012.
[15] H. Koscielniak, A. Puto, “Big Data in Decision Making Processes of Enterprises,” in Procedia Computer Science, ISSN 1877-0509, vol. 65, pp. 1052-1058, December 2015.
[16] “Incremental Learning,” Accessed on: March 21, 2021. [Online]. Available: https://en.wikipedia.org/wiki/Incremental_learning
[17] Y. Luo et al., “An appraisal of incremental learning methods,” Entropy, ISSN 1099-4300, vol. 22, number 11, article number 1190, October 2020.
[18] V. Losing, B. Hammer, H. Wersing, “Incremental On-line Learning: A Review and Comparison of State of the Art Algorithms,” Neurocomputing, ISSN 0925-2312, vol. 275, pp. 1261-1274, Sept. 2017, DOI: 10.1016/j.neucom.2017.06.084.
[19] A. Pradhan, “Support vector machine-A survey,” International Journal of Emerging Technology and Advanced Engineering, ISSN 2250-2459, Vol. 2, Issue 8, Aug. 2012.
[20] “Ensemble Learning,” Accessed on: March 21, 2021. [Online]. Available: https://en.wikipedia.org/wiki/Ensemble_learning
[21] E. Grossi, M. Buscema, “Introduction to artificial neural networks,” European Journal of Gastroenterology & Hepatology, vol. 19, Issue 12, pp. 1046-1054. Dec. 2007, DOI: 10.1097/MEG.0b013e3282f198a0.
[22] N. Malik, “Artificial Neural Networks and their Applications,” in National Conference on ‘Unearthing Technological Developments & their Transfer for Serving Masses’, GLA ITM, Mathura, India, 17-18 April 2005.
[23] Z. Zhang, “A gentle introduction to artificial neural networks,” Annals of Translational Medicine, ISSN 2305-5847, vol. 4 – No. 19, Oct. 2016, DOI: 10.21037/atm.2016.06.20.
[24] S. Banerjee, N. Dabeeru and R. Lavanya, “Stock market prediction,” International Journal of Innovative Technology and Exploring Engineering, ISSN 2278-3075, vol. 9, Issue 9, July 2020, DOI:10.35940/ijitee.I7642.079920.
[25] Md. Farhad Hossain, P. Chakraborty and S. Islam, “Predicting Daily Closing Prices of Selected Shares of Dhaka Stock Exchange (DSE) Using Support Vector Machines,” Internet of Things and Cloud Computing , vol. 8, pp. 46-51, Dec. 2020.
[26] N. Hasan and R. I. Rasel, “Artificial Neural Network Approach for Stock Price and Trend Prediction,” in International conference on advanced information & communication technology, May 2016.
[27] Mustain B. Rubel et al., “Predicting Closing Stock Price using Artificial Neural Network and Adaptive Neuro Fuzzy Inference System (ANFIS): The Case of the Dhaka Stock Exchange,” International Journal of Computer Applications, vol. 129 – No. 11, Nov. 2015, DOI: 10.5120/ijca2015906952.
[28] D. M. Q. Nelson, A. C. M. Pereira and R. A. de Oliveira, "Stock market's price movement prediction with LSTM neural networks," 2017 International Joint Conference on Neural Networks (IJCNN), 2017, pp. 1419-1426, doi: 10.1109/IJCNN.2017.7966019.
[29] G. Montana, F. Parrella, “Learning to Trade with Incremental Support Vector Regression Experts,” in Hybrid Artificial Intelligence Systems, Third International Workshop, HAIS 2008, Burgos, Spain, September 24-26, 2008, vol. 5271, pp. 591-598, DOI: 10.1007/978-3-540-87656-4_73.
[30] B. Pavlyshenko, “Machine-Learning Models for Sales Time Series Forecasting,” Data, vol. 4, no. 1, p. 15, Jan. 2019, doi: 10.3390/data4010015. [Online]. Available: http://dx.doi.org/10.3390/data4010015
[31] L. Sindayigaya, “Machine Learning Algorithms: A Review,” Information Systems Journal, vol. ISJ-RA-3392, sp. 6, Aug. 2022.
[32] M. Haque “Dhaka Stock Exchange (Historical prices of stocks),” Version 3, Updated on: Jan. 24, 2021. Accessed on: Feb. 17, 2021. [Online]. Available: https://www.kaggle.com/mahmudulhaque/dsebd
[33] Andrew Ng, “Machine Learning,” Accessed on: May 24, 2021. [Online]. Available: https://www.coursera.org/lecture/machine-learning/multiple-features-6Nj1q
[34] “Data Science 101: Introduction to Cost Function,” Mar. 4, 2021. Accessed on: Apr. 17, 2021. [Online]. Available: https://www.analyticsvidhya.com/blog/2021/03/data-science-101-introduction-to-cost-function/
[35] “Introduction to optimizers,” May 7, 2018. Accessed on: Apr. 24, 2021. [Online]. Available: https://algorithmia.com/blog/introduction-to-optimizers
[36] “CS 2750 Machine Learning Lecture 8-9,” Accessed on: May 19, 2021. [Online]. Available: https://people.cs.pitt.edu/~milos/courses/cs2750-Spring2020/Lectures/Class8.pdf
[37] “A Gentle Introduction to Concept Drift in Machine Learning,” Dec. 10, 2020. Accessed on: Apr. 13, 2021. [Online]. Available: https://machinelearningmastery.com/gentle-introduction-concept-drift-machine-learning/
[38] “Pandas Documentation,” Accessed on: Mar. 11, 2021. [Online]. Available: https://pandas.pydata.org/docs/
[39] “NumPy v1.20.0,” Accessed on: Mar. 11, 2021. [Online]. Available: https://numpy.org/
[40] “Matplotlib v3.4.2,” Accessed on: Mar. 13, 2021. [Online]. Available: https://matplotlib.org/
[41] J. Montiel et al.,“River: machine learning for streaming data in Python,” year- 2020, eprint- 2012.04740, archivePrefix- arXiv, primaryClass- cs.LG