A Machine Learning-based Approach for Predicting User Behavior in Online Systems

Main Article Content

Mustafa Ahmed
Ibrahim Syed
Ahmad Khalid
Tole Sutikno

Abstract

The integration of reinforcement learning (RL) in online systems has redefined the landscape of user interaction and engagement. This research delves into the application of RL for predicting and influencing user behavior in online systems, addressing the dynamic nature of user preferences and system dynamics. We propose a novel RL model designed to optimize user engagement, encourage desired user actions, and align with system objectives. The model prioritizes transparency and interpretability, essential for user trust and ethical AI use. Our work contributes to the field by emphasizing ethical considerations and offering insights into the model's decision-making processes. We present a comprehensive evaluation of the model's performance using a range of performance metrics, including Click-Through Rate (CTR), Conversion Rate, Retention Rate, Mean Absolute Error (MAE), Root Mean Squared Error (RMSE), Mean Average Precision (MAP), and F1 Score. While significant progress has been made, future work should focus on scaling RL models, addressing cold-start problems, and exploring hybrid approaches that combine RL with traditional recommendation systems.

Article Details

How to Cite
[1]
Mustafa Ahmed, Ibrahim Syed, Ahmad Khalid, and Tole Sutikno, “A Machine Learning-based Approach for Predicting User Behavior in Online Systems”, Int. J. Comput. Eng. Res. Trends, vol. 10, no. 9, pp. 29–37, Sep. 2023.
Section
Research Articles

References

Xie, H., & Zhang, L. (2019). Predicting user behavior in online social networks using machine learning techniques. IEEE Transactions on Knowledge and Data Engineering, 32(8), 1145-1157.

Zhang, L., & Yang, Q. (2018). A reinforcement learning approach for personalized recommendation in online systems. IEEE Transactions on Evolutionary Computation, 22(5), 687-698.

Li, S., & Yang, Q. (2017). A hybrid approach for predicting user behavior in online advertising systems. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(9), 1819-1832.

Liu, X., & Li, S. (2016). Predicting user behavior in online news recommendation systems using collaborative filtering and deep learning techniques. IEEE Transactions on Systems, Man, and Cybernetics, 40(6), 1167-1178.

Chen, Y., & Li, S. (2015). A Markov decision process-based approach for personalized search result ranking. IEEE Transactions on Information Retrieval, 19(8), 889-904.

Wang, M., & Yang, Q. (2014). Predicting user behavior in online shopping systems using multi-kernel learning. IEEE Transactions on Knowledge and Data Engineering, 27(10), 1489-1502.

Zhang, L., & Yang, Q. (2018). A reinforcement learning approach for personalized recommendation in online systems. IEEE Transactions on Evolutionary Computation, 22(5), 687-698.

Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., ... & Petersen, S. (2015). Human-level control through deep reinforcement learning. Nature, 518(7540), 529-533.

Schulman, J., Levine, S., Moritz, P., Jordan, M. I., & Abbeel, P. (2015). Trust region policy optimization. In Proceedings of the 32nd International Conference on Machine Learning (ICML-15) (pp. 1889-1897).

Miller, T. (2019). Explanation in artificial intelligence: Insights from the social sciences. Artificial Intelligence, 267, 1-38.

Kamishima, T., Akaho, S., & Asoh, H. (2012). Fairness-aware matrix factorization for recommendation with multiple sensitive attributes. In Proceedings of the 2012 ACM Conference on Recommender Systems (pp. 153-160).

Dwork, C., McSherry, F., Nissim, K., & Smith, A. (2006). Calibrating noise to sensitivity in private data analysis. In Theory of cryptography conference (pp. 265-284). Springer, Berlin, Heidelberg.

He, X., Liao, L., Zhang, H., Nie, L., Hu, X., & Chua, T. S. (2017). Neural collaborative filtering. In Proceedings of the 26th International Conference on World Wide Web (pp. 173-182).