Modelling Customer Relationships as Hidden Markov Chains

Edesiri Bridget Nkemnole, Ekene Nwaokoro

Abstract

Models in behavioural relationship marketing suggest that relations between the customer and the company change over time as a result of the continuous encounter. Some theoretical models have been put forward concerning relationship marketing, both from the standpoints of consumer behaviour and empirical modelling. In addition to these, this study proposes the hidden Markov model (HMM) as a potential tool for assessing customer relationships. Specifically, the HMM is submitted via the framework of a Markov chain model to classify customers relationship dynamics of a telecommunication service company by using an experimental data set. We develop and estimate an HMM to relate the unobservable relationship states to the observed buying behaviour of the customers giving an appropriate classification of the customers into the relationship states. By merely accounting for the functional and unobserved heterogeneity with a two-state hidden Markov model and taking estimation into account via an optimal estimation method, the empirical results not only demonstrate the value of the proposed model in assessing the dynamics of a customer relationship over time but also gives the optimal marketing-mixed strategies in different customer state.

10.22178/pos.64-9


Keywords


customer’s relationship management; hidden Markov model; Markov chain; transition probability; estimation

Full Text:

PDF


References


Ahani, E., & Abass, O. (2010). A Sequential Monte Carlo Approach of Online Stock Market Prediction using Hidden Markov Model. Journal of Modern Mathematics and Statistics, 4(2), 73–77.

Ahnn, Y. J., Kim, K. S., & Han, S. K. (2003). On the Design Concepts for CRM Systems. Industrial Management and Data Systems, 103(5), 32-43.

Bhar R., & Hamori S. (2004). Hidden Markov Models: Application to Financial Economics. Dordrecht: Kluwer Academic Publishers.

Bolton, R. N., & Lemon, K. (1999). A Dynamic Model of Customers’ Usage of Services: Usage as an Antecedent of Satisfaction. Journal of Marketing Research, 36(2), 171–186.

Burez, J., & Van Den Poel., D. (2007). CRM at a pay-TV company, using Analytical models to reduce customer attrition by targeted marketing for subscription services. Expert Systems with Application, 32 (2), 277-288.

Chelmeta, R. (2006). Methodology for Customer Relationship Management. The Journal of Systems and Softwares, 79, 1015–1024.

Ching, W. K., Fung, E. S., & Ng, M. K. (2003). Higher-Order Hidden Markov Models with Applications to DNA Sequences. Lecture Notes in Computer Science, 535–539.

Ching, W. K., Wong, K. (2004). Hidden Markov models and their applications to customer relationship management. IMA Journal of Management Mathematics , 15, 13–24.

Courtheaux, R. J. (1986). Database Marketing: Developing a Profitable Mailing Plan.

Elliot, R., & Hinz, J. (2002). Portfolio Optimization, Hidden Markov models and Technical Analysis of P&F charts. International Journal of Theoretical and Applied Finance, 5(4), 385-399.

Fan Wu, I-Han Chiu, & Jiunn-Rong Lin. (2005). Prediction of the intention of purchase of the user surfing on the Web using hidden Markov model. Proceedings of ICSSSM ’05. 2005 International Conference on Services Systems and Services Management, 2005.

Feinberg, F. M., Kahn, E. B., & McAlister, L. (1994). Implication and Relative Fit of Several First-Order Markov models of Customer Variety Seeking. European Journal of Operational Research, 76(2), 309-320.

Ford, D. (1980). The Development of Buyer-Seller Relationships in Industrial Markets. European Journal of Marketing, 14(5/6), 339–353.

Fournier, S. (1998). Consumers and Their Brands: Developing Relationship Theory in Consumer Research. Journal of Consumer Research, 3, 343-373.

Gupta, S., Lehmann, D. R., & Stuart, J. A. (2004). Valuing Customers. Journal of Marketing Research, 41(4), 417-418.

Hadden, J., Tiwari, A. Roy, R., & Ruta, D. (2007). Computer Assited Customer Churn Management: State-of-the-art and Future Trends. Computers and Operations Research, 34(10), 2902-2917.

Harary, F., & Lipstein, B. (1962): The dynamics of Brand Loyalty: A Markovian approach. Operation Research, 10(1), 19-40.

Hughes, A. M. (1997). Customer Retention: Integrating Lifetime Value into Marketing Strategies. Journal of Database Marketing, 5(2), 171–178.

Jackson, D. R. (1996). Achieving Strategic Competitive Advantage Through the Application of the Long-Term Customer Value Concept. Journal of Database Marketing, 4(2), 174–186.

Jenamani, M., Mohapatra, P., & Chose, S. (2003): A Stochastic Model of e-customer behavior. Electronic Commerce Research and Applications, 2(1), 82-94.

Jonker, J. J., Piersma, N., & Van den Poel, D. (2004). Joint Optimization of Customer Segmentation and Marketing policy to Maximize Long-term Profitability. Expert Systems with Applications, 27, 159-168.

Koski, T. (2001). Hidden Markov Models for Bioinformatics. Dordrecht: Kluwer.

Ling, R., & Yen, D. C. (2001). Customer Relationship Management: An Analysis Framework and Implementations Strategies. Journal of Computer Information Systems, 41, 82-97.

Liu, H. (2010). Dynamic Portfolio Choice Under Ambiguity and regime Switching mean Returns. Journal of Economic Dynamics and Control, 35(4), 623-640.

Ma, M., Li, Z., & Chen, J. (2008). Phase-type Distribution of Customer Relationship with Markovian Response and Marketing Expenditure Decision on the Customer Lifetime Value. European Journal of Operational Research, 187(1), 313-326.

MacDonald, I. L., & Zucchini, W. (1997). Hidden Markov and Other Models for Discrete-valued Time Series. London: Chapman and Hall.

Morgan, R., Hunt, S. (1994). The Commitment-trust theory of relationship marketing. Journal of Marketing, 58(3), 20–38.

Netzer, O., Lattin, J., & Sirinvasan, V. (2005). A Hidden Markov Model of Customer Relationship Dynamics. Marketing Science, 27(2), 185-204.

Nour-Mohammad, Y., Mahdi, S., & Jamshid, M. (2011). Improving Service Quality by using Organizational Citizenship Behaviour: Iranian Evidence. Iranian Journal of Management Studies, 4(2), 79–97.

Rabiner, L. R. (1989). A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition. Retrieved from https://web.ece.ucsb.edu/Faculty/Rabiner/ece259/Reprints/tutorial%20on%20hmm%20and%20applications.pdf

Reinartz, W., & Kumar, V. (2003). The Impact of Customer Relationship Characteristics on Profitable Lifetime Duration. Journal of Marketing, 67(1), 77-99.

Shen, H., & Zhao, J. (2006). Classification Customer Loyalty Based on hidden Markov model. International Journal of Internet and Enterprise Management, 4(1), 57-64.

Tanaka, T. (2017). A partially observable discrete-time Markov decision process with a fractional discounted reward. Journal of Information and Optimization Sciences, 38(1), 21-37.

Thomas, J. (2001). The Importance of Linking Customer Acquisition to Customer Retention. Journal of Marketing Research, 39, 262-268.

Viterbi, A. (1967). Error bounds for convolutional codes and an asymptotically optimum decoding algorithm. IEEE Transaction on Information Theory, 13(2), 260–269.

Wang, S., Gao, W., Huang, T., Ma, J., Li, J., & Xie, H. (2000). Adaptive Online Retail Web Site Based on Hidden Markov Model. Lecture Notes in Computer Science, 177–188.

Wu, H. H., & Shieh, J. I. (2006). Using a Markov Chain Model in Quality Function Development to Analyse Customer Requirements. International Journal of Manufacturing Technology, 30(1), 141-146.


Article Metrics

Metrics Loading ...

Metrics powered by PLOS ALM

Refbacks

  • There are currently no refbacks.


Bookmark and Share


Copyright (c) 2020 Edesiri Bridget Nkemnole, Ekene Nwaokoro

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.