Navigating Customer Satisfaction: Unravelling The Dynamics Of Chatbot Performance, Trust in Technology
Authors/Creators
- 1. Dr. Nagashree, Associate Professor and IQAC Coordinator, Department of Commerce Soundarya Institute of Management and Science, Affiliated to Bangalore University
Description
Abstract
This study explores the dynamics of customer satisfaction in chatbot interactions, with a focus on how chatbot performance influences users’ trust in technology. Conducted in Bangalore City, Karnataka, the research targets customers of both private and public sector banks. A multi-stage random sampling method was used, beginning with all banks in the city and narrowing to four major institutions: HDFC Bank, ICICI Bank, State Bank of India, and Bank of Baroda. Data were collected from 350 customers across selected branches of these banks. The study applies advanced statistical techniques, including Structural Equation Modelling (SEM) and moderation analysis, to examine the relationships among key variables. The findings highlight the critical role of chatbot performance in shaping customer satisfaction, with technological trust acting as a mediator and technical literacy serving as a moderator in influencing overall customer experience in digital banking.
Keywords: Customer satisfaction, Chatbot interactions, Trust in technology, Chatbot performance
1.Introduction
Since the "customer service revolution" about 20 years ago, business research has prioritised customer happiness and customer-focused organisations. Business consultants and enterprises have developed techniques to identify customer-pleasing organisations, assess happiness, and construct quality improvement processes based on feedback. While corporate research has focused on customer service and happiness, it is not exclusive to the private sector. Publicly sponsored organisations embracing commercial techniques provide valuable insights and research. Federal, state, and municipal governments are increasingly measuring their performance and impact on individuals they serve. Initiatives to "reinvent" government, such as school reform, privatisation, and managed care, prioritise customer service and satisfaction. The European Union is reforming social services with a focus on social inclusion and "user involvement" to enhance quality[1].
Artificial intelligence is not a new notion in India. For decades, research groups and institutions have been experimenting with various AI technologies, notably in the subject of social change. AI is becoming more mainstream, with large corporations and start-ups investigating numerous opportunities as supporting technology becomes more available and inexpensive.technology significantly impacts industries and everyday tasks. It has several applications and is used differently across the globe. Artificial intelligence has recently gained popularity among the public. Artificial intelligence mimics the cognitive abilities of humans. To grow more accurate and human-like, AI chatbots are taking the place of human responders. The use of chatbots, sometimes known as virtual assistants, is growing in popularity as a result of developments in natural language processing, artificial intelligence, machine learning, and neural networks. Interactive questions let chatbots communicate with people more effectively. To expand the chatbot industry, several cloud-based chatbot services have surfaced, such as Watson from IBM, Cleverbot, and ELIZA chatbot. Conversation between people and robots has greatly improved in recent years, with more responsive conversational agents. This article discusses the generalisation and description of AI chatbots[2].
Chatbots are adaptable and show a lot of potential. Human care providers often struggle to manage resources and get exhausted. Chatbots are available 24/7 due to scalable technology, ensuring quick access for consumers. Chatbots may dramatically decrease expenses and automate corporate procedures. Chatbots, such as Amazon Alexa and Apple Siri, are becoming more popular for their practical applications. Watson, IBM's question-and-answer programme, is a great example. Chatbots have a wide range of applications outside information technology. In 2020, chatbots accounted for over 85% of consumer interactions. Here's an example: "Businesses can use chatbots for internal communication in addition to using them for external communication (with customers)" . Large organisations often utilise chatbots for staff assistance, recruitment as well as training. Meet Franks is a digital assistant that links talent and corporations discreetly. Live chat interfaces are becoming more popular for providing real time customer care, particularly in e-commerce. Chatbots are often used to replace human chat service representatives. Although AI-based chatbots have been extensively adopted for cost and time savings, they often fail to meet consumer expectations, potentially leading to decreased user engagement[3].
Chatbots are thought to provide round-the-clock assistance, seven days a week, which improves customer interactions by cutting down on bank customer wait times. Because they make common banking tasks simpler for consumers to do, chatbots are seen as beneficial.
Additionally, using chatbots for various financial procedures is easier and costs nothing. It's argued that chatbots pose less of a risk to privacy and data security. The chatbots are a trustworthy source since their responses are up to date and precise[4].
Chatbot apps may serve as a useful tool for personal consultation and learning via interactive tactics and user-friendly interfaces, apart from providing a range of successful interpersonal interactions. A chat bot's ability to reach a large audience via automated, personalised messages and a messaging system is its main benefit. Furthermore, chatbots may be used in the workplace due to the growing use of mobile technology, the lack of time and location constraints, and the development of interactive education techniques[5].
This paper is organised as follows: the third portion presents our analysis's methodologies and data collecting, while the second section evaluates pertinent literature. The findings are explained and our results are described in the fourth part. The article is concluded in the last part.
2.Literature Review
[6] This study investigates how cognitive and peripheral inputs affect experience characteristics, resulting in chatbots, building on the principles of the Model of Elaboration Likelihood (ELM). The user wants to suggest. In the buy and post-purchase phases, the study used a strong interpretive sequencing mixed-method research design and incorporated competence as well as warmth as mediating variables.[7] This paper provides an in-depth analysis of the manner how artificially intelligent (AI) and NLP, or natural language processing, are pushing the boundaries of convention, revolutionising modern marketing strategies, and providing insightful knowledge about consumer behaviour and tactical decision-making.
[8] This study aims to provide a novel contribution by offering a thorough, well-organized roadmap that describes the fundamental ideas required for successful combining automation and process optimisation within the framework of state-of-the-art artificial intelligence[9] This study explores the intricate interplay between social media and marketing tactics in influencing the global economic landscape. Understanding the critical roles that social media and marketing play becomes imperative for companies, governments, and other stakeholders in an age when globalisation & digitalization are driving revolutionary changes. scholars as well.
[10] A new age of improved digital offering dependability, optimized supply chain operations, and instantaneous access to priceless data and analytics has been brought about by the
incorporation of AI. In its endeavour to close the knowledge gap and enable the effective integration of AI into business planning, this article aspires to perfection.[11] The report ends with recommendations for further research on personalised marketing, with an emphasis on cutting-edge technologies including wearables, big data, blockchain, artificial intelligence, and the internet of things. investigate new approaches to creating individualised experiences for both online and offline platforms.
[12] The study puts the rise of smart tourism in perspective and explains how technology and data are changing the dynamics of the sector. In summary, it considers potential uses while highlighting the need of a well-balanced combination of data and technology to fulfil the potential of smart tourism.[13] This article offers a thorough analysis of scientific research on AI's effects on digital marketing initiatives. By looking at several scholarly articles, this study aims to provide light on how artificial intelligence (AI) tools are affecting strategies, processes, and outcomes in the area of digital marketing.
[14] This study used a serial mediation mechanism to examine the effect of human portrayal in chatbot on the intention to follow health advice, using psychological separation and trust towards the chatbot counsellor. The results showed that participants in the simulated human condition expressed a stronger willingness to heed chatbot-generated emotional wellness advice than did those in the mechanical representation condition. [15] Because of digital technology and media, the situations in which companies interact with their customers are changing. The authors provide a number of plausible extensions of the present study's findings as ideas for future academic research.
3.Research Gap
The study gap stems from a lack of investigation into how confidence in technology mediates the link between chatbot performance and customer pleasure, as well as a limited grasp of how technical literacy moderates this relationship. Current research focuses mostly on direct impacts, ignoring these critical mediating and moderating variables. Addressing these gaps is critical for gaining a more complete knowledge of customer-bot interactions and may give significant insights into the design and deployment of successful chatbot systems.
4.Aim of the Study
This study's goal is to look into and comprehend the elements that influence customer satisfaction in chatbot encounters, with a particular emphasis on chatbot performance and its
effect on users' faith in technology. The study aims to give insights that may help increase chatbot performance, overall customer happiness, and a better understanding of technology's developing role in moulding user trust.
5.Objective
OB1: To evaluate and quantify the direct influence of chatbot performance on customer satisfaction.
OB2: To examine the mediating effect of trust in technology in the relationship between chatbot performance and customer satisfaction.
OB3: To explore the moderating role of technical literacy in shaping the relationship between chatbot performance and customer satisfaction.
6.Hypothesis
H1: Chatbot performance has a significant direct positive effect on customer satisfaction.
H2: Trust in technology significantly mediates the relationship between chatbot performance and customer satisfaction.
H3: Technical literacy significantly moderates the relationship between chatbot performance and customer satisfaction.
7.Research Methodology
Fig.1 conceptual frame work
8.Research Design
This study explores Navigating Customer Satisfaction: Unravelling The Dynamics Of Chatbot Performance, Trust In Technology, using both surveys and qualitative methods. Surveys gather numerical data on satisfaction and preferences, while interviews and focus groups delve into reasons behind perceptions, addressing aspects like trust in AI. This mixed-method design aims
to offer a comprehensive understanding of factors influencing Navigating Customer Satisfaction - Unravelling The Dynamics Of Chatbot Performance, Trust In Technology.
9.Data Collection Methods
A structured survey will collect quantitative data on Navigating Customer Satisfaction: Unravelling The Dynamics Of Chatbot Performance, Trust In Technology. Stratified sampling ensures a diverse sample, using electronic and in-person distribution. Data analysis includes descriptive and inferential statistics. Validity and reliability are ensured through pre-testing, Cronbach's alpha, and ethical considerations. This approach aims to yield reliable insights into Dynamics Of Chatbot Performance, Trust In Technology customer views on Chatbot Performance.
-
Sampling
The quantitative study on " Navigating Customer Satisfaction: Unravelling The Dynamics Of Chatbot Performance, Trust In Technology" will employ a meticulous sampling strategy. The target population, bank customers Satisfaction Chatbot Performance, Trust In Technology, will be stratified based on characteristics such as age, income, and banking frequency. Random sampling within each stratum will ensure diverse perspectives are represented. The sample size will be determined through statistical calculations balancing reliability and feasibility. The goal is to generalize findings to the broader population while maintaining efficiency. Efforts to minimize selection bias and enhance external validity will be ongoing, providing a comprehensive snapshot of Navigating Customer Satisfaction: Unravelling The Dynamics Of Chatbot Performance, Trust In Technology.
-
Sample Size
The research "Navigating Customer Satisfaction: Unravelling the Dynamics of Chatbot Performance and Trust in Technology" carefully created a sample of 350 participants, expertly balancing dependability and manageability. This enlarged sample size boosts statistical power, allowing a complete examination of varied consumer sentiments. This purposeful decision, which is consistent with structural equation modelling (SEM) principles, emphasises the research's dedication to producing reliable and relevant outcomes.
-
Sampling Technique
Our research on "Navigating Customer Satisfaction: Unravelling the Dynamics of Chatbot Performance and Trust in Technology" used a rigorous sampling approach, including stratified random sampling, random sampling with many stages, and random sampling, to ensure a comprehensive and representative sample of participants. The population was divided into groups based on essential factors such as gender, age, income, region, and education, and people were selected at random. This systematic technique sought to capture variety, improving the quality and reliability of our data, by investigating possible differences in results across various demographic groups in the areas of Chatbot Performance and Trust in Technology.
-
Sample Design
This research includes Bangalore City, the biggest in Karnataka, and aims to analyse consumer preferences and behaviours in both private and public sector banks. Using a multi-stage random selection technique, the study first covers all banks in Bangalore. In the next phase, four banks with large market capitalization are explicitly chosen: HDFC, ICICI, State Bank of India, and Bank of Baroda. The systematic selection of branches for data collection yielded a total sample size of 350 clients from 28 State Bank of India branches, 9 Bank of Baroda branches, 11 HDFC Bank branches, and 5 ICICI Bank branches. This comprehensive method attempts to give important insights on clients' banking experiences in Bangalore City.
Table 1:Total Number Of Bank Branches In Bangalore city
|
BANK |
NUMBER OF BRANCHES |
|
PRIVATE BANK |
|
|
HDFC BANK |
217 |
|
ICICI BANK |
103 |
|
PUBLIC BANK |
|
|
STATE BANK OF INDIA |
577 |
|
BANK OF BOARADA |
175 |
Table 2: List Of Selected Private And Public Sector banks In Bangalore City
|
Bank Name |
No.of Branches |
Percentage |
No. of Banks |
Sample Size |
|
HDFC |
217 |
20.22 |
11 |
120 |
|
ICICI |
103 |
9.62 |
5 |
47 |
|
SBI |
577 |
53.84 |
28 |
128 |
|
BOB |
175 |
16.32 |
9 |
55 |
|
TOTAL |
1072 |
100 |
53 |
350 |
10.Data Collection
Our study on " Navigating Customer Satisfaction: Unravelling The Dynamics Of Chatbot Performance, Trust In Technology " involved 350 participants surveyed through structured questionnaires. Ethical considerations were prioritized, ensuring informed consent and data security. A stratified random sampling method, considering demographics, was used for inclusivity. Participants chose between in-person interviews or online surveys for flexibility. This approach aimed to gain reliable insights into diverse Navigating Customer Satisfaction: Unravelling The Dynamics Of Chatbot Performance, Trust In Technology.
10.1.Data Analysis
In our work "Navigating Customer Satisfaction: Unravelling Chatbot Performance Dynamics," we used Structural Equation Modelling and Moderation analysis. Our extensive data analysis, which included descriptive and inferential statistics, revealed important insights into the interaction of key elements driving customer satisfaction. These results inform banks' strategic choices, upgrading Chatbot services to improve client happiness and loyalty in the ever
changing the AI environment of the banking business and beyond.
-
Analysis of Structural Equation Modelling (SEM)
In this study, we use structural equation modelling, or SEM, to analyse complicated interactions between many variables concurrently. SEM integrates regression and factor analysis, providing a comprehensive understanding of relationships within a theoretical framework. It helps verify and adjust research hypotheses, revealing detailed patterns and insights into the dynamics between MSME performance management, modern marketing strategies, and digital marketing capabilities.
-
Chatbot Performance: Satisfaction levels result from setting and attaining consumer goals. This entails understanding consumer perceptions, strengths, weaknesses, opportunities, and threats. Strategies are then developed and implemented to achieve these goals.
-
Customer Satisfaction: Consumer perception drives an entity's growth and success, requiring effective management and a balance between expansion and core values for long-term sustainability.
-
Trust in Technology: Consumer trust in technology grows as banks leverage Artificial Intelligence (AI) to enhance data analysis, develop strategies, and improve communication with stakeholders.
11.Results
Table 3 Demographic variables
|
Frequency |
Percent |
||
|
Gender |
Male |
175 |
50.0 |
|
Female |
133 |
38.0 |
|
|
Transgender |
42 |
12.0 |
|
|
Total |
350 |
100.0 |
|
|
Marital Status |
Married |
210 |
60.0 |
|
Single |
140 |
40.0 |
|
|
Total |
350 |
100.0 |
|
|
Age Group |
18- 25 years |
77 |
22.0 |
|
26-35 years |
70 |
20.0 |
|
|
36-45years |
63 |
18.0 |
|
|
46-60years |
70 |
20.0 |
|
Above 60+years |
70 |
20.0 |
|
|
Total |
350 |
100.0 |
|
|
Education Qualification |
Primary school level |
84 |
24.0 |
|
Higher secondary level |
63 |
18.0 |
|
|
Under Graduate level |
70 |
20.0 |
|
|
Post Graduate level |
70 |
20.0 |
|
|
University /Ph.D./ Tertiary |
63 |
18.0 |
|
|
Total |
350 |
100.0 |
|
|
Occupation |
Students |
63 |
18.0 |
|
Govt. employee |
49 |
14.0 |
|
|
Private employee |
49 |
14.0 |
|
|
Professional |
56 |
15.0 |
|
|
House Maker |
42 |
12.0 |
|
|
Business/Employer |
42 |
12.0 |
|
|
Retied |
49 |
14.0 |
|
|
Total |
350 |
100.0 |
|
|
Monthly Income |
Below 20000 |
84 |
24.0 |
|
20000-50000 |
84 |
24.0 |
|
|
50000-100000 |
91 |
26.0 |
|
|
Above –100000. |
91 |
26.0 |
|
|
Total |
350 |
100.0 |
-
Gender: The variable "Gender" has three categories – Male, Female, and Transgender. Among the 350 respondents, 175 (50.0%) identified as Male, 133 (38.0%) as Female, and 42 (12.0%) as Transgender.
-
Marital Status: The "Marital Status" variable consists of two categories – Married and Single. Out of the total respondents, 210 (60.0%) reported being married, while 140 (40.0%) identified as single.
-
Age Group: Five groups are identified by the "Age Group" variable: 18–25 years, 26–35 years, 36–45 years, 46–60 years, and Above 60+ years. Each category shows the respondents' percentage overall; the highest number is 22.0% for the 18–25 age range.
-
Education Qualification: For the "Education Qualification" variable, respondents are categorized based on their educational levels – Primary school level, Higher secondary level, Under Graduate level, Post Graduate level, and University/Ph.D./Tertiary. The highest percentage (24.0%) falls under the Primary school level.
-
Occupation: The "Occupation" variable includes categories such as Students, Govt. employee, Private employee, Professional, House Maker, Business/Employer, and Retired. Among the respondents, the highest percentage (18.0%) identified as Students.
-
Monthly Income: The "Monthly Income" variable is divided into four categories – Below 20000, 20000-50000, 50000-100000, and Above 100000. Each category represents a percentage of the total respondents, with 26.0% reporting a monthly income in the range of 50000-100000 and Above 100000.
-
SEM (structural equational modelling) Structural Equation Modelling (SEM) is a flexible statistical method that describes complicated relationships among variables, whether latent or visible. Its ability to analyze intricate causal pathways, integrate latent components, test several hypotheses at once, account for measurement error, evaluate model fit, and combine aspects of factor analysis and regression are just a few of its special features. SEM is an essential tool for research in disciplines like psychology, sociology, economics, and beyond because it can be used to validate theoretical models, examine the effects of interventions or policies, and simplify complex datasets. This allows for more thorough and accurate data analysis and hypothesis testing.
-
Measurement model and validity: Measurement models and validity are indispensable in research as they establish a structured framework for ensuring the accuracy and meaningfulness of data. Measurement models clarify the relationships between observed variables and their underlying constructs, enabling researchers to assess complex concepts.
Validity, on the other hand, ensures that the measurement instruments precisely capture the intended constructs, safeguarding against misleading or incorrect conclusions. Both measurement models and validity are essential components in research, serving as the foundation for reliable and credible findings, which is paramount for informed decision-making and advancing knowledge across diverse fields.
Table 4:Regression Weights: (Group number 1 - Default model)
|
Path |
Unstandardized Estimate |
S.E. |
Standardized Estimates |
C.R. |
P |
|
cs1 <--- Customer Satisfaction |
1.000 |
.822 |
|||
|
Customer cs2 <--- Satisfaction |
.707 |
.036 |
.733 |
19.592 |
*** |
|
Customer cs3 <--- Satisfaction |
.697 |
.032 |
.703 |
21.545 |
*** |
|
Customer cs4 <--- Satisfaction |
.598 |
.037 |
.642 |
16.362 |
*** |
|
Customer cs5 <--- Satisfaction |
.681 |
.038 |
.682 |
17.849 |
*** |
|
Customer cs6 <--- Satisfaction |
.647 |
.038 |
.694 |
17.141 |
*** |
|
TT1 <--- Trust Technology |
1.000 |
.734 |
|||
|
TT2 <--- Trust Technology |
.945 |
.062 |
.640 |
15.320 |
*** |
|
TT3 <--- Trust Technology |
.903 |
.052 |
.627 |
17.284 |
*** |
|
TT4 <--- Trust Technology |
1.163 |
.060 |
.810 |
19.534 |
*** |
|
TT5 <--- Trust Technology |
.887 |
.057 |
.651 |
15.617 |
*** |
|
TT6 <--- Trust Technology |
.940 |
.062 |
.621 |
15.197 |
*** |
|
TLC1 <--- Technical Literacy of Customers |
1.045 |
.058 |
.697 |
18.085 |
*** |
|
TLC2 <--- Technical Literacy of Customers |
1.000 |
.843 |
|||
|
TLC3 <--- Technical Literacy of Customers |
.814 |
.042 |
.707 |
19.365 |
*** |
|
TLC4 <--- Technical Literacy of Customers |
.753 |
.039 |
.660 |
19.081 |
*** |
|
TLC5 <--- Technical Literacy of Customers |
.777 |
.040 |
.713 |
19.596 |
*** |
|
TLC6 <--- Technical Literacy of Customers |
.695 |
.040 |
.625 |
17.456 |
*** |
|
cp1 <--- Chat bot performance |
1.000 |
.685 |
|||
|
Chat bot cp2 <--- performance |
1.099 |
.076 |
.727 |
14.536 |
*** |
|
Chat bot cp3 <--- performance |
1.209 |
.067 |
.744 |
17.969 |
*** |
|
Chat bot cp4 <--- performance |
1.188 |
.080 |
.747 |
14.938 |
*** |
|
Chat bot cp5 <--- performance |
1.101 |
.074 |
.683 |
14.839 |
*** |
|
Chat bot cp6 <--- performance |
1.011 |
.073 |
.639 |
13.916 |
*** |
Table 5:KMO and Bartlett's Test
|
Kaiser-Meyer-Olkin Measure of Sampling Adequacy. |
.955 |
|
|
Bartlett's Test of Sphericity |
Approx. Chi-Square |
8774.413 |
|
df |
276 |
|
|
Sig. |
.000 |
The KMO test and Bartlett's tests are used to determine whether factor analysis is suitable. The factor analysis was validated by the very significant (P = 0.000) Bartlett's Examination, which produced a KMO score of 0.955, indicating excellent sample quality.
Confirmatory Factor Analysis (CFA) verified our instrument by identifying factor loadings greater than the 0.5 threshold, highlighting its excellent measuring capabilities. Items with factor loadings less than 0.6 were eliminated. Table 4 provides details on internal consistency, as measured by Results obtained after CFA, together with average variation extracted (AVE) and the composite reliability (CR). Discriminant validity. is supported by Table 5, indicating that the instrument can accurately assess the required components.
Table 6:Post CFA, Cronbach Alpha, Factor Loadings
|
Factors and items |
Cronbach alpha values |
Post CFA factor loadings |
AVE |
CR |
|
Customer Satisfaction |
0.869 |
0.712 |
0.843 |
|
|
CS1 |
.822 |
|||
|
CS2 |
.733 |
|||
|
CS3 |
.703 |
|||
|
CS4 |
.642 |
|||
|
CS5 |
.682 |
|||
|
CS6 |
.694 |
|||
|
Chat bot performance |
0.850 |
0.704 |
0.840 |
|
|
CP1 |
.685 |
|||
|
CP2 |
.727 |
|||
|
CP3 |
.744 |
|||
|
CP4 |
.747 |
|||
|
CP5 |
.683 |
|||
|
CP6 |
.639 |
|||
|
Trust Technology |
0.854 |
0.680 |
0.831 |
|
TT1 |
.734 |
|||
|
TT2 |
.640 |
|||
|
TT3 |
.627 |
|||
|
TT4 |
.810 |
|||
|
TT5 |
.651 |
|||
|
TT6 |
.621 |
|||
|
Technical Literacy of Customers |
0.874 |
0.707 |
0.841 |
|
|
TLC1 |
.697 |
|||
|
TLC2 |
.843 |
|||
|
TLC3 |
.707 |
|||
|
TLC4 |
.660 |
|||
|
TLC5 |
.713 |
|||
|
TLC6 |
.625 |
Discriminant validity
Discriminant validity is a conceptual validation quality, not a particular statistical test. It guarantees the distinctness of variables in a research, which is necessary for proper measurement. Techniques such as confirmatory component analysis (CFA) and correlation analysis demonstrate that constructs are indeed distinct. This eliminates duplication, improving the accuracy of data processing and interpretation in research.
Table 7: Discriminant validity Test
|
Customer Satisfaction |
Chatbot Performance |
Trust Technology |
Technical literacy of Customers |
|
|
Customer Satisfaction |
0.843801 |
|||
|
Chatbot Performance |
.839** |
0.839047 |
||
|
Trust Technology |
.528** |
.555** |
0.824621 |
|
|
Technical literacy of Customers |
.619** |
.615** |
.853** |
0.840833 |
Table 5 shows good discriminant validity for the research constructs. Diagonal values (AVE square roots) for Customer Satisfaction, Chatbot Performance, Trust Technology, and Technical Literacy are more than 0.50, indicating uniqueness. Construct separation is shown by off-diagonal correlations that are lower than AVE square roots. These data confirm that variables may accurately assess various features of the study constructs.
Table 8: Model Fit Summary
|
Variable |
Chi square value( χ2) |
Degrees of Freedom (df) |
CMIN/DF |
P value |
GFI |
RFI |
NFI |
IFI |
CFI |
RMR |
RMSEA |
|
Value |
963.04 4 |
213 |
4.521 |
0.077 |
0.99 |
0.96 |
0.992 |
0.914 |
0.913 |
0.042 |
0.064 |
It was determined that the following were appropriate representations of the sample data: centeredness of fit (χ2 = 963.044), relative fit index (RFI) = 0.960, comparative fit index (CFI) = 0.913, incremental fit index (IFI) = 0.914, goodness of fit (GFI) = 0.990, and normalised fit index (NFI) = 0.992. These numbers are much higher than 0.90. Both the Root Mean Square Error of Adaptation (RMSEA) = 0.064 and the Rational Mean Square Residuals (RMSR) = 0.042 are below the 0.080 criterion. As shown by the model's RMSEA of 0.064, RMR of 0.042, GFI of 0.990, and CFI of 0.913, the data was well-fitted by it.
Proposed Hypothesis:
H1: Chatbot performance has a significant direct positive effect on customer satisfaction.
Table 9: Regression Weights: (Group number 1 - Default model)
|
Path |
Unstandardized Estimate |
S.E. |
Standardized Estimates |
C.R. |
P |
|
Customer Satisfaction<--- Chatbot Performance |
.924 |
.065 |
.969 |
14.317 |
*** |
The hypothetical structural equation model shows a substantial positive association (β=0.969, P<0.05) between Chatbot Performance (independent variable) and Customer Satisfaction (dependent variable). This implies that Chatbot Performance has a significant influence on increasing Customer Satisfaction in the analysed environment. With a standardised coefficient of 0.969, the path linking Chatbot Performance and Customer Satisfaction demonstrates a strong positive relationship. Large correlation coefficient values (C.R. values) and strong fit indices (p-values > 0.05 in Table 8) confirm the statistical significance of this association, indicating that the model is robust.
Table 10: Model Fit Summary
|
Variable |
Chi square value( χ2) |
Degrees of Freedom (df) |
CMIN/DF |
P value |
GFI |
RFI |
NFI |
IFI |
CFI |
RMR |
RMSEA |
|
Value |
165.698 |
36 |
4.603 |
0.065 |
0.957 |
0.923 |
0.958 |
0.967 |
0.96 7 |
0.03 |
0.078 |
The model has a strong fit, as shown by a χ2 of 165.698 and several fit indices: NFI = 0.958, IFI = 0.967, GFI = 0.957, RFI = 0.923, and CFI = 0.967, all above 0.90. Additionally, the RMR (0.030) and RMSEA (0.078) readings are less than the crucial threshold of 0.080.
H2: Trust in technology significantly mediates the relationship between chatbot performance and customer satisfaction.
Table 11:Regression Weights: (Group number 1 - Default model)
|
Path |
Unstandardized Estimate |
S.E. |
Standardized Estimates |
C.R. |
P |
|
Trust Technology<--- Chatbot Performance |
.547 |
.033 |
.555 |
16.337 |
*** |
|
CUSTOMER Satisfaction<--- Trust Technology |
.101 |
.030 |
.089 |
3.375 |
*** |
|
CUSTOMERSatisfaction<---Chatbot performance |
.880 |
.029 |
.790 |
29.837 |
*** |
The research found that Trust Technology mediates the favourable association between Chatbot Performance and Customer Satisfaction. Chatbot performance has a considerable effect on Trust Technology (β=0.555, C.R.=16.337) and directly impacts Customer Satisfaction (Chatbot: β=0.790, C.R.=29.837; Trust Technology: β=0.089, C.R.=3.375). This emphasises the importance of effective Chatbot Performance and Trust Technology in improving Customer Satisfaction.
Table 12:Standardized Indirect Effects (Group number 1 - Default model)
|
Chatbot performance |
Trust Technology |
|
|
Trust Technology |
.000 |
.000 |
|
CUSTOMER Satisfaction |
.050 |
.000 |
Table 10 shows the standardised indirect effects for Group 1 in the default model, demonstrating the impact of one construct on another via intermediates. For example, CUSTOMER Satisfaction's indirect influence on Trust Technology via Chatbot Performance is.050, demonstrating the extent of the effects. Indirect impacts of Trust Technology are indicated as.000, indicating its low influence in this model.
Table 13:Model Fit Summary
|
Variable |
Chi square value( χ2) |
Degrees of Freedom (df) |
CMIN/DF |
P value |
GFI |
RFI |
NFI |
IFI |
CFI |
RMR |
RMSEA |
|
Value |
389.878 |
93 |
4.192 |
0.077 |
0.912 |
0.9523 |
0.91 |
0.937 |
0.929 |
0.07 |
0.074 |
The model has a strong fit with a χ2 of 389.878 and fit indices surpassing 0.90, including NFI = 0.910, IFI = 0.930, GFI = 0.912, RFI = 0.952, and CFI = 0.929. Additionally, RMR (0.070) and RMSEA (0.074) values are less than the key 0.080 barrier, confirming the model's sufficiency.
H3: Technical literacy significantly moderates the relationship between chatbot performance and customer satisfaction.
Table 14:Regression Weights: (Group number 1 - Default model)
|
Path |
Unstandardized Estimate |
S.E. |
Standardized Estimates |
C.R. |
P |
|
Zscore (Customer Satisfaction) <---Zscore(Chatbot Performance) |
.738 |
.027 |
.737 |
27.055 |
*** |
|
Zscore (Customer Satisfaction) <--- Zscore(Technical literacy of Customers) |
.167 |
.027 |
.167 |
6.119 |
*** |
|
Zscore (Customer Satisfaction)<--- Interaction(Zscore(Technical_literacy_of_Customer s)*Zscore(Chatbot_performance)) |
.041 |
.0 22 |
.040 |
1.852 |
.044 |
A Structural Equation Model (SEM) moderating Z score (Technical Literacy of Customers) is shown in Table 12 and looks at the link between Zscore (Chatbot Performance) and Zscore (Customer Satisfaction). The findings show that customer satisfaction and chatbot performance have a strong positive correlation (β=0.737, P<0.05), and technical literacy has a major impact on customer satisfaction (β=0.167, P<0.05).
Moderation testing:
The moderator variable in this study is Zscore (technical literacy of customers), the dependent variable is Zscore (customer satisfaction), and the independent variable is Zscore (chatbot performance). Using SPSS, the findings are computed by generating interaction terms from the standardized score of the variables.
Table 15: Regression Weights: (Group number 1 - Default model)
|
Path |
Unstandardized Estimate |
S.E. |
Standardized Estimates |
C.R. |
P |
|
Zscore(Customer Satisfaction)<--- Interaction(Zscore(Technical_literacy_of_Customers)*Zscore(Chatbot_performance)) |
.041 |
.022 |
.040 |
1.852 |
.044 |
Testing Zscore (Technical Literacy of Customers) as a moderator indicates a significant favourable influence (β=0.040, P<0.05) of the interaction term between Zscore (Chatbot Performance) and Zscore (Technical Literacy of Customers) on Zscore (Customer Satisfaction). Despite contradicting the hypothesised nature, the fit indices in Table 14 corroborate the model's overall goodness of fit, emphasising the relevance of Technical Literacy in the Chatbot Performance-Customer Satisfaction link.
Table 16: Model Fit Summary
|
Variable |
Chi square value( χ2) |
Degrees of Freedom (df) |
CMIN/DF |
P value |
GFI |
RFI |
NFI |
IFI |
CFI |
RMR |
RMSEA |
|
Value |
23.339 |
8 |
2.917 |
0.056 |
0.975 |
0.923 |
0.971 |
0.98 |
0.98 |
0.0731 |
0.067 |
The model has an excellent fit with a χ2 of 23.339 and strong fit indices above 0.90, including NFI = 0.971, IFI = 0.980, GFI = 0.975, RFI = 0.923, and CFI = 0.980. Furthermore, RMR
(0.031) and the RMSEA (0.067) values are lower than the key 0.080 threshold, indicating the model's adequacy.
12.Discussion
In examining the hypotheses presented, it is evident that the performance of chatbots holds a pivotal role in shaping customer satisfaction. The first hypothesis underscores the direct positive impact of chatbot performance on satisfaction, aligning with the established notion that efficient and effective interactions contribute to overall positive customer experiences. Moving beyond this direct relationship, the second hypothesis introduces the nuanced role of trust in technology as a mediator, suggesting that as trust increases, the positive effects of chatbot performance on satisfaction are further amplified. This highlights the importance of cultivating user trust in technology to enhance the effectiveness of chatbot interactions. The third hypothesis adds the moderating role of technical literacy, demonstrating that users' technological skill may alter the strength of the link among chatbot performance and pleasure. Acknowledging these interrelated factors, businesses must adopt a holistic approach, considering not only the technical capabilities of chatbots but also fostering user trust and accounting for diverse levels of technical literacy. In doing so, a more comprehensive understanding of the intricate dynamics involved in the user-chatbot interaction can be attained, guiding the development and implementation of chatbot systems tailored to meet varied user needs and ultimately optimize customer satisfaction.
Conclusion
The research concluded by looking at three theories on technical literacy, technological trust, and chatbot performance in relation to customer happiness. First, using a well-fitting model (p>0.05), the study validated H1, showing a substantial positive association between Chatbot Performance and Customer Satisfaction (β=0.969, p<0.05). Second, with standardised coefficients of 0.555 (p<0.000) and 0.790 (p<0.000), respectively, it was shown that Trust Technology mediates the association between Chatbot Performance and Customer Satisfaction, supporting the validation of H2. Additionally, there was a favourable direct impact of Trust Technology on Customer Satisfaction (β=0.089, p<0.005). Finally, H3 suggested technical literacy as a moderator. The findings showed that Chatbot Performance and Technical Literacy significantly positively influenced Customer Satisfaction (β=0.040, p<0.05). This surprising result implies that, in contrast to the relationship's predicted nature, technical literacy has a moderating effect. Overall, the research emphasises how crucial effective chatbot performance
is, how crucial technological trust is as a mediator, and how technical literacy functions as a moderator when it comes to determining consumer pleasure in the digital age.
References
-
C. for the S. of S. Policy, “Customer satisfaction: What the research tells us,” p. 42, 2007.
-
Aishwarya Gupta, “Introduction to AI Chatbots,” Int. J. Eng. Res., vol. V9, no. 07, 2020, doi: 10.17577/ijertv9is070143.
-
S. Morsi, “Artificial Intelligence in Electronic Commerce: Investigating the Customers’ Acceptance of Using Chatbots,” J. Syst. Manag. Sci., vol. 13, no. 3, pp. 156–176, 2023, doi: 10.33168/JSMS.2023.0311.
-
N. R. Sanil, J. K. Johnson, E. Small, and F. Bank, “RESEARCH IN ENGINEERING MANAGEMENT OPTIMISING BANK ’ S BRAND EXPERIENCES ON SOCIAL MEDIA : THE ROLE OF CHATBOTS AND INTERACTIVE TOOLS,” pp. 363–371, 2023.
-
S. Shafiee, L. L. Zhang, and K. M. Rasmussen, “Improving Financial Literacy and Supporting Financial Decisions: Developing a Personalized Configurator,” J. Knowl. Econ., no. 0123456789, 2023, doi: 10.1007/s13132-023-01651-9.
-
Y. K. Dwivedi, J. Balakrishnan, A. M. Baabdullah, and R. Das, “Do chatbots establish ‘humanness’ in the customer purchase journey? An investigation through explanatory sequential design,” Psychol. Mark., vol. 40, no. 11, pp. 2244–2271, 2023, doi: 10.1002/mar.21888.
-
M. Kamal and A. S. Himel, “Redefining Modern Marketing: An Analysis of AI and NLP’s Influence on Consumer Engagement, Strategy, and Beyond,” Eig. Rev. Sci. Technol. , vol. 7, no. 1, pp. 203–223, 2023.
-
A. Aldoseri, K. N. Al-Khalifa, and A. M. Hamouda, “A Roadmap for Integrating Automation with Process Optimization for AI-powered Digital Transformation,” 2023, doi: 10.20944/preprints202310.1055.v1.
-
K. Ambili, “Navigating growth : Unraveling the interplay between marketing strategies and social media in the economic development of nations,” vol. 10, no. 02, pp. 1144– 1151, 2023.
-
H. Allioui and Y. Mourdi, “Unleashing the Potential of AI: Investigating Cutting-Edge Technologies That Are Transforming Businesses,” Int. J. Comput. Eng. Data Sci., vol. 3, no. 2, pp. 2737–8543, 2023.
-
S. Chandra, S. Verma, W. M. Lim, S. Kumar, and N. Donthu, “Personalization in personalized marketing: Trends and ways forward,” Psychol. Mark., vol. 39, no. 8, pp. 1529–1562, 2022, doi: 10.1002/mar.21670.
-
H. Hoang, “Navigating the Rise of Smart Tourism: Implications of Technology and Data for Sustainable Industry Growth,” Brawijaya J. Soc. Sci., vol. 3, no. 01, pp. 1–18, 2023, doi: 10.21776/ub.bjss.2023.003.01.1.
-
T. M. Tung, “An Analysis of the Scientific Researches on how Artificial Intelligence affects Digital Marketing Initiatives,” Migr. Lett., vol. 20, pp. 1331–1337, 2023, doi: 10.59670/ml.v20iS8.5266.
-
G. Park, J. Chung, and S. Lee, “Human vs. machine-like representation in chatbot mental health counseling: the serial mediation of psychological distance and trust on compliance intention,” Curr. Psychol., 2023, doi: 10.1007/s12144-023-04653-7.
-
H. Nam and P. K. Kannan, “Digital Environment in Global Markets: Cross-Cultural Implications for Evolving Customer Journeys,” J. Int. Mark., vol. 28, no. 1, pp. 28–47, 2020, doi: 10.1177/1069031X19898767.
-
Y. Bao, W. Gong, and K. Yang, “A Literature Review of Human–AI Synergy in Decision Making: From the Perspective of Affordance Actualization Theory,” Systems, vol. 11, no. 9, 2023, doi: 10.3390/systems11090442.
-
E. M. Lase and F. Nkosi, “Human-Centric AI: Understanding and Enhancing Collaboration between Humans and Intelligent Systems,” Algorithm Asynchronous, vol. 1, no. 1, pp. 33–40, 2023, doi: 10.61963/jaa.v1i1.49.
-
P. GÜLTAŞ, “Strategic Insights: Navigating Digital Transformation and Customer Centricity for Enhanced Business Success,” InTraders Int. Trade Acad. J., vol. 6, no. 2, pp. 223–249, 2023, doi: 10.55065/intraders.1393775.
-
S. (2019) TONTS, “Chatbots_ will they ever be ready?,” 2019.
-
A. Hovsepyan and K. Johansson, “Study of AI Service Providers in IT Consulting, Marketing, and Law,” 2023.