<?xml version="1.0" encoding="UTF-8"?>
<article xmlns:xlink="http://www.w3.org/1999/xlink">
<front><article-meta>
<title-group><article-title>Optimizing the Ticket Response Process in Customer Support Systems Using Data -Driven and Machine Learning Methods: A Case Study ofIFDA</article-title></title-group>
<contrib-group>
<contrib contrib-type="author"><name><surname>Saadati</surname><given-names>Hossein</given-names></name><xref ref-type="aff" rid="aff1"/></contrib>
<contrib contrib-type="author"><name><surname>Hakimi</surname><given-names>Ahmad</given-names></name><xref ref-type="aff" rid="aff2"/></contrib>
<aff id="aff1">Macroeconomic and Social Systems Master Student, Kharazmi University, Tehran, Iran‎.</aff>
<aff id="aff2">Department of Industrial Engineering, Shahed University, Tehran, Iran‎.</aff>
</contrib-group>
<abstract><p>Effective customer interaction through IT Support Ticketing (ITST) can enhance customer satisfaction, whether human -driven or automated, facilitating collaboration towards common goals. This principle is particularly critical in Information Technology (IT) Services, where clear communication ensures accurate interpretation of requests and efficient resolution of issues .This study employs M achine Learning (ML) algorithms, specifically Natural Language Processing (NLP) and Tag Cloud Representation, to prioritize issues in the support system. The research utilizes data collected from both individual and corporate entities over a one -month peri od, revealing that common problems predominantly involve password and username retrieval issues. The analysis conducted in this study emphasizes the importance of continuous planning and the integration of additional ML algorithms to enhance the support pr ocess further and advance the digitalization of IT systems. This research highlights the critical need for robust IT Service Management (ITSM )strategies to manage increasing ticket volumes and improve Response Times (RT).</p></abstract>
<kwd-group kwd-group-type="author"><kwd>Machine learning</kwd><kwd>Tag cloud representation</kwd><kwd>Response time improvement</kwd><kwd>Practical applications in IT</kwd></kwd-group>
</article-meta></front>
<body>
<sec id="sec-1">
<p>support, Automated IT support systems, NLP .</p>
</sec>
<sec id="sec-2"><label>1</label><title>Introduction</title>
<p>Effective communication serves as the cornerstone of every successful process, whether human -driven or automated. The ability to comprehend one another and exchange ideas and information facilitates collaboration towards achieving common objectives. This h olds especially true in the realm of Information Technology (IT) Services , where clear communication is essential for articulating needs and issues and enabling colleagues to grasp the intricacies of requests thoroughly. A detailed and semantically accurat e description increases the likelihood of the message recipient interpreting it correctly and delivering an appropriate solution. Ultimately, the overarching aim of this scenario is to resolve issues or requests efficiently and effectively.</p>
<p>A ticket is the first step in any Service Desk occurrence. An incident, problem, or service request is an example of a service event, and a ticket is a historical record that describes it. The processing of a service event is governed and controlled by tickets. They are employed in the routing of events for resolution among various resources <xref ref-type="bibr" rid="ref-1">[1]</xref> .</p>
<p>The Iran Food and Drug Admini stration (IFDA) fulfils an essential part in ensuring public health by enforcing laws in a variety of industries, including food, cosmetics, and medicines. The obligation emphasizes the need for a strong infrastructure that can handle inquiries for assista nce from companies looking for regulatory clearance or direction. But despite the recent paperless system upgrade having improved productivity, there has been a noticeable increase in the number of electronic tickets issued. The IFDA&apos;s current workforce fa ces an important obstacle as a result of the rise in requests, which might result in longer Response Times (RT) and delays in crucial regulatory processes.</p>
<p>A ticket is the first step in the world of Service Desk incidents. It acts like an archive that defi nes service events by collecting events, difficulties, or service requests. Tickets control the flow of activities among multiple resources and are the basis for the systematic processing of service events <xref ref-type="bibr" rid="ref-1">[1]</xref> . Although they often have helpful information, tickets are typically disorganized. In theory, in order to understand the extra capabilities, new members should review the most important tickets.</p>
<p>On the other hand, this procedure takes a while. Even though tickets are frequently processed one at a time, groups of tickets occasionally show comparable trends <xref ref-type="bibr" rid="ref-2">[2]</xref> . The digitalization approaches implemented by all sectors have resulted in a notable increase in the volume of support requests <xref ref-type="bibr" rid="ref-3">[3]</xref> . A vital tool for successfully and efficiently handling client requests and concerns, Ticket Management Systems (TMS) are utilize d by a wide range of companies and associations.</p>
<p>Resolution Time (RT), which is the period that occurs between the time that an issue is logged and when it is fully resolved, is a measure of multiple challenges that modern Customer Relationship Management (CRM) systems encounter. Each of these issues can be overcome with Real -Time Prioritization (RTP), especially when it comes to improving the support ticketing module. Companies are now able to assign customer support interactions to personnel, rank them, a nd efficiently follow their growth <xref ref-type="bibr" rid="ref-4">[4]</xref> .</p>
<sec id="sec-3"><label>1.1</label><title>Problem Overview</title>
<p>The IFDA was successfully converted to a paperless system through a recent modernization initiative that used Business Process Management Notation (BPMN) to optimize procedures. Although this digital revolution removed paper -based bottlenec ks, it unexpectedly brought about a new problem: a significant rise in the number of electronic inquiries (tickets). The current workforce is unable to handle the rise of demand from enterprises across the country, specifically in light of the small number of experts (4 -6) in each field (e.g., medicines, cosmetics). As a result, the time it takes to answer queries has increased greatly, which has an effect on the successful implementation of regulations and can place public health at risk by procrastinating necessary assessments.</p>
<p>The IT department came up with and implemented the t icketing system support. <xref ref-type="fig" rid="fig1">Fig. 1</xref> illustrates the main operations of this system. All licenses and permits that the Food and Drug Administration has granted are modelled and implemen ted in businesses using process modelling tools in line with efforts to automate and replace paper -based procedures. This system needs to be carefully analyzed and developed after it is gradually put into operation. Finding the key focal points is the main objective after the process has been described and the process profile has been completed. Graphing the RACI diagram enables a better understanding of the resources and people involved in the process, in addition to the previously discussed tools and visu al paradigm software. Following that, a few documents related to the obtained focal points that call for ideas for solutions will be investigated. The reports undergo review to address the challenges and problems that occurred throughout the research.</p>
<fig id="fig1"><label>Figure 1</label><caption><p>Process of an IT ticketing system.</p></caption><graphic xlink:href="https://opt.reapress.com/public/journals/1/jats-figures/57/fig-1-a6a3f3c4ef0d.png"/></fig>
<p>The focus of IT Service Management (ITSM) is on the administration and framework for IT service delivery <xref ref-type="bibr" rid="ref-5">[5]</xref> . The investigation covers a large stream of the servicing of IT operations. IT specialists successfully develop an organizational framework for IT services by referring to the IT Infrastructure Library (I TIL) as an approach to IT providing services <xref ref-type="bibr" rid="ref-6">[6]</xref> . Unstructured tex tual data, or tickets about occurrences, problems, or modifications to IT infrastructure goods and services, is handled heavily by ITIL&apos;s several domains, such as Occasion, Problem, and Change Management. The quantity and variety of queries and inquiries t hat the IFDA&apos;s IT department gets daily might severely limit the productivity of its employees. In the digital age, migrating from paper -based procedures to modern information systems has become routine. However, the IFDA has launched a ticketing system tooffer its customers online assistance. The first step towards resolving the previously described problems is the deployment of this system.</p>
<fig id="fig2"><label>Figure 2</label><caption><p>GUI of Khedmat system.</p></caption><graphic xlink:href="https://opt.reapress.com/public/journals/1/jats-figures/57/fig-2-edd2f1094ed6.png"/></fig>
</sec>
<sec id="sec-4"><label>1.2</label><title>Significance of Research</title>
<p>The previously described ticketing system has been meticulously developed through a number of collaborative meetings, including experts in the field. The framework aims to deal with the variety of requirements of clients at different phases while upholding the ideals of continual development. However, the scattered requests, a lack of classification, and inadequate user explanations of the problems they face have forced the IFDA&apos;s Research and Development (R&amp;D) department to adopt specific algorithms and re gression models. The research methodology section will include a thorough explanation of these techniques.</p>
<p>According to an examination of the current system logs, waiting in line for the information system is one of the main bottlenecks in the process ment ioned earlier. Due to the shortage of experts in such situations, the system cannot forward a case to a specific expert if the total number of cases assigned to it exceeds a particular limit; instead, it will allocate the case to the selected individual at another time. In addition, if a suitable specialized department is not selected or explained improperly in relation to the activity, it can result in several challenges, including unresolved problems remaining open, misleading responses, and even the need to speak with another expert in a different department or area of expertise for advice or details.</p>
</sec>
</sec>
<sec id="sec-5"><title>Average response time (Day)</title>
<p>7 6/3</p>
<p>3/2 3/1</p>
<p>Pharmaceuticals Cosmetics &amp; Supplements &amp; Food Control Medical Food and Hygiene Natural Products Laboratories Equipment Beverages</p>
<fig id="fig3"><label>Figure 3</label><caption><p>Average response time (days) for inquiries to IFDA departments (Source: IFDA data).</p></caption></fig>
<p>The average response time (in days) for questions sent to the several IFD A departments is shown in <xref ref-type="fig" rid="fig3">Fig. 3</xref> .</p>
<p>The departments are classified on the x -axis, and the average response time is measured on the y -axis. Among all the specialities shown in the chart, the Department of Food and Beverage and the Department of Cosmetics and Hygiene stand out for having the longest resolution timeframes. The cause for this prolonged response time is probably due to a great deal of questions that these business large number of companies generate. However, the IFDA cannot simply incre ase staff to handle the increasing volume of inquiries due to financial constraints. This requires a more systematic and productive method. The IFDA is looking at using Machine Learning (ML) and Artificial Intelligence (AI) to develop an original approach to ticket -setting priorities, having recognized the potential benefits of these technologies.</p>
<p>There has never been a greater need to use modern technology to automate regulatory processes, especially given the mistakes that are common in data collecting an d use. This change offers a solution to the growing issue of regulatory organizations&apos; dwindling internal staffing levels along with simplifying operations <xref ref-type="bibr" rid="ref-7">[7]</xref> .</p>
<p>This study contributes to the ongoing pursuit of enhanced customer support experiences. By leveraging Tag Cloud Representation for ticket prioritization, IFDA can expedite issue resolution, improve resource allocation within its IT service desk, and ultimately enhance customer satisfaction. Furthermore, the research emphasizes the importance of continuous improvement . The exploration of additional ML algorithms alongside NLP presents a promising avenue for further optimizing the digitalization of IFDA&apos;s customer support system, leading to a more robust and efficient service experience for its customers. Additionally, the main re search question of this study: how can customer support systems be optimized in a way that responses to submitted tickets are faster and more effective? is practically addressed in Section 4.</p>
<p>The rest of the paper is structured as follows. Secti on 2 provides the literature review, and in Section 3, the research methodology is explained. Section 4 provides the answer to the main research question (data analysis ). Finally, the conclusion and policy implications of the paper are stated in Section 5.</p>
</sec>
<sec id="sec-6"><label>2</label><title>Literature Review</title>
<p>Any business, given the current level of digitization, has a wide range of applications, many of which have grown continuously. Massive and complex IT service environments are needed to serve such a portfolio <xref ref-type="bibr" rid="ref-8">[8]</xref> .</p>
<p>These advancements highlight the critical role that IT support systems play in the support functions of any firm <xref ref-type="bibr" rid="ref-9">[9]</xref> . Tickets serve as the most significant means for interaction between clients and the personnel in charge of monitoring service, enabling the resolution of any issues or events. These kinds of deali ngs occur in almost every sector of the economy. However, complaints and requests for assistance for IT -related issues are the most common examples <xref ref-type="bibr" rid="ref-1">[1]</xref> . Ticket Automation (TA) can be defined as the collection of automated systems that aim to reduce the number of steps between the submission of a ticket and its resolution. The rising complexity of IT services us ed by businesses has drawn attention to the automatic classification of IT issues <xref ref-type="bibr" rid="ref-10">[10]</xref> .</p>
<p>The initiation of a problem ticket within the helpdesk support system is carried out by the end user, who chooses a category and provi des a description. Nevertheless, the manual selection of the ticket category by the end user introduces the risk of misrouting tickets to incorrect resolver groups. The E -ticketing system, endorsed by the Federal Highway Administration&apos;s Every Day Counts (EDC) program, uses software tools to track electronically and archive data regarding the quantity of construction materials procured by State Transportation Agenci es (STAs) through unit bid contracts based on weight <xref ref-type="bibr" rid="ref-11">[11]</xref> .</p>
<p>The rapid evolution of technologies, particularly driven by contemporary AI, has significantly transformed the world, ideally to the advantage of humanity. AI is being applied to address numerous real -world challenges, benefiting society in various ways. Notable ex amples include industrial automation, intelligent virtual assistants, autonomous vehicles, cancer diagnostics, and advanced Enterprise Resource Planning (ERP) systems <xref ref-type="bibr" rid="ref-12">[12]</xref> .</p>
<p>The advent of ML has opened avenues for automating ticket classificati on, thereby facilitating the prediction of the time required to resolve cases <xref ref-type="bibr" rid="ref-13">[13]</xref> , <xref ref-type="bibr" rid="ref-14">[14]</xref> . Various ML algorithms have been integrated into Service Ticketing Systems (STS) to achieve this goal. In previous research, an in -depth linguistic analysis was conducted on ITIL Change Management (CHM) ticket texts from the IT CHM ticket processing department of a large enterprise with over 200,000 employees worldwide <xref ref-type="bibr" rid="ref-10">[10]</xref> . This study utilized detailed linguistic representations of the ticket texts to implement a rule -based approach for predicting process complexity <xref ref-type="bibr" rid="ref-15">[15]</xref> .</p>
<p>Several automatic document classification methods have been developed using supervised learning techniques, as documented in prior studies <xref ref-type="bibr" rid="ref-16">[16]</xref> . For instance, Revina et al. <xref ref-type="bibr" rid="ref-17">[17]</xref> proposed a method employing Support Vector Machines ( SVM) to detect commits carrying safety risks automatically. Diao and Bhattacharya <xref ref-type="bibr" rid="ref-18">[18]</xref> utilized Word2Vec and a Convolutional Neural Network (CNN) to classify functional and non -functional requirement documents. Additionally, Pingclasai et al. <xref ref-type="bibr" rid="ref-19">[19]</xref> introduced a technique fo r categorizing bug reports using supervised learning and topic modelling methods like Latent Dirichlet Allocation (LDA). However, it is worth noting that labelled training data preparation can be a costly endeavour. Moreover, in cases where the context of the software development project is not predetermined, the derivation and creation of labels pose significant challenges.</p>
<p>Al-Hawari andBarham <xref ref-type="bibr" rid="ref-20">[20]</xref>in a ML -based help desk system for ITSM was introduced to enhance the performance of the German Jordanian University IT staff in addressing technical ticket issues. This system employs a ML model to automatically classify tickets by utilizing the title, description, and comments of each ticket. Specifically, TF -IDF is applied for tokenization and feature extraction, while the SVM algorithm is used for the classification task.</p>
<p>A recent study introduced a SVM classifier that integrates various features such as Bag-Of-Words (BOW), POS -tag, synonyms, and entity types <xref ref-type="bibr" rid="ref-21">[21]</xref> . This research aligns closely with the objectives of our investigation, particularly regarding the extraction technique employed to analyze diverse features within each question.</p>
<p>However, it&apos;s noteworthy that the dataset utilized in the study is the Hierarchical Classification Standard, which differs from the focus of our research, centred on the da taset specific to helpdesk support systems.</p>
<p>Additionally, Rodríguez -Robayo et al. <xref ref-type="bibr" rid="ref-22">[22]</xref>introduced a Tree-Based Convolutional Neural Network (TBCNN) tailored for p rogramming language processing. A pivotal study, the National Cooperative Highway Research Program (NCHRP) Synthesis 450, sheds light on the significant discrepancy between the expanding scope of regulatory responsibilities and the diminishing workforce av ailable to fulfil them <xref ref-type="bibr" rid="ref-23">[23]</xref> , <xref ref-type="bibr" rid="ref-24">[24]</xref> .</p>
<p>The categorization of questions stands as a pivotal component within the realm of question processing as it determines the appropriate type of response. The classification of answers assumes significant importance in Question Answering Systems, delineating the specific information that needs to be retrieved from a knowledge base <xref ref-type="bibr" rid="ref-25">[25]</xref> .Assigning a text to a set of pre -defined categories is known as text classification, sometimes known as categorized text or language tagging. Human specialists have traditionally completed this type of task. For instance, expert text classif ication is still frequently used in qualitative studies such as indexing or coding <xref ref-type="bibr" rid="ref-26">[26]</xref> .However, as the volume of text data increased, scientists&apos; and practitioners&apos; emphasis turned to methods that were automated. Three primary categories of automatic text classification techniques exist rule -based, ML -based and hybrid systems that combine both of them. Software development and maintenance ticket classification have been investigated to address issues like precise ticket allocation and prioritizing, forecasting time and quantity of possible tickets, and pr eventing duplicate requests <xref ref-type="bibr" rid="ref-27">[27]</xref> , <xref ref-type="bibr" rid="ref-28">[28]</xref> .</p>
<p>Showcase the feasibility o f extracting tags possessing collective utility from the amalgamation of individually and freely assigned tags, thereby autonomously resolving tag ambiguity issues <xref ref-type="bibr" rid="ref-29">[29]</xref> . Various machine -learning techniques are explored for email filtering and classification. Additionally, SVM and Artificial Neural Networks (ANN) have been employed by other researchers <xref ref-type="bibr" rid="ref-30">[30]</xref> . Research indicates that the Neural Network (NN) footprint can be significantly reduced with only moderate performance degradation across various tasks such as image recognition <xref ref-type="bibr" rid="ref-31">[31]</xref> , natural language understanding and speech recognition. Various techniques have been proposed to achieve this, including integer quantization <xref ref-type="bibr" rid="ref-32">[32]</xref> , hashing, vector quantization <xref ref-type="bibr" rid="ref-33">[33]</xref> , and matrix factorization. N N models often need to be executed rapidly to minimize user -perceived latency. This is particularly crucial for applications involving continuous interactions with customers, such as virtual assistants <xref ref-type="bibr" rid="ref-34">[34]</xref> .</p>
<p>Delivering top -notch customer service is paramount in both service -based industries and businesses. It&apos;s imperative t o prioritize customer satisfaction by providing optimal assistance. The IT service delivery of every company heavily depends on the efficiency of its helpdesk. Consequently, numerous enterprises employ intelligent helpdesk solutions to enhance the quality of customer service, recognizing its critical importance <xref ref-type="bibr" rid="ref-35">[35]</xref> . A customer&apos;s request for assistance from a service p rovider&apos;s help desk is r eferred to as a support ticket .</p>
<p>These are necessary resources for all contemporary companies to manage their interaction with clients and include incident reports, service tickets, and customer complaints <xref ref-type="bibr" rid="ref-11">[11]</xref> .</p>
<p>In recent years, the adoption of helpdesk support systems has emerged as a prevailing trend across industries, offering a structured approach to managing support services. A plethora of open -source applications catering to helpdesk support has already permeated the market, providing organizations with readily available solutions to facilitate their support endeavours. Management can peruse these options and select the most suitable helpdesk support system based on the unique requirements and objectives of their business operations <xref ref-type="bibr" rid="ref-13">[13]</xref> .</p>
<p>The service desk creates a ticket once it recognizes the situation as an incident. The incident report, the user&apos;s name and contact information, the date and time of the occurrence, and other details should all be included in the ticket. Categorization, ordering, and the actions the service desk takes may all be included in the logging process. The process of categorization entails giving the occur rence of at least one subcategory and a category <xref ref-type="bibr" rid="ref-21">[21]</xref> .</p>
<p>In a helpdesk system, a crucial element is a Question and Answering (Q&amp;A) system, housing question data that serves as the primary information for processing to ensure ef fective implementation of Q&amp;A activities.</p>
<p>Hence, there is a necessity to organize existing questions to facilitate accurate and prompt responses. A question, in this context, refers to a linguistic expression utilized to seek information <xref ref-type="bibr" rid="ref-36">[36]</xref> .</p>
<p>Numerous methods for categorizing questions have been explored and put into practice, particularly within customer service domains. Three primary strategies are commonly employed for question classification tasks:</p>
<p>these include 1) ML approaches, 2) rule -based techniques, and 3) hybrid methodologies that combine elements of both <xref ref-type="bibr" rid="ref-39">[39]</xref>.</p>
<p>Pingclasai et al. <xref ref-type="bibr" rid="ref-19">[19]</xref>conducted a comparative analysis of four algorithms: 1) Multinomial Naïve Bayes, 2) Logistic Regression, 3) K -nearest Neighbor, and 4) SVM . Their findings indicated that the SVM exhibited the highest accuracy rate of 87% when compared to Logistic Regression (81%), Multinomial Naïve Bayes (69%), and K-nearest Neighbor (67%) on the training dataset. Notably, the SVM classifier demonstrated consistent performance across various service desk ticket data samples, achieving a satisfactory level of accuracy. The implementation of the suggested automated ticket classifier system promises enhancements in end -user satisfaction, customer happiness, and the efficient utilization of support resources. Additionally, it facilitates faster tick et RT s and f osters business growth.</p>
<table-wrap id="tab1"><label>Table 1</label><caption><p>Overview of design techniques and key findings in tag cloud research .</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:6:66,395.4,684.4,447.5"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
<p><xref ref-type="bibr" rid="ref-11">[11]</xref> Clustering Applied clustering techniques to tag cloud design .</p>
<p>Alphabetical, semantic, and random <xref ref-type="bibr" rid="ref-37">[37]</xref> Alphabetical design was the best rated .</p>
<p>designs Users can manipulate typography, position, orientation, <xref ref-type="bibr" rid="ref-22">[22]</xref> Manipulable design and color of tags .</p>
<p><xref ref-type="bibr" rid="ref-28">[28]</xref> Tag locatio n (first quadrant) Tags in the first quadrant are most remembered .</p>
<p><xref ref-type="table" rid="tab1">Table 1</xref> summarizes various design techniques used in tag cloud research and the key findings associated with each approach. It highlights the impact of different designs on user efficiency, memory, and interaction with tag clouds.</p>
</sec>
<sec id="sec-7"><label>3</label><title>Research Methodology</title>
<p>As highli ghted at the outset of this study, the growing integration of AI into business and daily life underscores the critical importance of AI explainability. Understanding AI system decisions is crucial for building trust and effectively addressing errors made b y such systems. Our research focuses on the ITIL Change Management-based IT ticketing process of a large telecommunications company. Implementing changes in the IT infrastructure involves interventions in the organization&apos;s IT environment, functions, and u ser experience each time a change is made.</p>
<sec id="sec-8"><label>3.1</label><title>Case Study</title>
<p>There are many different types of research methodologies, but each has its benefits. Research topics that centre on how and why are suitable for cas e studies . For a number of reasons, scenarios are crucial in research.</p>
<p>By providing specific, contextual information that is frequently ignored by more general surveys or experiments, they aid in the development of theories. This is particularly useful in exploratory study, which aims to generate unique ideas and questions.</p>
<p>Furthermore, case histories add fresh data to enhance and broaden previous hypotheses. They are also essential for theory testing since they enable scholars to assess the constraints and applicability of theoretical conceptions in prac tical contexts. Through the observation of interactions between troubles, actions, and outcomes made possible by this practical application, an in -depth understanding of the phenomenon being studied is provided.</p>
<p>The IFDA plays a crucial role in safeguardin g public health by regulating and supervising a wide range of industries, including pharmaceuticals, food, and cosmetics. To enhance its regulatory capabilities, the IFDA has implemented a system known as the Tracking, Tracing and Authentication Control (T TAC). It is for monitoring and tracing health -related products. This system aims to prevent the distribution and sale of counterfeit and smuggled goods. The primary focus of the TTAC system is to create a centralized database to permanently record the owne rship and temporal and spatial identity of a product throughout the supply chain .</p>
<p>IFDA</p>
<p>Food &amp; Cosmetics &amp; Supplements &amp; Medical Food Control Pharmaceuticals Beverages Hygiene Natural Products Equipment Laboratories</p>
<fig id="fig4"><label>Figure 4</label><caption><p>Departments of IFDA .</p></caption></fig>
<p>In the context of this research, the case study method was applied to analyze the IFDA &apos;sTracking, Tracing, and Authentication Control (TTAC) system. The TTAC system, which comprises 23 subsystems operating in five different categories, is designed to prevent the distribution and sale of counterfeit and smuggled goods by creating a centralized database to permanently record the ownership and tem poral and spatial identity of</p>
</sec>
<sec id="sec-9"><label>3.2</label><title>Data Collection</title>
<p>Core system</p>
<p>Technica Licensing l Support Systems Systems</p>
<p>Supply Value-</p>
<p>Chain</p>
<p>Added</p>
<p>Manageme</p>
<p>nt Systems Systems The data collected for this study was sourced from tickets submitted by users within the Food and Drug Ticketing System. Given the high volume of incoming requests, we focused exclusively on system (entity) data over one month as our case study. This approach allowed us to manage the data effectively while ensuring the relevance and accuracy of our findings.</p>
<fig id="fig5"><label>Figure 5</label><caption><p>Architecture of TTAC .</p></caption></fig>
</sec>
<sec id="sec-10"><label>3.3</label><title>Machine Learning</title>
<p>Predi ctive analytics entails leveraging historical data and statistical models to anticipate future events of unknown nature. The concept of predictive analytics has garnered significant attention in recent years, driven by the proliferation of data and advance ments in technologies like AI, ML , and business intelligence. By harnessing predictive analytics, organizations can effectively tap into past and present data to accurately predict trends and behaviours, providing insights into future occurrences ranging f rom seconds to days or even years ahead <xref ref-type="bibr" rid="ref-23">[23]</xref> .</p>
<p>Supervised Learning is a learning function that maps inputs to outputs based on a given example of input - output pairs. Supervised Learning is a function of the training data labels that exist in a set of training examples. This algorithm requires external assistance from a supervisor. The input dataset will be separated into two parts: 1) train ,and 2) test. There will be an output variable in the training dataset that must be predicted or categorized. Draws a pattern from the training dataset and applies i t to the test dataset for prediction or classification <xref ref-type="bibr" rid="ref-26">[26]</xref> .</p>
</sec>
<sec id="sec-11"><label>3.4</label><title>Natural LanguageProcessing</title>
<p>Natural Language Processing (NLP) is a significant field of AI which investigates the connections between people and computers through natural language. It explores basic approaches to understanding the meaning of lexical, phrasal, and textual expressions. These approaches include grammatical and semantic processes like as syntactic parsing, semantic translation, and lexical analysis. Moreover, NLP aims to create several applications, including text production, dial ogue systems, information retrieval, Machine Translation (MT), and recommendation engines. In industries like search engines, virtual assistants, corporate analytics, and customer support systems, NLP integration is essential. The history of NLP dates back to the 1950s. In the beginning of NLP research, rule -based methods were used to build NLP systems, including word/sentence analysis, QA, and MT <xref ref-type="bibr" rid="ref-20">[20]</xref> , <xref ref-type="bibr" rid="ref-29">[29]</xref> .</p>
<sec id="sec-12"><label>3.4.1</label><title>Tag cloud representation</title>
<p>A novel approach for met adata creation, known as tagging, has emerged. Tagging -based systems enable users to categorize web resources by adding freely chosen keywords or tags to facilitate their retrieval at a later time. Tagging functions not only as an individual categorization process but also as a social indexing mechanism and a collective knowledge construction activity. By sharing resources along with their associated tags, users contribute to the generation of an aggregated tag index referred to as a folksonomy. Folksonomy is defined as a space of keywords. When folksonomy is used, searchers can access the resources previously tagged through two principal paradigms: 1) Information Filtering (IF), and 2) Information Retrieval (IR) <xref ref-type="bibr" rid="ref-11">[11]</xref> .</p>
</sec>
<sec id="sec-13"><label>3.4.2</label><title>Evaluati on metrics</title>
<p>Aouicheet al. <xref ref-type="bibr" rid="ref-38">[38]</xref>defined the entropy of a tag cloud as follows:</p>
<p>Entropy ( T ) = −∑ p ( t ) log { p ( t ) } , (1)</p>
<p>t ∈ T</p>
<p>where weiqht ( t )</p>
<p>p ( t ) = . (2)</p>
<p>∑ t ∈ Tweiqht ( t ) Entropy quantifies the weight disparity between tags. If it is low, the tag cloud is significant or effective. If, on the contrary, it is high, the weights of the tags are uniform, which visually is not very informative. A tag cloud will be effective if it consists of significant tags <xref ref-type="bibr" rid="ref-18">[18]</xref> . According to Sinclair and Cardew-Hall<xref ref-type="bibr" rid="ref-39">[39]</xref> , various methods of tag generation should be reviewed, including aspects such as tag size and tag usefulness. They argue that a ranking system is essent ial for the selection of tags to be displayed in the tag cloud.</p>
<p>Log ( f i −f min +1 )</p>
<p>TagSize =1+C . , (3)</p>
<p>Log ( f max −f min +1 ) where f iis the tag frequency, f min and f max are the minimum and maximum frequencies, respectively, and C is a constant which determines the maximum text size.</p>
<p>This section of the article delves into the analysis of the employed methods and addresses the posed inquiries to present a practical and ef fective approach for addressing the research problem. Leveraging ML algorithms, this section explains the methods that were used and gives practical solutions to the challenge that was explored. By examining actual cases in the appropriate field, these eva luations give investigators the chance to identify trends and subsequently acquire expertise for closing the understanding gap between theory and practice. Therefore, the practical strategy used in this part helps to improve understanding and effectiveness while solving real -world problems in the sector.</p>
<p>As we became familiar with the systems related to the Food and Drug Administration in the previous section, we will now, considering the various subsystems under the TTAC system for transferring implementat ion experiences in the regulatory industry in the health sector, randomly implement and introduce one of the targeted systems called Entities .</p>
<p>Applicants create a task list for registering technical managers&apos; details. After submission, In the Entity system. Food and Drug Administration reviews and approves the information, issuing an activity license. Company managers can then search for and send employment requests to licensed technical managers, who can accept or reject these requests.</p>
</sec>
</sec>
</sec>
<sec id="sec-14"><label>4</label><title>Solution an d Implementation</title>
<p>This section of the article delves into the analysis of the employed methods and addresses the posed inquiries to present a practical and effective approach for addressing the research problem. Leveraging ML algorithms, this section explai nsthe methods that were used and gives practical solutions to the challenge that was explored. By examining actual cases in the appropriate field, these evaluations give investigators the chance to identify trends and subsequently acquire expertise for cl osing the understanding gap between theory and practice. Therefore, the practical strategy used in this part helps to improve understanding and effectiveness while solving real -world problems in the sector.</p>
<p>As we became familiar with the systems related to the Food and Drug Administration in the previous section, we will now, considering the various subsystems under the TTAC system for transferring implementation experiences in the regulatory industry in the health sector, randomly implement and introduce o ne of the targeted systems called Entities .</p>
<p>In the Entitysystem, by executing the Request for Technical Manager Qualification operation by the applicant, a task list is created for them. The technical manager information registration task list is specifically designed for completing the personal information, educational, and wo rk history of technical managers.</p>
<p>Additionally, the registration task list for the CEO is specifically designed for registering legal companies active in the health sector. This task list includes the personal information of the CEO and board members, along with the registered company information . After reg istering and submitting the technical manager&apos;s information in the system, the information review process is carried out by the Food and Drug Administration experts, and if the information is approved, an activity license for the technical manager is issue d. After the activity license is issued, company managers can search for the relevant technical manager and send an employment request to them. The technical manager, by viewing the applicant companies&apos; information in the system, can accept o r reject the e mployment requests.</p>
<fig id="fig6"><label>Figure 6</label><caption><p>Mapping the challenges of entity registration .</p></caption><graphic xlink:href="https://opt.reapress.com/public/journals/1/jats-figures/57/fig-3-fe0f2af284d1.jpg"/></fig>
<p>In <xref ref-type="fig" rid="fig6">Fig. 6</xref>, to facilitate and expedite the response to registered tickets, we will categorize and classify them, and in the continuation of the article, we will discuss how this ca tegorization is used in the applied algorithms.</p>
<p>In this section, we provide a detailed solution to optimize customer support systems, addressing the main research question of this study:</p>
<p>Q1: How can customer support systems be optimized in a way that resp onses to submitted ticke ts are faster and more effective?</p>
<fig id="fig7"><label>Figure 7</label><caption><p>Tag cloud representation .</p></caption><graphic xlink:href="https://opt.reapress.com/public/journals/1/jats-figures/57/fig-4-56c3432e9a60.jpg"/></fig>
<p>Given the heavy workload in the Ian Food and Drug Administration (IFDA), the presence of specialized departments with numerous requests, the submission of duplicate tickets, the outbreak of infectious diseases such as COVID-19, and several other factors, the need to improve the customer service support system became critically important. Support systems for users require precise prioritization to respond effectively and efficiently to submitted tickets. To address this, we conducted group meetings with experts from specialized departments to gather and document their feedback. Subsequently, in collaboration with IT engineers and utilizing the Tag Cloud R epresentation technique, the status of open tickets in the system was graphically displayed to the responsible experts in a structured format.</p>
<p>The Tag Cloud Representation technique helps categorize tickets based on frequently used keywords and similar topics. This meth od enables experts to identify high -priority tickets and respond appropriately quickly.</p>
<p>Additionally, by displaying frequently asked questions in the users&apos; dashboard, duplicate ticket submissions are prevented, thereby reducing the workload.</p>
<p>Using this te chnique resulted in:</p>
<p>I. Increased efficiency and productivity: experts were able to respond faster to more important tickets with proper prioritization.</p>
<p>II. Reduction in duplicate tickets: by displaying frequently asked questions to users, the number of duplicate tickets decreased, reducing the workload for experts.</p>
<p>III. Improved user satisfaction: rapid and effective responses to tickets led to higher user satisfaction.</p>
<p>IV. Better resource management: with fewer duplicate tickets, the organization&apos;s resources wer e managedmore optimally.</p>
<p>Statistics indicate that the implementation of this method has led to a decrease in the number of submitted tickets and an improvement in the quality of responses. These measures have significantly enhanced the efficiency and red uced the workload of the support units. All the code related to this section, written using the Jupyter framework, has been included in the attached file submitted with this paper for the journal.</p>
</sec>
<sec id="sec-15"><title>Average response time(Day)</title>
<p>Average response time (before)Average response time (after)</p>
<p>7 6/3 6 5/2 5 4/3 4 3/2 3/3 3 2/2</p>
<p>Pharmaceuticals Cosmetics &amp; Supplements &amp; Food Control Medical Food and Hygiene Natural Products Laboratories Equipment Beverages</p>
<fig id="fig8"><label>Figure 8</label><caption><p>Research findings .</p></caption></fig>
</sec>
<sec id="sec-16"><label>5</label><title>Conclusion</title>
<p>The limitations identified across studies addressing behaviour pattern analysis in ticketing systems span several aspects. These include challenges such as noisy data affecting pattern recognition, limitations in handling technical terms impacting accuracy , algorithmic constraints hindering ticket classification, computational resource requirements for expedited learning, the need for periodic training set adjustments, absence of ground truth annotations for sentiment analysis, dataset constraints, the nece ssity to evaluate system performance over longer time scales and under varying settings, and the initial handling of unstructured noisy data. Addressing these limitations collectively would require strategies ranging from data preprocessing techniques to a lgorithmic enhancements and resource optimization to ensure accurate and efficient behaviour pattern analysis in ticketing systems.</p>
<p>This paper explores the limitations and potential solutions for behaviour pattern analysis in ticketing systems. By analyzin g user interactions within ticketing systems, organizations can gain valuable insights into customer behaviour, identify potential issues, and improve overall service delivery. However, several challenges hinder the accuracy and efficiency of current behav iour pattern analysis methods.</p>
<p>This investigation points up a number of major shortcomings in previous research on behavior pattern analysis in ticketing systems. Some of these challenges are:</p>
<p>I. Noisy data: ticketing system data can be riddled with errors an d inconsistencies, impacting pattern recognition algorithms <xref ref-type="bibr" rid="ref-14">[14]</xref> .</p>
<p>II. Technical terminology: the presence of technical terms within tickets can hinder the accuracy of analysis, as classification algorithms may not readily understand these ter ms.</p>
<p>III. Algorithmic constraints: current classification algorithms might struggle to effectively categorize tickets due to inherent limitations in their design <xref ref-type="bibr" rid="ref-1">[1]</xref> .</p>
<p>IV. Computational resources: training and running complex algorithms often require significant computational resources, impacting processing speed and scalability.</p>
<p>V. Training set maintenance: the performance of behaviour pattern analysis systems can degrade over time if the training data sets are not periodically adjusted to reflect evolving user behaviour and system configurations.</p>
<p>VI. Sentiment analysis challenges: the absence of ground truth annotations for sen timent analysis within ticketing data makes it difficult to assess us er emotions and satisfaction accurately <xref ref-type="bibr" rid="ref-40">[40]</xref> .</p>
<p>VII. Dataset constraints: dataset limitations, such as size and representativeness, can restrict the generalizability of findings and hinder the development of robust behaviour pattern analysis models.</p>
<p>By addressing these challenges and implementi ng the proposed solutions, researchers and practitioners can develop more accurate and efficient behaviour pattern analysis systems for ticketing systems. This will ultimately lead to improved customer service delivery and enhanced decision -making within o rganizations.</p>
<p>The provision of support services throughout the entire application system development process stands as a cornerstone for organizational success. Both technical and management support play indispensable roles in guaranteeing the seamless evo lution and ultimate triumph of an application system. From the initial user requirement phase through programming development, system testing, and culminating in the final support stage, ongoing assistance is imperative to shepherd the system to its full m aturity. Indeed, the continuity of support services is essential for sustaining the relevance and functionality of an application system over time . A ML system for categorization and ranking incoming calls can be developed by exploiting the IFDA&apos;s huge col lection of previous inquiries and replies. The platform may evaluate incoming inquiries and assign priority levels depending on public health impact and urgency by developing models on earlier data. This ensures prompt attention to critical issues, optimiz ing resource allocation and regulatory decision -making. When an ML -based ticket prioritizing system is effectively implemented at the IFDA, it can optimize the utilization of resources, simplify workflows, and greatly speed up RT for severe public health c oncerns. By using ML to find patterns in questions, human specialists can focus on deeper issues, which increases productivity and eliminates backlogs.</p>
<p>The IFDA has strong databases that are used to publicly label ML algorithms like K -Nearest Neighbours (KNN) and others. This enables improved performance comparison and exploitation. Moreover, through the development of a multi -year strategy and the setting up of appropriate performance measures, the Support Ticketing system can be improved by giving priorit y to ongoing improvement.</p>
<p>The high volume of inquiries encountered in the transitioned paperless environment at the IFDA necessitates a novel solution. Implementing a ML system for ticket prioritization offers a promising approach. By leveraging its vast d ataset of past inquiries and resolutions, the IFDA can develop a system capable of intelligently classifying and prioritizing incoming tickets based on urgency and potential public health impact. This innovative solution holds the potential to enhance publ ic health protection, optimize resource allocation within the IFDA, and improve customer service for businesses seeking regulatory guidance. Further R&amp;D are crucial to refine this approach and ensure its successful integration within the IFDA&apos;s regulatory framework.</p>
</sec>
<sec id="sec-17"><title>Author Contribution</title>
<p>The conceptualization and ideas for the study were developed by H.S. The data collection and formal analysis were also carried out by H.S. Funding for the research was acquired by A.H. Both A.H. and H.S. were involved in the investigation phase. Methodology development, software programming, and the creation of computer code and supporting algorithms were handled by H.S. Validation and review were conducted by A.H., while the original draft of the manuscript was written by H.S. The review and editing process was completed by A.H.</p>
</sec>
<sec id="sec-18"><title>Data Availability</title>
<p>The data used in this research study is derived from th e ticketing system of the IFDA . The FDA retains the ownership of this data. Given the nature of the data, which includes inf ormation related to the production lines of certain pharmaceuticals and specific drug -related details, sharing this data poses significant risks and potential harm. Despite our trust in your esteemed journal, we must adhere to these confidentiality constra ints. However, we have included the relevant Python software codes in the appendix for the journal&apos;s review.</p>
</sec>
<sec id="sec-19"><title>Conflicts of Interest</title>
<p>The author declares no conflict of interest. The data utilized in this study were obtained from the ticketing system of the IFDA . Access to this data was granted under strict confidentiality agreements, and the IFDA retains full ownership of the data. Therefore, the data cannot be shared publicly or with third parties without explicit permission from the IFDA.</p>
</sec>
</body>
<back><ref-list><title>References</title>
<ref id="ref-1"><label>1</label><mixed-citation>Hertvik, J. (2020). Service desk TIPS explained: Ticket, incident, problem, service request. <ext-link ext-link-type="uri" xlink:href="https://www.bmc.com/blogs/ticket">https://www.bmc.com/blogs/ticket</ext-link> -vs-incident -vs-problem -vs-service -request/</mixed-citation></ref>
<ref id="ref-2"><label>2</label><mixed-citation>Mani, S., Sankaran, A., &amp; Aralikatte, R. (2019). Deeptriage: exploring the effectiveness of deep learning for bug triaging. Proceedings of the ACM India joint international co nference on data science and management of data(pp. 171 – 179). Association for Computing Machinery. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1145/3297001.3297023">https://doi.org/10.1145/3297001.3297023</ext-link></mixed-citation></ref>
<ref id="ref-3"><label>3</label><mixed-citation>Kurnaedi, D., Oktora, E., Dharmawan, E., Nasrullah, I., &amp; Drajat, M. (2022). Web -based IT helpdesk ticketing sy stem at PT. Dayacipta Kemasindo. Bit-tech: binary digital -technology , 5(2), 121 – 127. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.32877/bt.v5i2.617">https://doi.org/10.32877/bt.v5i2.617</ext-link></mixed-citation></ref>
<ref id="ref-4"><label>4</label><mixed-citation>Mani, S., Sankaranarayanan, K., Sinha, V. S., &amp; Devanbu, P. (2014). Panning requirement nuggets in stream of software maintenance tickets. Proceedings of the 22nd ACM sigsoft international symposium on foundations of software engineering (pp. 678 – 688). Association for Computing Machinery. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1145/2635868.2635897">https://doi.org/10.1145/2635868.2635897</ext-link></mixed-citation></ref>
<ref id="ref-5"><label>5</label><mixed-citation>Orta, E., Ruiz, M., Hurtado, N., &amp; Gawn, D. (2014) . Decision -making in IT service management: a simulation based approach. Decision support systems , 66, 36 – 51. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1145/2635868.2635897">http://dx.doi.org/10.1145/2635868.2635897</ext-link></mixed-citation></ref>
<ref id="ref-6"><label>6</label><mixed-citation>Fontes, M., Nascimento, W., Carvalho, K., Moreira, E., Cardoso, M., &amp; Montoni, M. (2014). Improving the software factory contracting process in the public area: the rio de janeiro city hall’s experience. 2014 9th international conference on the quality of information and communications technology (pp. 152 – 155). IEEE.</mixed-citation></ref>
<ref id="ref-7"><label>7</label><mixed-citation>Newcomer, C., Withrow, J., Stur gill, R. E., &amp; Dadi, G. B. (2019). Towards an automated asphalt paving construction inspection operation. Advances in informatics and computing in civil and construction engineering: proceedings of the 35th CIB w78 2018 conference: it in design, constructi on, and management(pp. 593– 600). Springer. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/978">https://doi.org/10.1007/978</ext-link> -3-030-00220-6_71</mixed-citation></ref>
<ref id="ref-8"><label>8</label><mixed-citation>Paramesh, S., &amp; Shreedhara, K. S. (2019). It help desk incident classification using classifier ensembles. ICTACT journal on soft computing , 9(04), 331 – 346. DOI:1 0.21917/ijsc.2019.0276</mixed-citation></ref>
<ref id="ref-9"><label>9</label><mixed-citation>Agarwal, S., Aggarwal, V., Akula, A. R., Dasgupta, G. B., &amp; Sridhara, G. (2017). Automatic problem extraction and analysis from unstructured text in IT tickets. IBM journal of research and development , 61(1), 4– 41. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1147/JRD.2016.2629318">https://doi.org/10.1147/JRD.2016.2629318</ext-link></mixed-citation></ref>
<ref id="ref-10"><label>10</label><mixed-citation>Rizun, N., Meister, V., &amp; Revina, A. (2020). Discovery of stylistic patterns in business process textual descriptions: it ticket case. 33rd international business information management association conference (pp. 2103– 2113).IBIMA. <ext-link ext-link-type="uri" xlink:href="https://ibima.org">https://ibima.org</ext-link> /accepted-paper/discovery-of-stylistic -patterns -in-business-process-textual -data-it -ticket -case/</mixed-citation></ref>
<ref id="ref-11"><label>11</label><mixed-citation>Hassan -Montero, Y., &amp; Herrero -Solana, V. (2024). Improving tag -clouds as visual information retrieval interfaces . <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.48550/arXiv.2401.049">https://doi.org/10.48550/arXiv.2401.049</ext-link> 47</mixed-citation></ref>
<ref id="ref-12"><label>12</label><mixed-citation>Rizun, N., Revina, A., &amp; Meister, V. (2019). Method of decision -making logic discovery in the business process textual data. International conference on business information systems (pp. 70 – 84). Springer.</mixed-citation></ref>
<ref id="ref-13"><label>13</label><mixed-citation>Harun, N. A., Huspi, S. H., &amp; Iahad, N. A. (2021). Question classification framework for helpdesk ticketing support system using machine learning. 2021 7th international conference on research and innovation in information systems ( ICRIIS)(pp. 1 – 7). IEEE. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/ICRIIS53035">https://doi.org/10.1109/ICRIIS53035</ext-link> .2021.9617077</mixed-citation></ref>
<ref id="ref-14"><label>14</label><mixed-citation>Chagnon, C. J., Trapp, A. C., &amp; Djamasbi, S. (2017). Creating a decision support system for service classification and assignment through optimization [presentation]. Twenty -third americas conference on information systems (pp. 1 – 5). <ext-link ext-link-type="uri" xlink:href="https://scholar.archive.org/work/qhgkenuucff4lp4brdv3ox3kcm/access/wayback/http://aisel.aisnet.org:8">https://scholar.archive.org/work/qhgkenuucff4lp4brdv3ox3kcm/access/wayback/http://aisel.aisnet.org:8</ext-link> 0/cgi/viewcontent.cgi?article=1393&amp;context=amcis2017</mixed-citation></ref>
<ref id="ref-15"><label>15</label><mixed-citation>Revina, A., &amp; Rizun, N. (2019). Multi-criteria knowledge -based recommender system for decision support in complex business processes .<ext-link ext-link-type="uri" xlink:href="https://mostwiedzy.pl/pl/publication/multi">https://mostwiedzy.pl/pl/publication/multi</ext-link> -criteria -knowledge -based-recommender -system-for-decision -support-in-complex -business-processes,150018 -1</mixed-citation></ref>
<ref id="ref-16"><label>16</label><mixed-citation>Dekhtyar, A., &amp; Fong, V. (2017). Re data challenge: req uirements identification with word2vec and tensorflow. 2017 IEEE 25th international requirements engineering conference ( RE )(pp. 484 – 489). IEEE.</mixed-citation></ref>
<ref id="ref-17"><label>17</label><mixed-citation>Revina, A., Buza, K., &amp; Meister, V. G. (2020). It ticket classification: The simpler, the better. IEEE access , 8, 193380– 193395. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/ACCESS.2020.3032840">https://doi.org/10.1109/ACCESS.2020.3032840</ext-link></mixed-citation></ref>
<ref id="ref-18"><label>18</label><mixed-citation>Diao, Y., &amp; Bhattacharya, K. (2008). Estimating business value of it services through process complexity analysis. NOMS 2008 -2008 IEEE network operations and management symposium (pp. 208 – 215). IEEE.</mixed-citation></ref>
<ref id="ref-19"><label>19</label><mixed-citation>Pingclasai, N., Hata, H., &amp; Matsumoto, K. (2013). Classifying bug reports to bugs and other requests using topic modeling. 2013 20th asia -pacific software engineering conference ( APSEC )(Vol. 2, pp. 13 – 18). IEEE.</mixed-citation></ref>
<ref id="ref-20"><label>20</label><mixed-citation>Al-Hawari, F., &amp; Barham, H. (2021). A machine learning based help desk system for IT service management. Journal of king saud university -computer and information sciences , 33(6), 702 – 718. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.jksuci.2">https://doi.org/10.1016/j.jksuci.2</ext-link> 019.04.001</mixed-citation></ref>
<ref id="ref-21"><label>21</label><mixed-citation>Prasetio, R. T., Ramdhani, Y., &amp; Alamsyah, D. P. (2021). Scrum method in help -desk ticketing and project management system. 2021 3rd international conference on cybernetics and intelligent system ( ICORIS )(pp. 1 – 6). IEEE. <ext-link ext-link-type="uri" xlink:href="https://doi.org/1">https://doi.org/1</ext-link> 0.1109/ICRIIS53035.2021.9617077</mixed-citation></ref>
<ref id="ref-22"><label>22</label><mixed-citation>Rodríguez -Robayo, K. J., Méndez -López, M. E., Molina -Villegas, A., &amp; Juárez, L. (2020). What do we talk about when we talk about milpa? A conceptual approach to the significance, topics of research and impact of the ma yan milpa system. Journal of rural studies , 77, 47 – 54. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.jrurstud.2020.04.029">https://doi.org/10.1016/j.jrurstud.2020.04.029</ext-link></mixed-citation></ref>
<ref id="ref-23"><label>23</label><mixed-citation>Bottou, L., Curtis, F. E., &amp; Nocedal, J. (2018). Optimization methods for large -scale machine learning. SIAM review, 60(2), 223 – 311. <ext-link ext-link-type="uri" xlink:href="https://doi.org">https://doi.org</ext-link> /10.1137/16M1080173</mixed-citation></ref>
<ref id="ref-24"><label>24</label><mixed-citation>Houssein, E. H., Mohamed, R. E., &amp; Ali, A. A. (2021). Machine learning techniques for biomedical natural language processing: a comprehensive review. IEEE access , 9, 140628 – 140653. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/ACCESS.2021.3119621">https://doi.org/10.1109/ACCESS.2021.3119621</ext-link></mixed-citation></ref>
<ref id="ref-25"><label>25</label><mixed-citation>Cortes, E., Woloszyn, V., Binder, A., Himmelsbach, T., Barone, D., &amp; Möller, S. (2020). An empirical comparison of question classification methods for question answering systems. Proceedings of the twelfth language resources and evaluation conference (pp.5408– 5416). European Language Resources Association (ELRA).</mixed-citation></ref>
<ref id="ref-26"><label>26</label><mixed-citation>Basha, S. M., &amp; Rajput, D. S. (2019). Survey on evaluating the performance of machine learning algorithms: Past contributions and future roadmap. In Deep learning and parallel computing env ironment for bioengineering systems (pp. 153 – 164). Elsevier. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/B978">https://doi.org/10.1016/B978</ext-link> -0-12-816718-2.00016-6</mixed-citation></ref>
<ref id="ref-27"><label>27</label><mixed-citation>Carpinteiro, O. A. S., Lima, I., Assis, J. M. C., de Souza, A. C. Z., Moreira, E. M., &amp; Pinheiro, C. A. M. (2006). A neural model in anti -spam systems. Artificial neural networks -- icann 2006: 16th international conference, athen s, greece , part II 16 (pp. 847 – 855). Springer. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/11840930_88">https://doi.org/10.1007/11840930_88</ext-link></mixed-citation></ref>
<ref id="ref-28"><label>28</label><mixed-citation>Ye, Y., Lee, B., Flynn, R., Murray, N., &amp; Qiao, Y. (2017). HLAF: heterogeneous -latency adaptive forwarding strategy for peer -assisted video streaming in ndn. 2017 IEEE symposium on computers and communications ( ISCC )(pp. 657 – 662). IEEE. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10">https://doi.org/10</ext-link> .1109/ISCC.2017.8024603</mixed-citation></ref>
<ref id="ref-29"><label>29</label><mixed-citation>Awad, W. A., &amp; ELseuofi, S. M. (2011). Machine learning methods for spam e -mail classification. AIRCC’s international journal of computer science and information technology , 3(1), 173– 184. DOI : 10.5121/ijcsit.2011.3112</mixed-citation></ref>
<ref id="ref-30"><label>30</label><mixed-citation>Yayah, F. C., Ghauth, K. I., &amp; Ting, C. -Y. (2022). The Performance Of Classification Method In Telco Customer Trouble Ticket Dataset. IAENG international journal of computer science , 49(2). <ext-link ext-link-type="uri" xlink:href="http://www.iaeng.org/IJCS/issues_v49/issue_2/IJCS_49_2_05.pdf">http://www.iaeng.org/IJCS/issues_v49/issue_2/IJCS_49_2_05.pdf</ext-link></mixed-citation></ref>
<ref id="ref-31"><label>31</label><mixed-citation>Yang, N., Wu, G., MacEachren, A. M., Pang, X., &amp; Fang, H. (2023). Comparison of font size and background color strategies for tag weights on tag maps. Cartography and geographic information science , 50(2), 162 – 177. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/15230406.2022.2">https://doi.org/10.1080/15230406.2022.2</ext-link> 152098</mixed-citation></ref>
<ref id="ref-32"><label>32</label><mixed-citation>Denton, E. L., Zaremba, W., Bruna, J., LeCun, Y., &amp; Fergus, R. (2014). Exploiting linear structure within convolutional networks for efficient evaluation . <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.48550/arXiv.1404.0736">https://doi.org/10.48550/arXiv.1404.0736</ext-link></mixed-citation></ref>
<ref id="ref-33"><label>33</label><mixed-citation>Gong, Y., Liu, L., Yang, M., &amp; Bourdev, L. (2014). Compressing deep convolutional networks using vector quantization . <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.48550/arXiv.1412.6115">https://doi.org/10.48550/arXiv.1412.6115</ext-link></mixed-citation></ref>
<ref id="ref-34"><label>34</label><mixed-citation>Jaderberg, M., Vedaldi, A., &amp; Zisserman, A. (2014). Speeding up convolutional neural networ ks with low rank expansions . <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.48550/arXiv.1405.3866">https://doi.org/10.48550/arXiv.1405.3866</ext-link></mixed-citation></ref>
<ref id="ref-35"><label>35</label><mixed-citation>Sujata, S., &amp; Ramya, M. (2020). Real -time IT help desk ticket classification using deep learning approach. International journal of scientific and technology research , 9(4), 239 – 244.</mixed-citation></ref>
<ref id="ref-36"><label>36</label><mixed-citation>Paramesh, S. P., &amp; Shreedhara, K. S. (2019). Automated it service desk systems using machine learning techniques. Data analytics and learning: proceedings of dal 2018 (pp. 331 – 346). Springer.</mixed-citation></ref>
<ref id="ref-37"><label>37</label><mixed-citation>Abakouy, R., En-Naimi, E. M., El Haddadi, A., &amp; Lotfi, E. (2019). Data -driven marketing: how machine learning will improve decision -making for marketers. ACM international conference proceeding series (pp. 1– 5). Association for Computing Machinery. DOI: 10.1145/3368756.3369024</mixed-citation></ref>
<ref id="ref-38"><label>38</label><mixed-citation>Aouiche, K., Lemire, D., &amp; Godin, R. (2009). Web 2.0 olap: from data cubes to tag clouds. Web information systems and technologies: 4t h international conference (pp. 51 – 64). Springer. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/978">https://doi.org/10.1007/978</ext-link> -3-642- 01344-7_5</mixed-citation></ref>
<ref id="ref-39"><label>39</label><mixed-citation>Sinclair, J., &amp; Cardew -Hall, M. (2008). The folksonomy tag cloud: when is it useful? Journal of information science , 34(1), 15 – 29. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/0165551506078083">https://doi.org/10.1177/0165551506078083</ext-link></mixed-citation></ref>
<ref id="ref-40"><label>40</label><mixed-citation>Mandal, A., Malhotra, N., Agarwal, S., Ray, A., &amp; Sridhara, G. (2019). A utomated dispatch of helpdesk email tickets: pushing the limits with AI. Proceedings of the AAAI conference on artificial intelligence (Vol. 33, pp. 9381 – 9388). IAAI. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1609/aaai.v33i01.33019381">https://doi.org/10.1609/aaai.v33i01.33019381</ext-link></mixed-citation></ref>
</ref-list></back>
</article>