Multilingual Language Models for Customer Support

Malte Ostendorff

Large Language Models (LLMs) are revolutionizing the field of artificial intelligence (AI), driving progress and innovation across industries. Products such as OpenAI’s ChatGPT have gained immense popularity, appealing not only to individual users but also to businesses that leverage this technology to create cutting-edge internal and external tools. Among the various applications, chatbots and virtual assistants for customer support stand out as some of the most impactful. LLM-powered chatbots engage customers in ways that were previously unimaginable, offering a level of natural interaction far superior to the scripted dialogues of older technologies. This transformative shift significantly enhances the customer experience, fostering better communication and satisfaction.

While the general advantages of LLMs have been widely discussed, there is one aspect that has not received the attention it deserves: their multilingual capabilities.

Multilingual Capabilities: A Game-Changer for Global Companies

Multilingual capabilities enable LLMs to generate fluent and coherent text in a vast array of languages – essentially any language with sufficient representation on the web. What makes this truly groundbreaking is that LLMs can sometimes demonstrate proficiency in languages they were not explicitly trained on (Al-Sibai, 2023). For global companies, this opens a wealth of opportunities.

Take Deutsche Telekom, for example. Operating in multiple markets worldwide, it serves a diverse customer base speaking a plethora of languages. Offering consistent, high-quality customer support to all these customers is no small feat. Multilingual LLMs provide a robust solution, enabling customer interactions in the language that users prefer. Imagine an international customer residing in Germany but more comfortable communicating in their native language rather than German. LLMs can facilitate such interactions seamlessly, something that would have been nearly impossible using traditional methods.

Challenges of Multilingual LLM Implementation

However, while the promise of multilingual LLMs is immense, deploying them comes with its own set of challenges:

  • Quality Variation Across Languages: Not all languages are equally supported by LLMs. For example, an LLM might perform exceptionally well in English but produce less accurate or nuanced responses in German or less commonly used languages, as recent research findings suggest (Brack, 2024). This variability is often tied to the amount and quality of data available for training in each language. Therefore, businesses must carefully evaluate how well an LLM supports the specific languages of their target customer base.

  • Cost Implications of Multilingual Operations: The cost of using LLMs can also vary significantly depending on the language. A recent study (Ali et al., 2024) revealed that some languages can increase operational costs by up to 68%. Factors contributing to these disparities include the complexity of tokenization for certain languages and variations in processing time. For companies operating on a global scale, understanding these cost implications is essential to optimizing resources and managing expenses effectively.

  • Vendor and Model Selection: Selecting the right LLM vendor and model is critical for maximizing the benefits of multilingual capabilities. Businesses must assess not only the linguistic proficiency of the model but also its ability to handle region-specific nuances, cultural contexts, and domain-specific terminologies. Conducting thorough evaluations and benchmarking across multiple vendors can ensure that the chosen solution aligns with both the linguistic and operational needs of the company.

The Future of Multilingual LLMs in Customer Support

As LLMs continue to evolve, their multilingual capabilities will only improve, addressing current limitations and unlocking new possibilities. For businesses like Deutsche Telekom, this evolution represents an opportunity to not only improve customer satisfaction but also drive efficiency and innovation.

Soon, advancements in LLMs may reduce the quality gap between languages, making it feasible to offer equally robust support in both major and minor languages. Moreover, the development of more cost-efficient models tailored for specific languages or domains could further lower the barrier to entry for businesses seeking to adopt multilingual AI solutions.

Conclusion

Large Language Models are undeniably at the forefront of AI innovation, with multilingual capabilities offering transformative potential for businesses aiming to deliver exceptional customer experiences. While challenges such as quality disparities and cost variations must be addressed, the opportunities far outweigh the hurdles. For global organizations, integrating multilingual LLMs into customer support systems is no longer just an option – it is becoming a necessity in our increasingly connected world. By investing in the right models and strategies, businesses can build a future where language is no longer a barrier to communication, fostering greater inclusivity and engagement with their customers worldwide.

Bibliography

Ali, M., Fromm, M., Thellmann, K., Rutmann, R., Lübbering, M., Leveling, J., Klug, K., Ebert, J., Doll, N., Buschhoff, J., Jain, C., Weber, A., Jurkschat, L., Abdelwahab, H., John, C., Ortiz Suarez, P., Ostendorff, M., Weinbach, S., Sifa, R., Kesselheim, S., and Flores-Herr, N. (2024). Tokenizer choice for LLM training: Negligible or crucial? In K. Duh, H. Gomez, & S. Bethard (EDS.), Findings of the Association for Computational Linguistics: NAACL 2024 (pp. 3907–3924). Association for Computational Linguistics.

Al-Sibai, N. (2023). Google Surprised When Experimental AI Learns Language It Was Never Trained On. Futurism. https://futurism.com/the-byte/google-ai-bengali

Brack, M. (2024). New Set of German Language Models. Occiglot. https://occiglot.eu/posts/llama-3-german-8b/

About the Author

Dr. Malte Ostendorff

Deutsche Telekom