Language models are the fuel that powers AI driven technology like translation software, chatbots, and text recognition. As it takes significant investment and time to create a functional language model, the common practice when building AI systems like chatbots is to use a pretrained model publicly available from the research community. The challenge is that niche languages do not have enough available resources, so there was no model available for Luxembourgish, until today.

Thanks to the collaboration between BGL BNP Paribas and SnT, and with the support of the Alphonse Weicker Foundation, an innovative approach to tackle the challenge of training models in low-resource languages has been created. The project, which was led on SnT’s side by Prof. Jacques Klein, developed the first model of its kind. LuxemBERT will fuel language-based AI systems around the country, making a significant contribution to its leadership in artificial intelligence and to the innovation ecosystem.

This is a key step in developing multilingual virtual assistants, which enhance customer experience by providing a quick answer to any request at any time. Using the power of artificial intelligence, the virtual assistant can understand the customer’s question and provide the most relevant answer.

“Creating solutions based on the most innovative technologies is key for our business, and we are proud to have contributed to the development of a Luxembourgish language model. This will no doubt have a positive impact on the country’s AI innovation ecosystem”, said Béatrice Belorgey, Chair of the BGL BNP Paribas Executive Committee and Country Head of the BNP Paribas Group in Luxembourg.”

“The result of FinTech innovations for individual customers is that most of their interactions with their banks now happen online, making a chatbot a vital resource for them to conduct their transactions. BGL BNP Paribas had the foresight to see the need for a Luxembourgish language model and brought this challenge to us because of our considerable experience with natural language processing,” says Prof. Björn Ottersten, director of SnT. “Now that LuxemBERT has been released publicly, other actors in the AI domain can begin building systems with it, and we look forward to being the academic stewards of this model as it grows in its usage.”