- Silo AI, in collaboration with TurkuNLP and HPLT, releases Viking 7B, a multilingual large language model (LLM) for Nordic languages.
- Viking 7B demonstrates exceptional performance in Nordic languages while maintaining proficiency in English and programming languages.
- The model prioritizes inclusivity and cultural sensitivity, challenging biases inherent in existing language models.
- Training approach akin to Poro, Viking 7B expands to include Danish, Finnish, Norwegian, Icelandic, Swedish, and programming languages.
- Utilizes EuroHPC supercomputer LUMI for sustainable and efficient AI development.
- Offers customizable AI building blocks for tailored solutions, empowering organizations to integrate and own AI models.
Main AI News:
In today’s rapidly evolving technological landscape, the demand for inclusive language models is on the rise. Silo AI, Europe’s premier private AI lab, in collaboration with the University of Turku’s esteemed research group TurkuNLP and HPLT, proudly introduces the pioneering multilingual large language model (LLM) tailored for all Nordic languages. This groundbreaking release not only encompasses the Nordic languages but also includes English and various programming languages, positioning itself as a versatile solution for diverse linguistic needs. Evaluations have demonstrated its unparalleled performance across Nordic languages while maintaining excellence in English proficiency, setting a new standard in linguistic inclusivity.
In a recent conversation with Silo AI’s CEO and co-founder, Peter Sarlin, we gained valuable insights into the significance of Viking 7B in the realm of language technology. Sarlin highlighted Viking 7B as a pivotal achievement in the pursuit of state-of-the-art LLMs for European languages, addressing the inherent biases stemming from the overrepresentation of English in existing models. By prioritizing the inclusion of low-resource languages and ensuring linguistic and cultural accuracy, Silo AI reaffirms its commitment to fostering a more representative digital landscape.
Drawing inspiration from the successful training approach utilized in Poro, Viking adopts a similar strategy while expanding its scope to encompass Danish, Finnish, Norwegian, Icelandic, Swedish, and programming languages. Sarlin emphasized the meticulous process of acquiring and processing high-quality data for these languages, along with innovative techniques such as cross-training to enhance performance in low-resource settings. This holistic approach not only mitigates the “curse of multilinguality” but also lays the foundation for unbiased and culturally sensitive language models.
Viking 7B’s significance extends beyond technological advancements; it symbolizes Silo AI’s dedication to Europe’s digital sovereignty. By leveraging cutting-edge infrastructure, including the EuroHPC supercomputer LUMI, Viking 7B embodies a sustainable approach to AI development. Sarlin reiterated the importance of aligning digital innovation with European values, emphasizing the role of technology as a unifying force in the digital age.
Furthermore, Viking’s training on the energy-efficient LUMI supercomputer underscores its commitment to environmental sustainability. As Europe’s most powerful supercomputer, LUMI sets a precedent for green computing, harnessing hydroelectric power to minimize its carbon footprint. By utilizing renewable energy and repurposing waste heat for district heating, LUMI exemplifies the fusion of technological advancement and environmental stewardship.
In assessing Viking’s performance, Silo AI highlights its competitive edge over existing models, particularly in low-resource language settings. By offering customizable AI building blocks, Silo AI empowers organizations to tailor solutions that address specific needs effectively. Sarlin emphasized the importance of customization in maximizing the utility of AI models, underscoring Silo AI’s commitment to facilitating seamless integration and ownership of AI solutions.
Conclusion:
Silo AI’s Viking 7B marks a significant advancement in language technology, addressing the linguistic biases prevalent in existing models and promoting inclusivity across diverse languages and cultures. This innovation not only enhances the accessibility of AI-driven solutions but also underscores the importance of cultural sensitivity and digital sovereignty in the global market. Businesses that leverage Viking 7B stand to gain a competitive edge in delivering inclusive and culturally resonant products and services, thereby driving market growth and fostering deeper societal connections.
