The Technology Innovation Institute (TII), a government-funded research establishment based in Abu Dhabi, has recently revealed the latest iteration of their large language model (LLM) series, called Falcon 180B. This new and improved AI model can outperform most open-source LLMs and even rivals the LLMs made by industry giants such as Google and Meta, according to various reports.
TII has released the Falcon 180B on Hugging Face and has quickly reached the top of its performance list for LLMs. According to the company’s blog post, this model has been trained on 3.5 million tokens and has 180 billion parameters, thus making it one of the most powerful open-source language models out there.
“This model performs exceptionally well in various tasks like reasoning, coding, proficiency, and knowledge tests, even beating competitors like Meta’s LLaMA 2. Among closed source models, it ranks just behind OpenAI’s GPT 4, and performs on par with Google’s PaLM 2 Large, which powers Bard, despite being half the size of the model.”, the company stated in their blog post.
Falcon 180B is currently available on Hugging Face for both commercial and research use. The model is compatible with many languages including English, German, Spanish, French, and Italian.