xAI has recently made its flagship AI chatbot, Grok-1, available to developers. This launch comes after the decision to make the model open source and follows a turbulent period for the company caused by a recent lawsuit. xAI is a startup AI company founded by Elon Musk.
“We are releasing the base model weights and network architecture of Grok-1, our large language model,”, the company stated on their official website. Grok-1 is a Mixture-of-Experts model with 314 billion parameters released under the Apache 2.0 license. The base model was trained from scratch using large amounts of text data. However, the data is not optimized for any particular application, according to xAI.
See Related: Elon Musk Decides To Open Source His AI Chatbot Amidst Ongoing Lawsuit Against OpenAI
The current version contains the raw base model checkpoint from the pre-training phase. This will allow developers to build on the base model and impact future modifications. Musk and his company hope the subsequent improvement will allow Grok-1 to compete with rivals such as OpenAI’s ChatGPT and Google’s Gemini.
In its initial stages of testing, experts say Grok-1 has been unable to stand out from the competition. xAI claimed that their AIl was a “Chatbot with a rebellious attitude”.
Grok-1 is available at https://github.com/xai-org/grok-1.