xAI, Elon Musk创建的AI 公司。

?W?E?I?G?H?T?S?I?N?B?I?O?

— Grok (@grok) March 17, 2024

“We are releasing the base model weights and network architecture of Grok-1, our large language model,” xAI writes in the post. “Grok-1 is a 314 billion parameter Mixture-of-Experts model trained from scratch by xAI.”

“This is the raw base model checkpoint from the Grok-1 pre-training phase, which concluded in October 2023,” xAI adds. “This means that the model is not fine-tuned for any specific application, such as dialogue.”

“We are releasing the weights and the architecture under the Apache 2.0 license.”

-----------------------------------------------------------

We are releasing the weights and architecture of our 314 billion parameter Mixture-of-Experts model, Grok-1.

https://x.ai/blog/grok-os