今日凌晨,马斯克旗下人工智能公司xAI宣布,正式开放其开发的大语言模型Grok-1。该模型拥有3140亿参数,是目前公开源代码中规模最大的AI模型之一。Grok-1采用混合专家架构(MoE),其激活权重为25%,基于大量文本数据进行训练,未针对特定任务进行微调。xAI承诺遵守Apache 2.0许可证,公开Grok-1的权重和架构。此举显示了xAI在推动AI技术发展和社区共享上的积极态度。

英文标题:Musk’s xAI Releases Open Source Grok-1 with 31.4B Parameters

英文关键词:AI model, open source, parameters

英文新闻内容:
Early this morning, Musk’s artificial intelligence company, xAI, announced the official release of Grok-1, a large language model with 31.4 billion parameters. Grok-1, which employs a Mixture of Experts (MoE) architecture and has an activation weight of 25%, has been trained on a vast amount of text data without being fine-tuned for any specific task. xAI has committed to an Apache 2.0 license, making the weight and architecture of Grok-1 publicly available, showcasing xAI’s positive stance on advancing AI technology and community sharing.

【来源】https://mp.weixin.qq.com/s/hvt5zwoazDx26KOaKuTs_w

Views: 2

发表回复

您的邮箱地址不会被公开。 必填项已用 * 标注