Grok is a new generation of AI assistant launched by Elon Musk's xAI. Its biggest feature is to obtain X (Twitter) data in real time through the Internet, provide the latest information, and have a humorous and personalized conversation style. Its main users include X platform users, content creators, developers and corporate users. Although it is currently limited to the X ecosystem, it may be expanded to Tesla, SpaceX and even a wider range of AI application scenarios in the future.
Software functions
[Intelligent dialogue] Provides a smooth conversation experience and answers various questions.
[Deep search] Search the entire network and grasp information in real time.
[Logical reasoning] Solve complex problems and provide detailed answers.
[Creative writing] Automatically generate creative copywriting and write various articles and reports.
[Code writing] Supports multiple programming languages and generates code quickly.
Software Features
1. Based on a large amount of text data training, not fine-tuned for any specific task
2. 314 billion parameter MoE model, activation weight 25%
3. Tokenizer vocabulary size 131,072, embedding size 6,144
4. 64-layer Transformer, each decoder layer contains multi-head attention blocks and dense blocks
Software Highlights
1. Multi-head attention: 48-head query, 8-head key/value, key value size 128
2. Dense block: widening factor 8, hidden layer size 32768
3. Each token selects 2 from 8 experts
4. Context length 8192 tokens, precision bf16
Change log
Introducing Grok Android Beta with Grok 3
Google login improvements
Fixed top 5 crashes, resoled app not responding errors
Settings now has theme options