2024-03-17 05:47:21 +00:00
|
|
|
---
|
|
|
|
|
license: apache-2.0
|
|
|
|
|
---
|
2024-03-17 05:49:40 +00:00
|
|
|
# Grok-1
|
|
|
|
|
|
2024-03-17 06:13:36 +00:00
|
|
|
This repository contains the weights of the Grok-1 open-weights model.
|
2024-03-17 05:49:40 +00:00
|
|
|
|
|
|
|
|
Make sure to download the `int8` checkpoint to the `checkpoints` directory and run
|
|
|
|
|
|
|
|
|
|
```shell
|
|
|
|
|
pip install -r requirements.txt
|
|
|
|
|
python transformer.py
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
to test the code.
|
|
|
|
|
|
|
|
|
|
You should be seeing output from the language model.
|
|
|
|
|
|
|
|
|
|
Due to the large size of the model (314B parameters), a multi-GPU machine is required to test the model with the example code.
|
2024-03-17 21:48:09 +00:00
|
|
|
|
2024-03-18 02:47:23 +00:00
|
|
|
p.s. we're hiring: https://x.ai/careers
|
