grok-1/README.md
Szymon Tworkowski 638171f5e0
Update README.md
2024-03-17 06:13:36 +00:00

462 B

license
apache-2.0

Grok-1

This repository contains the weights of the Grok-1 open-weights model.

Make sure to download the int8 checkpoint to the checkpoints directory and run

pip install -r requirements.txt
python transformer.py

to test the code.

You should be seeing output from the language model.

Due to the large size of the model (314B parameters), a multi-GPU machine is required to test the model with the example code.