Upload RELEASE with huggingface_hub

This commit is contained in:
Szymon Tworkowski 2024-03-17 08:12:59 +00:00 committed by system
parent 638171f5e0
commit 62ddeebf9b
No known key found for this signature in database
GPG Key ID: 6A528E38E0733467

21
RELEASE Normal file

@ -0,0 +1,21 @@
╔══════════════════════════╗
║ _______ ║
║ /\ |_ _| ║
║ __ __ / \ | | ║
║ \ \/ / / /\ \ | | ║
║ > < / ____ \ _| |_ ║
║ /_/\_\/_/ \_\_____| ║
║ ║
║ Understand the Universe ║
╚══════════════════════════╝
╔═══════════════════╗
║ xAI Grok-1 (314B) ║
╚═══════════════════╝
╔═════════════════════════════════════════╗
║ 314B parameter Mixture of Experts model ║
║ - Base model (not finetuned) ║
║ - 8 experts (2 active) ║
║ - 86B active parameters ║
╚═════════════════════════════════════════╝