diff --git a/RELEASE b/RELEASE new file mode 100644 index 0000000..c0ecab8 --- /dev/null +++ b/RELEASE @@ -0,0 +1,21 @@ + ╔══════════════════════════╗ + ║ _______ ║ + ║ /\ |_ _| ║ + ║ __ __ / \ | | ║ + ║ \ \/ / / /\ \ | | ║ + ║ > < / ____ \ _| |_ ║ + ║ /_/\_\/_/ \_\_____| ║ + ║ ║ + ║ Understand the Universe ║ + ╚══════════════════════════╝ + + ╔═══════════════════╗ + ║ xAI Grok-1 (314B) ║ + ╚═══════════════════╝ + +╔═════════════════════════════════════════╗ +║ 314B parameter Mixture of Experts model ║ +║ - Base model (not finetuned) ║ +║ - 8 experts (2 active) ║ +║ - 86B active parameters ║ +╚═════════════════════════════════════════╝