From 62ddeebf9b3c9f052ba5869563604c051909b128 Mon Sep 17 00:00:00 2001 From: Szymon Tworkowski Date: Sun, 17 Mar 2024 08:12:59 +0000 Subject: [PATCH] Upload RELEASE with huggingface_hub --- RELEASE | 21 +++++++++++++++++++++ 1 file changed, 21 insertions(+) create mode 100644 RELEASE diff --git a/RELEASE b/RELEASE new file mode 100644 index 0000000..c0ecab8 --- /dev/null +++ b/RELEASE @@ -0,0 +1,21 @@ + ╔══════════════════════════╗ + ║ _______ ║ + ║ /\ |_ _| ║ + ║ __ __ / \ | | ║ + ║ \ \/ / / /\ \ | | ║ + ║ > < / ____ \ _| |_ ║ + ║ /_/\_\/_/ \_\_____| ║ + ║ ║ + ║ Understand the Universe ║ + ╚══════════════════════════╝ + + ╔═══════════════════╗ + ║ xAI Grok-1 (314B) ║ + ╚═══════════════════╝ + +╔═════════════════════════════════════════╗ +║ 314B parameter Mixture of Experts model ║ +║ - Base model (not finetuned) ║ +║ - 8 experts (2 active) ║ +║ - 86B active parameters ║ +╚═════════════════════════════════════════╝