From 0a8f92a9a461c93e55592d60fcf73e21a159f709 Mon Sep 17 00:00:00 2001 From: Matthew Hayes Date: Wed, 12 Apr 2023 09:09:50 +0000 Subject: [PATCH] Update README.md Adjust table formatting --- README.md | 16 ++++++++-------- 1 file changed, 8 insertions(+), 8 deletions(-) diff --git a/README.md b/README.md index 6d82350..8eaf508 100644 --- a/README.md +++ b/README.md @@ -87,14 +87,14 @@ and in fact underperforms `dolly-v1-6b` in some evaluation benchmarks. We believ but a robust statement as to the sources of these variations requires further study. ``` -+----+------------------------------------+--------------+------------+--------------+-------------+-----------------+----------+----------+----------+ -| | model | openbookqa | arc_easy | winogrande | hellaswag | arc_challenge | piqa | boolq | gmean | -|----+------------------------------------+--------------+------------+--------------+-------------+-----------------+----------+----------+----------| -| 2 | EleutherAI/gpt-j-6B | 0.382 | 0.621633 | 0.651144 | 0.662617 | 0.363481 | 0.761153 | 0.655963 | 0.565936 | -| 3 | databricks/dolly-v2-12b | 0.408 | 0.63931 | 0.616417 | 0.707927 | 0.388225 | 0.757889 | 0.568196 | 0.56781 | -| 4 | databricks/dolly-v1-6b | 0.41 | 0.62963 | 0.643252 | 0.676758 | 0.384812 | 0.773667 | 0.687768 | 0.583431 | -| 6 | EleutherAI/gpt-neox-20b | 0.402 | 0.683923 | 0.656669 | 0.7142 | 0.408703 | 0.784004 | 0.695413 | 0.602236 | -+----+------------------------------------+--------------+------------+--------------+-------------+-----------------+----------+----------+----------+ ++------------------------------------+--------------+------------+--------------+-------------+-----------------+----------+----------+----------+ +| model | openbookqa | arc_easy | winogrande | hellaswag | arc_challenge | piqa | boolq | gmean | ++------------------------------------+--------------+------------+--------------+-------------+-----------------+----------+----------+----------| +| EleutherAI/gpt-j-6B | 0.382 | 0.621633 | 0.651144 | 0.662617 | 0.363481 | 0.761153 | 0.655963 | 0.565936 | +| databricks/dolly-v2-12b | 0.408 | 0.63931 | 0.616417 | 0.707927 | 0.388225 | 0.757889 | 0.568196 | 0.56781 | +| databricks/dolly-v1-6b | 0.41 | 0.62963 | 0.643252 | 0.676758 | 0.384812 | 0.773667 | 0.687768 | 0.583431 | +| EleutherAI/gpt-neox-20b | 0.402 | 0.683923 | 0.656669 | 0.7142 | 0.408703 | 0.784004 | 0.695413 | 0.602236 | ++------------------------------------+--------------+------------+--------------+-------------+-----------------+----------+----------+----------+ ``` # Happy Hacking! \ No newline at end of file