tiiuae/falcon-40b
tiiuae/falcon-40b
1
0
Overview Code Discussions Pull Requests Wiki Activity

corrected a typo (#5)

Browse Source 
- corrected a typo (77fc53d7cef8458c3881219f7a641b3cb9b22d22)


Co-authored-by: Ilyas Moutawwakil <IlyasMoutawwakil@users.noreply.huggingface.co>
This commit is contained in:
Falcon LLM TII UAE 2023-05-30 06:56:44 +00:00 committed by system
parent e49c179d8d
commit c63a64ac7c
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@ -131,7 +131,7 @@ Falcon-40B was trained on 1,000B tokens of [RefinedWeb](https://huggingface.co/d
| **Data source** | **Fraction** | **Tokens** | **Sources** | | **Data source** | **Fraction** | **Tokens** | **Sources** |
|--------------------|--------------|------------|-----------------------------------| |--------------------|--------------|------------|-----------------------------------|
| [RefinedWeb-English](https://huggingface.co/datasets/tiiuae/falcon-refinedweb) | 75% | 750B | massive web crawl | | [RefinedWeb-English](https://huggingface.co/datasets/tiiuae/falcon-refinedweb) | 75% | 750B | massive web crawl |
| RefinedWeb-Europe | 7% | 70B | European massive zeb crawl | | RefinedWeb-Europe | 7% | 70B | European massive web crawl |
| Books | 6% | 60B | | | Books | 6% | 60B | |
| Conversations | 5% | 50B | Reddit, StackOverflow, HackerNews | | Conversations | 5% | 50B | Reddit, StackOverflow, HackerNews |
| Code | 5% | 50B | | | Code | 5% | 50B | |