Open-Orca/OpenOrca
Open-Orca/OpenOrca
1
0
Overview Code Discussions Pull Requests Wiki Activity

Update README.md

Browse Source
This commit is contained in:
Bleys 2023-06-29 19:15:08 +00:00 committed by huggingface-web
parent 1e8a5032c5
commit 378ac6e247
1 changed files with 21 additions and 25 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

42
README.md
View File

@ -37,44 +37,40 @@ Dataset Use
Use Cases Use Cases
Usage Caveats Usage Caveats
Getting Started Getting Started
<a name="credit where credit is due"></a> <a name="credit where credit is due"></a>
the Orca paper has been replicated to as fine of a degree of precision as several obsessive nerds sweating for weeks could pull off(a very high degree)
We will be releasing Orca's as the models continue to be trained The Orca paper has been replicated to as fine of a degree of precision as several obsessive nerds sweating for weeks could pull off (a very high degree)
And the dataset after we wipe off all the sweat and tears. We will be releasing Orcas as the models continue to be trained and the dataset after we wipe off all the sweat and tears.
Right now, we're testing our fifth iteration of orca on a subset of the final data, and are just about to jump into the final stages! Right now, we're testing our fifth iteration of orca on a subset of the final data, and are just about to jump into the final stages!
Thanks to Thanks to the
the
Team: Team:
winglian
erhartford
winglian Nanobit
@erhartford
Nanobit
Pankajmathur Pankajmathur
http://AlignmentLab.ai: http://AlignmentLab.ai:
Entropi Autometa
AtlasUnified Entropi
NeverendingToast AtlasUnified
Autometa NeverendingToast
And of course, as always TheBloke, for being the backbone of the whole community. Also of course, as always, TheBloke, for being the backbone of the whole community.
Be sure to check out Axolotl on github, developed by Nano and Winglian, the platform that developed and trained manticore, minotaur, and many others! Be sure to check out Axolotl on github, developed by Nano and Winglian, the platform that developed and trained manticore, minotaur, and many others!
OrcaMini on huggingface! Other team projects on huggingface:
OrcaMini
Samantha, WizardVicuna, and more! Samantha
WizardVicuna, and more!
and maybe even one of our projects at: http://Alignmentlab.ai https://discord.gg/n9hXaBPWxx and maybe even one of our projects at: http://Alignmentlab.ai https://discord.gg/n9hXaBPWxx
we are looking for sponsors or collaborators to help us build these models to the scale they deserve, my 3090 wont quite cut i this time, i think. We are looking for sponsors or collaborators to help us build these models to the scale they deserve; stacks of 3090s wont quite cut it this time, we think.
not for Falcon 40b, it wont ! Not for Falcon 40b, it won't!
Dataset Summary Dataset Summary
The Open Orca dataset is a collection of unaugmented and augmented FLAN data. It is tabularized in alignment with the distributions presented in the ORCA paper and currently represents a partial completion of the full intended dataset, with ongoing generation to expand its scope. The data is primarily used for training and evaluation in the field of natural language processing. The Open Orca dataset is a collection of unaugmented and augmented FLAN data. It is tabularized in alignment with the distributions presented in the ORCA paper and currently represents a partial completion of the full intended dataset, with ongoing generation to expand its scope. The data is primarily used for training and evaluation in the field of natural language processing.