microsoft/phi-2
microsoft/phi-2
1
0
Overview Code Discussions Pull Requests Wiki Activity

Update README.md (#2)

Browse Source 
- Update README.md (93093db3a799f04d6d2a4850749bc5fd6b896781)


Co-authored-by: Mojan Javaheripi <mojanjp@users.noreply.huggingface.co>
This commit is contained in:
Gustavo de Rosa 2023-12-13 21:40:21 +00:00 committed by system
parent b800bab521
commit e22cfa2e09
1 changed files with 10 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

10
README.md
View File

@ -16,6 +16,16 @@ Our model hasn't been fine-tuned through reinforcement learning from human feedb
## Intended Uses
Below are example codes to load phi-2, we support two modes of execution for the model:
1. loading in fp-16 format with flash-attention support:
```python
model = AutoModelForCausalLM.from_pretrained('microsoft/phi-2', torch_dtype='auto', flash_attn=True, flash_rotary=True, fused_dense=True, trust_remote_code=True)
```
2. loading in fp-16 without flash-attention
```python
model = AutoModelForCausalLM.from_pretrained('microsoft/phi-2', torch_dtype='auto', trust_remote_code=True)
```
Phi-2 is intended for research purposes only. Given the nature of the training data, the phi-2 model is best suited for prompts using the QA format, the chat format, and the code format.
#### QA format: