rhymes-ai/Allegro
rhymes-ai/Allegro
1
0
Overview Code Discussions Pull Requests Wiki Activity

Update README.md

Browse Source
This commit is contained in:
RhymesAI 2024-10-21 09:59:49 +00:00 committed by system
parent 8da6f5e65f
commit 08938492e7
No known key found for this signature in database
GPG Key ID: 6A528E38E0733467
1 changed files with 16 additions and 15 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

29
README.md
View File

@ -66,7 +66,7 @@ library_name: diffusers
</tr> </tr>
<tr> <tr>
<th>Video Length</th> <th>Video Length</th>
<td>6 seconds @ 15 fps</td> <td>6 seconds @ 15 FPS</td>
</tr> </tr>
<tr> <tr>
<th>Single GPU Memory Usage</th> <th>Single GPU Memory Usage</th>
@ -80,19 +80,20 @@ library_name: diffusers
2. Install the necessary requirements. 2. Install the necessary requirements.
a. Ensure Python >= 3.10, PyTorch >= 2.4, CUDA >= 12.4. For details, see [requirements.txt](https://github.com/rhymes-ai/Allegro/blob/main/requirements.txt). a. Ensure Python >= 3.10, PyTorch >= 2.4, CUDA >= 12.4. For details, see [requirements.txt](https://github.com/rhymes-ai/Allegro/blob/main/requirements.txt).
b. It is recommended to use Anaconda to create a new environment (Python >= 3.10) to run the following example. b. It is recommended to use Anaconda to create a new environment (Python >= 3.10) to run the following example.
3. Download the [Allegro model weights](https://huggingface.co/rhymes-ai/Allegro). 4. Download the [Allegro model weights](https://huggingface.co/rhymes-ai/Allegro).
4. Run inference. 5. Run inference.
```python
python single_inference.py \ ```python
--user_prompt 'A seaside harbor with bright sunlight and sparkling seawater, with many boats in the water. From an aerial view, the boats vary in size and color, some moving and some stationary. Fishing boats in the water suggest that this location might be a popular spot for docking fishing boats.' \ python single_inference.py \
--vae your/path/to/vae \ --user_prompt 'A seaside harbor with bright sunlight and sparkling seawater, with many boats in the water. From an aerial view, the boats vary in size and color, some moving and some stationary. Fishing boats in the water suggest that this location might be a popular spot for docking fishing boats.' \
--dit your/path/to/transformer \ --vae your/path/to/vae \
--text_encoder your/path/to/text_encoder \ --dit your/path/to/transformer \
--tokenizer your/path/to/tokenizer \ --text_encoder your/path/to/text_encoder \
--guidance_scale 7.5 \ --tokenizer your/path/to/tokenizer \
--num_sampling_steps 100 \ --guidance_scale 7.5 \
--seed 42 --num_sampling_steps 100 \
``` --seed 42
```
# License # License
This repo is released under the Apache 2.0 License. This repo is released under the Apache 2.0 License.