rhymes-ai/Allegro
rhymes-ai/Allegro
1
0
Overview Code Discussions Pull Requests Wiki Activity

Update README.md

Browse Source
This commit is contained in:
RhymesAI 2024-10-18 08:47:36 +00:00 committed by system
parent 41f1943a99
commit 2afcdf81aa
No known key found for this signature in database
GPG Key ID: 6A528E38E0733467
1 changed files with 48 additions and 15 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

63
README.md
View File

@ -21,22 +21,55 @@ Allegro is capable of producing high-quality, 6-second videos at 30 frames per s
# Model info
| **Model** | Allegro |
|-------------------------------|------------------------------------------------|
| **Description** | Text-to-Video Diffusion Transformer |
| **Download** | <HF link - TBD> |
| **Parameter** | VAE: 175M<br>DiT: 2.8B |
| **Inference Precision** | VAE: FP32/TF32/BF16/FP16 (best in FP32/TF32)<br>DiT/T5: BF16/FP32/TF32 |
| **Context Length** | 79.2k |
| **Resolution** | 720 x 1280 |
| **Frames** | 88 |
| **Video Length** | 6 seconds @ 15 fps |
| **Single GPU Memory Usage** | 9.3G BF16 (with cpu_offload) |
<table>
<tr>
<th>Model</th>
<td>Allegro</td>
</tr>
<tr>
<th>Description</th>
<td>Text-to-Video Diffusion Transformer</td>
</tr>
<tr>
<th>Download</th>
<td>&lt;HF link - TBD&gt;</td>
</tr>
<tr>
<th rowspan="2">Parameter</th>
<td>VAE: 175M</td>
</tr>
<tr>
<td>DiT: 2.8B</td>
</tr>
<tr>
<th rowspan="2">Inference Precision</th>
<td>VAE: FP32/TF32/BF16/FP16 (best in FP32/TF32)</td>
</tr>
<tr>
<td>DiT/T5: BF16/FP32/TF32</td>
</tr>
<tr>
<th>Context Length</th>
<td>79.2k</td>
</tr>
<tr>
<th>Resolution</th>
<td>720 x 1280</td>
</tr>
<tr>
<th>Frames</th>
<td>88</td>
</tr>
<tr>
<th>Video Length</th>
<td>6 seconds @ 15 fps</td>
</tr>
<tr>
<th>Single GPU Memory Usage</th>
<td>9.3G BF16 (with cpu_offload)</td>
</tr>
</table>
| Name | Parameter | Context Length | Download |
|-----------|-----------|-----------------|------------------------------------------------------------------|
| Allegro | 3B | 80K | [🤗 Hugging Face](https://huggingface.co/rhymes-ai/Allegro) |
| |
# Quick start