nicolabs/Open-Sora
1
0
Fork 0
mirror of https://github.com/hpcaitech/Open-Sora.git synced 2026-05-21 11:59:01 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions 1

Update acceleration.md (#127)

Browse source
This commit is contained in:
Yanjia0 2024-03-19 13:11:02 +08:00 committed by GitHub
parent 51e1eb3430
commit d0bd2358d8
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
docs/acceleration.md
View file

@ -6,7 +6,7 @@ Open-Sora aims to provide a high-speed training framework for diffusion models.
Open-Sora boosts the training speed by:
- Kernal optimization including [flash attention](https://github.com/Dao-AILab/flash-attention), fused layernorm kernal, and the ones compiled by colossalAI.
- Kernel optimization including [flash attention](https://github.com/Dao-AILab/flash-attention), fused layernorm kernal, and the ones compiled by colossalAI.
- Hybrid parallelism including ZeRO.
- Gradient checkpointing for larger batch size.