Open-Sora/opensora/models/vae
Shen-Chenhui 60eaffed4a debug
2024-04-04 15:11:42 +08:00
..
__init__.py added vae3d training code 2024-03-28 15:12:20 +08:00
discriminator_3d.py finish discriminator arch 2024-04-03 10:29:01 +08:00
lpips.py debug 2024-04-02 11:21:01 +08:00
model_utils.py add inference config 2024-04-04 14:11:25 +08:00
README.md debug 2024-04-04 15:11:42 +08:00
vae.py merge mask-related utils 2024-03-23 16:32:51 +08:00
vae_3d.py finish discriminator arch 2024-04-03 10:29:01 +08:00

Commands

1. Train

# train on pexel dataset
WANDB_API_KEY=<wandb_api_key> CUDA_VISIBLE_DEVICES=<n> torchrun --master_port=<port_num> --nnodes=1 --nproc_per_node=1 scripts/train-vae.py configs/vae_3d/train/16x256x256.py --data-path /home/shenchenhui/data/pexels/train.csv --wandb True

2. Inference

CUDA_VISIBLE_DEVICES=<n> torchrun --standalone --nnodes=1 --nproc_per_node=1 scripts/inference-vae.py configs/vae_3d/inference/16x256x256.py --ckpt-path /home/shenchenhui/Open-Sora-dev/outputs/028-F16S3-VAE_3D/epoch3-global_step20000/vae --vae-only True --data-path /home/shenchenhui/data/pexels/test.csv