Add model type filters and update MCP server

Features Added:
- Model type filters: --t2i-only, --v2v-only, --v2i-only, --3d-only, --tts-only, --audio-only
- Enhanced model list table with new capability columns (V2V, V2I, 3D, TTS)
- Updated detect_model_type() to detect all model capabilities

MCP Server Updates:
- Added videogen_video_to_video tool for V2V style transfer
- Added videogen_apply_video_filter tool for video filters
- Added videogen_extract_frames tool for frame extraction
- Added videogen_create_collage tool for thumbnail grids
- Added videogen_upscale_video tool for AI upscaling
- Added videogen_convert_3d tool for 2D-to-3D conversion
- Added videogen_concat_videos tool for video concatenation
- Updated model list filter to support all new types

SKILL.md Updates:
- Added V2V, V2I, 3D to generation types table
- Added model filter examples
- Added 8 new use cases for V2V, filters, frames, collage, upscale, 3D, concat
parent e69c2d81
......@@ -13,6 +13,10 @@ VideoGen is a universal video generation toolkit that supports:
- **Image-to-Video (I2V)**: Animate static images
- **Text-to-Image (T2I)**: Generate images from text
- **Image-to-Image (I2I)**: Transform existing images
- **Video-to-Video (V2V)**: Style transfer and filters for videos
- **Video-to-Image (V2I)**: Extract frames and keyframes from videos
- **2D-to-3D Conversion**: Convert 2D videos to 3D SBS, anaglyph, or VR 360
- **Video Upscaling**: AI-powered video upscaling
- **Audio Generation**: TTS and music generation
- **Lip Sync**: Synchronize lip movements with audio
......@@ -64,6 +68,31 @@ python3 videogen --show-model <model_id_or_name>
| I2V | `--image_to_video --model i2v_model --prompt "..."` | Animate an image |
| T2I | `--model t2i_model --prompt "..." --output image.png` | Generate image |
| I2I | `--image-to-image --image input.png --prompt "..."` | Transform image |
| V2V | `--video input.mp4 --video-to-video --prompt "..."` | Style transfer on video |
| V2I | `--video input.mp4 --extract-keyframes` | Extract frames from video |
| 3D | `--video input.mp4 --convert-3d-sbs` | Convert 2D to 3D |
### Model Filters
```bash
# List models by type
python3 videogen --model-list --t2v-only # Text-to-Video models
python3 videogen --model-list --i2v-only # Image-to-Video models
python3 videogen --model-list --t2i-only # Text-to-Image models
python3 videogen --model-list --v2v-only # Video-to-Video models
python3 videogen --model-list --v2i-only # Video-to-Image models
python3 videogen --model-list --3d-only # 2D-to-3D models
python3 videogen --model-list --tts-only # TTS models
python3 videogen --model-list --audio-only # Audio models
# List by VRAM requirement
python3 videogen --model-list --low-vram # ≤16GB VRAM
python3 videogen --model-list --high-vram # >30GB VRAM
python3 videogen --model-list --huge-vram # >55GB VRAM
# List NSFW-friendly models
python3 videogen --model-list --nsfw-friendly
```
### Auto Mode
......@@ -144,6 +173,84 @@ python3 videogen --image_to_video --model svd_xt_1.1 \
--lip_sync --output speaker
```
### 8. Video-to-Video Style Transfer
```bash
# Apply style transfer to a video
python3 videogen --video input.mp4 --video-to-video \
--prompt "make it look like a watercolor painting" \
--v2v-strength 0.7 --output styled
```
### 9. Apply Video Filter
```bash
# Apply grayscale filter
python3 videogen --video input.mp4 --video-filter grayscale --output gray
# Apply slow motion
python3 videogen --video input.mp4 --video-filter slow \
--filter-params "factor=0.5" --output slowmo
# Apply blur
python3 videogen --video input.mp4 --video-filter blur \
--filter-params "radius=10" --output blurred
```
### 10. Extract Frames from Video
```bash
# Extract keyframes
python3 videogen --video input.mp4 --extract-keyframes --frames-dir keyframes
# Extract single frame at timestamp
python3 videogen --video input.mp4 --extract-frame --timestamp 5.5 --output frame.png
# Extract all frames
python3 videogen --video input.mp4 --extract-frames --v2v-max-frames 100 --frames-dir all_frames
```
### 11. Create Video Collage
```bash
# Create 4x4 thumbnail grid
python3 videogen --video input.mp4 --video-collage \
--collage-grid 4x4 --output collage.png
```
### 12. Upscale Video
```bash
# 2x upscale using ffmpeg
python3 videogen --video input.mp4 --upscale-video \
--upscale-factor 2.0 --output upscaled
# 4x upscale using AI (ESRGAN)
python3 videogen --video input.mp4 --upscale-video \
--upscale-factor 4.0 --upscale-method esrgan --output upscaled_4k
```
### 13. Convert 2D to 3D
```bash
# Convert to side-by-side 3D for VR
python3 videogen --video input.mp4 --convert-3d-sbs \
--depth-method ai --output 3d_sbs
# Convert to anaglyph 3D (red/cyan glasses)
python3 videogen --video input.mp4 --convert-3d-anaglyph --output anaglyph
# Convert to VR 360 format
python3 videogen --video input.mp4 --convert-vr --output vr360
```
### 14. Concatenate Videos
```bash
# Join multiple videos
python3 videogen --concat-videos video1.mp4 video2.mp4 video3.mp4 --output joined
```
---
## Model Selection Guide
......
This diff is collapsed.
This diff is collapsed.
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment