Search the whole AI landscape.

2B-parameter open-weights video-language model that writes scene descriptions and timestamped event captions.

Google DeepMind research model that transcribes sign language from video into text captions.

PE

PerceptionDLM

Model · ByteDance

1

Diffusion-based vision-language model from PKU MSALab and ByteDance that captions multiple image regions in parallel.

MO

Mobius

Model

1

Unified motion-language model for text-to-motion, motion captioning, completion and editing, from HKUST and Tencent Games.

HO

Homie

Model

1

Reference-to-video model from HKUST for personalizing videos with multiple people and objects.

VI

VideoMDM

Research

1

Diffusion framework that learns text-to-3D human motion generation from 2D poses extracted from monocular videos.

GV

Gemini video understanding

Model · Google

1

Gemini API capability for analyzing video input, including visual and audio content, with text output.

GO

Gemini Omni 1.2 Flash

Model · Google

3

Google's video generation model producing clips up to 15 seconds from text, image, video or audio input.

KL

Kling

Model · Kuaishou

1

Kuaishou's AI video and image generation model family, offered via the Kling AI web studio and API.

SH

ShotPlan

Model

1

Research method for multi-shot text-to-video with frame-accurate cuts, fades and camera moves, built on Wan2.1-T2V-14B.