Skip to content
Kitbay
Skill

music-to-video

AGPL-3.0Updated on Nov 16, 202681,782GitHub starsIncludes scripts

A skill from the OpenMontage repository that turns a music track, or the audio of a video, into a HyperFrames video cut to the beat.

What the skill teaches

A skill from the OpenMontage repository that turns a music track, or the audio of a video, into a HyperFrames video cut to the beat. A Python analyser reads the track once and writes a timing map; the agent then plans the frames, the user approves the plan, and one subagent builds each frame. The user's own images or clips are placed on the beat grid, and when there are none the video uses typography and templates. Rendering and checks go through the HyperFrames CLI and headless Chrome. Background music can come from HeyGen when the user is signed in, or from a local model offline. Node.js scripts validate the plan and assemble the result.

Capabilities

  • Analyse a track's beats into a timing map
  • Plan and build video frames on the beat
  • Cut the user's images and clips to the music
  • Render the video with the HyperFrames CLI