Skip to content
Kitbay
Skill

video-understand

AGPL-3.0Updated on Nov 9, 202679,567GitHub starsIncludes scriptsNo API key needed

A skill kept in the OpenMontage repository that lets an agent look into a video file offline, with no API keys.

What the skill teaches

A skill kept in the OpenMontage repository that lets an agent look into a video file offline, with no API keys. A bundled Python script uses ffmpeg and ffprobe to pull frames, either at scene changes (the default, falling back to even spacing), at keyframes or at regular intervals up to a set limit, and can transcribe the sound track with the optional openai-whisper package in a chosen model size. It prints JSON with the video's details, frame paths and timestamps, and transcript segments, and the agent then opens the frame images to see them. ffmpeg must be installed; transcription can be turned off.

Capabilities

  • Extract frames at scene changes or intervals
  • Transcribe a video's audio locally with Whisper
  • Output video details and frames as JSON