Make videos searchable with description, tags, and speech

Index video content with descriptions, tags, and speech-to-text to enable fast searching and discovery.

by Paul Anthony Williams

The Workflow

Overview

This workflow generates a description (with tags), transcribes speech, and uses a prompt to generate a domain-specific set of keywords.

We can save this intelligence data to our database, and use it to populate our search indexes.

Build Workflow

A workflow is an array of task definitions that describe what should happen and in what order.

Tasks in the array run in parallel. You can also chain tasks together in sequences using the next property.

Create Task

We create a new task with the kind: "workflow".

The workflow property contains our workflow steps as defined above.

const task = await ittybit.tasks.create({
  url: "https://example.com/your-video.mp4",
  kind: "workflow",
  workflow: workflow
})

Handle Webhook

Your webhook handler should parse the File Object payloads and save the data in your database.

Paul Anthony Williams

Paul Anthony Williams is a software engineer and entrepreneur. He's a founder at Ittybit, he used to work with some of the world's biggest creators, and he appeared in Game of Thrones right before it went downhill (probably not his fault).