Tools

Video to JSON API

Submit any video file. Get back a transcript with timestamps, duration, dimensions, and metadata as structured JSON.

Try it below:

FILEDrop a file or click to upload

Production-ready

Private by design

Security-first

Scalable

Production-ready

Private by design

Security-first

Scalable

Production-ready

Private by design

Security-first

Scalable

Turn video files into structured JSON

Upload a video file or submit a URL, get structured JSON back.

{
  "kind": "video",
  "name": "",
  "url": null,
  "state": "completed",
  "createdAt": "2026-07-19T12:44:28.139Z",
  "extraction": {
    "common": {
      "mimeType": "video/quicktime",
      "size": 46478097,
      "caption": "This video is an advertisement introducing Fabric CLI, a command-line interface for the Fabric platform. It demonstrates key features such as creating notes, querying a Fabric AI assistant for information from a personal library or the web, and managing tasks with set priorities. Users can also search their Fabric library using natural language directly from the terminal. The video showcases a dark-themed terminal interface with highlighted commands, set to upbeat electronic music and narrated by a clear female voice.",
      "keywords": [
        "ai",
        "terminal",
        "promo",
        "software",
        "advertisement",
        "utility",
        "automation",
        "cli",
        "commercial",
        "video"
      ],
      "thumbnail": "https://cdn.exabase.io/workspace/fd9cc776-caa4-4c8e-a279-c71497d13eb1/processing/8e4f6389-7d8f-493c-8d5e-66ea2df61d30/thumbnail.jpg?token=uPFNmvHx-cZ7I8ENIVn2UPsct0OYqU_Tc0UHWj3Lb5c&expires=1785067200",
      "chunkCount": 2
    },
    "media": {
      "width": 1920,
      "height": 1080,
      "duration": 52.466667,
      "codec": "h264",
      "bitRate": 6893011,
      "frameRate": 30,
      "sampleRate": 44100,
      "channels": "stereo",
      "color": {
        "profile": "Rec. 709 (BT.709 (SDR), BT.709)",
        "space": "bt709",
        "pixelFormat": "yuv420p"
      },
      "location": {
        "latitude": null,
        "longitude": null
      },
      "transcript": {
        "url": "https://cdn.exabase.io/workspace/fd9cc776-caa4-4c8e-a279-c71497d13eb1/processing/8e4f6389-7d8f-493c-8d5e-66ea2df61d30/transcript.vtt?token=a7eYNJ-Y4uW6iVVTAuBj3P-I_6A82aEC4upil_GR_fs&expires=1785067200"
      }
    }
  }
}

Start for free

Read the docs

What is Exabase's video to JSON API?

Submit a video file to the Exabase Extract API and get structured JSON back. The response includes a full transcript with timestamps, video duration, frame dimensions, MIME type, file size, a CDN-hosted thumbnail, and the transcript text split into searchable chunks. MP4, MOV, AVI, WebM, MKV, and other major formats are supported.

The same POST /v2/extract endpoint accepts both file uploads and URLs pointing to hosted video. Transcription, metadata extraction, and chunking happen on Exabase's infrastructure. No FFmpeg, no speech-to-text model, no GPU provisioning on your end.

What you get back

The response includes video duration, frame dimensions (width and height), a full transcript, and the transcript split into chunks. Each chunk carries timeStart and timeEnd in seconds, so you can map any piece of text back to the exact moment in the video. You also get MIME type, file size, total chunk count, and a CDN-hosted thumbnail. The API reference has the complete response schema.

One multi-modal API

The same POST /v2/extract endpoint handles every content type Exabase supports. For video, it transcribes the audio track and returns timestamped chunks alongside frame dimensions. For audio, it does the same without the visual metadata. For PDFs, it returns page count, author, title, and (for recognised document types like invoices, contracts, and resumes) structured field extraction. For images, it runs OCR. For web pages, it renders JavaScript and extracts the content.

The submission flow is identical across all types: one endpoint, one SDK method, one webhook configuration. You learn the pattern once and use it for everything. The Extract docs cover each content type in detail.

What you can build with it

The timestamped chunks are the same format used across the Exabase platform. Feed them into a RAG pipeline so your agent can cite the exact moment in a video. Build searchable video libraries where users find the right clip without scrubbing through hours of footage. Process training videos and make every lesson searchable by topic. Index webinar recordings so participants can find what was said and when.

Store transcribed video as Resources in a Base and the content becomes searchable through Deep Search at the chunk level. Workers can re-extract updated recordings on a schedule, keeping your video index current without manual work.

Beyond transcription

The Extract API returns more than a transcript. You get structured metadata, frame dimensions, a CDN-hosted thumbnail, and chunks you can index directly.

Store the output as a Resource and it's searchable through Deep Search immediately. Extract key facts from the transcript into Memory so your agent retains what it saw between sessions.

The Submitting Jobs guide at https://exabase.io/docs/developer-guide/extraction/submitting-jobs walks through the full flow.

Start for free

Read the docs

How do I use it?

  1. Get your API key

Free, no credit card:

Sign up at exabase.io and copy your API key from the dashboard.

  1. Submit a video file

Using the SDK (Node.js):

import { Exabase } from "@exabase/sdk";
import { createReadStream } from "fs";

const api = new Exabase({
  apiKey: process.env.EXABASE_API_KEY,
});

const job = await api.extract.createFromFile({
  file: createReadStream("./product-demo.mp4"),
  name: "Product demo — Q3 2026",
});

console.log(job.id);    // extraction job id
console.log(job.state); // "pending"

  1. Get the result

Poll the job until state reaches completed, or skip polling entirely with webhooks.

const result = await api.extract.get({ jobId: job.id });

if (result.state === "completed") {
  console.log(result.extraction?.media?.duration);
  console.log(result.extraction?.media?.width);
  console.log(result.extraction?.media?.height);
  console.log(result.extraction?.media?.transcript);
  console.log(result.extraction?.common?.chunkCount);
  console.log(result.extraction?.common?.thumbnail);
}

One API call. No FFmpeg, no speech-to-text model, no GPU.

What you get back

Field

Type

Description

state

string

completed or failed

kind

string

video

extraction.common.mimeType

string

Detected MIME type (e.g. video/mp4)

extraction.common.size

number

File size in bytes

extraction.common.thumbnail

string

CDN-hosted thumbnail URL

extraction.common.chunkCount

number

Number of transcript chunks

extraction.media.duration

number

Duration in seconds

extraction.media.width

number

Frame width in pixels

extraction.media.height

number

Frame height in pixels

extraction.media.transcript

string

Full transcript text

Transcript chunks are retrieved separately via GET /v2/extract/{jobId}/chunks.

Each chunk includes timeStart and timeEnd in seconds alongside the transcript text.

API quick reference

Endpoint

Method

Description

/v2/extract

POST

Submit extraction job

/v2/extract

GET

List extraction jobs

/v2/extract/{jobId}

GET

Poll for result

/v2/extract/{jobId}/chunks

GET

Fetch transcript chunks

/v2/extract-settings

PUT

Configure webhook

Auth: X-Api-Key header on all requests.

File retention: Stored files are retained for 1 day from job creation. Download or copy anything you need before they expire.

Need file extraction or full page content?

Exabase offers a full set of tools to extract content from any media, document or website.

All your data extraction needs in one place.

Learn about Exabase Extract →

Why Exabase

Timestamps on every chunk

Transcript text is split into chunks, each with a start and end time in seconds. Build seek-to-source UIs, generate subtitles, or link citations directly to the right moment in the footage.

Timestamps on every chunk

Transcript text is split into chunks, each with a start and end time in seconds. Build seek-to-source UIs, generate subtitles, or link citations directly to the right moment in the footage.

Text as searchable chunks

Extracted text is split into structured chunks with page numbers. Build search, feed chunks into RAG pipelines, or index them directly. Not a single giant text blob.

Text as searchable chunks

Extracted text is split into structured chunks with page numbers. Build search, feed chunks into RAG pipelines, or index them directly. Not a single giant text blob.

No infrastructure to manage

Transcription and metadata extraction run on Exabase's infrastructure. No FFmpeg installation, no Whisper deployment, no GPU provisioning, no model version management. Submit a file, get JSON back.

No infrastructure to manage

Transcription and metadata extraction run on Exabase's infrastructure. No FFmpeg installation, no Whisper deployment, no GPU provisioning, no model version management. Submit a file, get JSON back.

Async processing that scales

Submit large video files and move on. Poll for results or set up webhooks and process completions as they arrive. No timeouts, no file-size bottlenecks.

Async processing that scales

Submit large video files and move on. Poll for results or set up webhooks and process completions as they arrive. No timeouts, no file-size bottlenecks.

One API for everything

The same POST /v2/extract endpoint handles video, audio, PDFs, images, and web pages. The response structure adapts to the content type. Learn one API, extract from anything.

One API for everything

The same POST /v2/extract endpoint handles video, audio, PDFs, images, and web pages. The response structure adapts to the content type. Learn one API, extract from anything.

Webhooks with delivery logs

No need to poll. Configure a webhook URL and get notified on completion. Every delivery attempt is logged with status codes and response bodies. You can manually re-trigger a webhook if your server missed it.

Webhooks with delivery logs

No need to poll. Configure a webhook URL and get notified on completion. Every delivery attempt is logged with status codes and response bodies. You can manually re-trigger a webhook if your server missed it.

Reprocess without re-uploading

If a job fails, call the reprocess endpoint. The API retries using the original file without requiring a new upload. Useful for large files where re-uploading is costly.

Reprocess without re-uploading

If a job fails, call the reprocess endpoint. The API retries using the original file without requiring a new upload. Useful for large files where re-uploading is costly.

Same account for full platform access

Video extraction is one endpoint. The same Exabase account gives you Memory, Deep Search, Resources, and Workers. Same API key, different endpoints.

Same account for full platform access

Video extraction is one endpoint. The same Exabase account gives you Memory, Deep Search, Resources, and Workers. Same API key, different endpoints.

Not just extraction

Extracted content can feed directly into the rest of the Exabase platform. Store it as a searchable Resource, index it with Deep Search, keep it current with Workers. Extract is one part of a complete data layer for agents.

Not just extraction

Extracted content can feed directly into the rest of the Exabase platform. Store it as a searchable Resource, index it with Deep Search, keep it current with Workers. Extract is one part of a complete data layer for agents.

Comparisons

vs Twelve Labs

Twelve Labs is a video understanding platform with search, classification, and generation features built around visual and spoken content. If you need frame-level visual analysis, that's their territory. If you need transcription and metadata extraction as part of a broader data layer (storage, search, memory, automation), Exabase handles the extraction and gives you the rest of the platform alongside it.

vs Mux

Mux is video infrastructure for hosting, streaming, and analytics. Exabase is not a video hosting platform. It extracts structured data from video files: transcripts, timestamps, metadata, thumbnails. If you need to serve video, use Mux. If you need to extract and search the content inside video, use Exabase.

vs Mux

Mux is video infrastructure for hosting, streaming, and analytics. Exabase is not a video hosting platform. It extracts structured data from video files: transcripts, timestamps, metadata, thumbnails. If you need to serve video, use Mux. If you need to extract and search the content inside video, use Exabase.

vs FFmpeg + Whisper on your own server

Building a video processing pipeline means installing FFmpeg for demuxing, hosting a Whisper model for transcription, provisioning GPUs, managing a job queue, and handling file storage. Exabase is one API call. The infrastructure is managed for you.

vs FFmpeg + Whisper on your own server

Building a video processing pipeline means installing FFmpeg for demuxing, hosting a Whisper model for transcription, provisioning GPUs, managing a job queue, and handling file storage. Exabase is one API call. The infrastructure is managed for you.

Works with other Exabase features

Memory

Self-managing advanced memory system.

Bases

Isolated per-tenant instances with version rollback.

Resources

Files, notes, links. Your portable context server.

Deep Search

Sub-document multi-modal hybrid search.

Extract

Structured data from PDFs, websites, images, and more.

Workers

Autonomous agents and self-enriching knowledge bases.

Memory

Self-managing advanced memory system.

Bases

Isolated per-tenant instances with version rollback.

Resources

Files, notes, links. Your portable context server.

Deep Search

Sub-document multi-modal hybrid search.

Extract

Structured data from PDFs, websites, images, and more.

Workers

Autonomous agents and self-enriching knowledge bases.

Ready for scale

Fast

Deliver speed to your users. Infrastructure that won't slow your agent down.

Secure

Encrypted in transit (SSL) and at rest (AES-256). CASA certified.

Reliable

99.9% uptime. Built on Exabase's consumer-grade scaled infrastructure.

Ready for scale

Fast

Deliver speed to your users. Infrastructure that won't slow your agent down.

Secure

Encrypted in transit (SSL) and at rest (AES-256). CASA certified.

Reliable

99.9% uptime. Built on Exabase's consumer-grade scaled infrastructure.

Ready for scale

Fast

Deliver speed to your users. Infrastructure that won't slow your agent down.

Secure

Encrypted in transit (SSL) and at rest (AES-256). CASA certified.

Reliable

99.9% uptime. Built on Exabase's consumer-grade scaled infrastructure.

Use cases

Video library search

Transcribe and index a library of video files. Users search by spoken content and jump to the exact moment. No scrubbing through hours of footage.

Training and education platforms

Index training videos, lectures, and tutorials. Students and employees find the right lesson and the right segment by searching the transcript.

Training and education platforms

Index training videos, lectures, and tutorials. Students and employees find the right lesson and the right segment by searching the transcript.

Webinar and event recordings

Transcribe webinar recordings and make them searchable. Attendees and no-shows alike can find what was covered and when.

Webinar and event recordings

Transcribe webinar recordings and make them searchable. Attendees and no-shows alike can find what was covered and when.

RAG pipelines with video sources

Extract transcript chunks from recordings and feed them into your retrieval-augmented generation pipeline. Each chunk includes timestamps for source attribution.

RAG pipelines with video sources

Extract transcript chunks from recordings and feed them into your retrieval-augmented generation pipeline. Each chunk includes timestamps for source attribution.

Meeting recording search

Transcribe video calls and index them in a Base. Search across all meetings by topic, decision, or action item. Deep Search returns the exact moment.

Content repurposing

Extract transcript text from interviews, presentations, or panel discussions. Use the structured chunks as source material for articles, blog posts, or social clips.

Content repurposing

Extract transcript text from interviews, presentations, or panel discussions. Use the structured chunks as source material for articles, blog posts, or social clips.

Media asset management

Transcribe and catalogue a video library. Display duration, dimensions, transcript previews, and thumbnails in your UI without playing the file.

Media asset management

Transcribe and catalogue a video library. Display duration, dimensions, transcript previews, and thumbnails in your UI without playing the file.

Subtitle and caption generation

Use the timestamped transcript chunks as a starting point for subtitle files. Each chunk maps to a time range in the video.

Subtitle and caption generation

Use the timestamped transcript chunks as a starting point for subtitle files. Each chunk maps to a time range in the video.

Compliance and audit

Transcribe recorded calls, presentations, or depositions. The full transcript and timestamped chunks create a searchable record for compliance review.

FAQs

What is Exabase?

Exabase is infrastructure for AI agents. It gives your agents memory, versioned file storage, AI deep search, and context automation through a set of APIs. Store what your agent learns, search inside any content type, and keep knowledge bases current automatically. Built for production use. Give your agent precise context and cut your token spend by up to 81%.

Who uses Exabase?

Developers and teams building AI agents, copilots, and RAG applications. If your agent needs to remember things between sessions, store and retrieve files, search across documents and media, or stay up to date without manual maintenance, Exabase handles that infrastructure so you can focus on your product.

How fast is processing?

Processing time depends on the file length, resolution, and format. Processing is asynchronous, so your application is not blocked while extraction runs. Poll for results or configure a webhook to be notified on completion.

What video formats are supported?

MP4, MOV, AVI, WebM, MKV, and other major video formats. The API auto-detects the content type and processes accordingly.

Do I have to poll for results?

No. You can configure a webhook URL and Exabase will POST the full result to your server when processing completes. The webhooks guide covers setup.

What do transcript chunks look like?

Each chunk contains the transcript text, a sequence number, and timeStart / timeEnd values in seconds. You can map any piece of text back to the exact moment in the video.

Can I submit a URL instead of uploading a file?

Yes. Pass a url field in the request body pointing to a publicly accessible video file. Exabase fetches and processes it.

Does it extract visual content from video frames?

The API extracts the audio track and transcribes it. It returns frame dimensions and a thumbnail, but does not perform frame-by-frame visual analysis or object detection. We are working on this capability.

What happens if extraction fails?

The job state moves to failed. You can call the reprocess endpoint to retry without re-uploading the original file.

How long are files retained?

Stored files are retained for 1 day from job creation, then permanently deleted. Download or copy anything you need before the retention window expires.

Can I use the transcript with other Exabase features?

Yes. Store transcribed video as a Resource in a Base and the content becomes searchable through Deep Search. Extract key facts into Memory so your agent retains what it saw. Workers can re-extract updated recordings on a schedule.

How is this different from the Video Transcription tool?

The Video Transcription page focuses on the transcript output specifically. Video to JSON covers the full extraction response: metadata, duration, dimensions, thumbnail, transcript, and chunks. Same underlying API, different emphasis.

Is there an SDK?

Yes. The @exabase/sdk package for Node.js/TypeScript handles file streaming, job polling, and chunk retrieval. Install with npm install @exabase/sdk. Or call the REST API directly from any language.

What other content types does Extract support?

PDFs, images (with OCR), audio files (with transcription), web pages, and documents. The same POST /v2/extract endpoint handles all of them. See the PDF to JSON, Image to JSON, Audio to JSON, and Website to JSON tool pages.

Other tools

Token cost calculator

Link preview API

PDF thumbnail generator

PDF to JSON

Website to JSON

Audio to JSON

Video to JSON

Image to JSON

Invoice to JSON

Contract to JSON

Resume to JSON

PDF to chunks

Image to text

Audio transcription

Video transcription

Token cost calculator

Link preview API

PDF thumbnail generator

PDF to JSON

Website to JSON

Audio to JSON

Video to JSON

Image to JSON

Invoice to JSON

Contract to JSON

Resume to JSON

PDF to chunks

Image to text

Audio transcription

Video transcription

Deciding?

Ask your favourite AI about Exabase:

Cut your token spend and give your agent precise context.

Get started in minutes.

Start for free

Read the docs

Cut your token spend and give your agent precise context.

Get started in minutes.

Start for free

Read the docs