Video data for AI teams

Video data captured and labeled frame by frame

Video data for AI is footage your model learns from over time: objects that move, actions that unfold, and speech that goes with the picture. People from our 30,000+ network film it in our Video Collection tool, and the same team labels, tracks and transcribes it.

The short answer

What is video data?

Video data for AI is footage paired with labels over time: boxes that follow each object from frame to frame, the start and end of actions, and what was said. A model learns from it how things move and what happens next.

Time is what makes video different from a stack of photos. An object has to keep the same identity across frames, and an action has a start, a middle and an end that someone has to mark.

A good video dataset is filmed to a brief, with the angles, settings and lengths your model will meet, and labeled to rules agreed before the first clip.

Per-frame labels multiply any inconsistency, so it is worth reading how annotation quality gets measured before you scope a labeling pass.

Video data at IndecalAI

Collection
Clips of actions, gestures, driving and everyday scenes, filmed by people in our 30,000+ network.
Labels
Objects per frame, tracking with one id per object, action and event labels.
Speech
Speech in video transcribed with timestamps that match the footage.
Tools
Video Collection, Image Annotation and Transcription, all our own.
Industries
Automotive, retail and healthcare, among others.
Quality
A review before delivery.
Your data
NDA first, used only for the agreed scope, returned or deleted when you ask.
Contact
One named contact who replies within one business day.
First step
A small free sample before you commit.
Company
Based in Ahmedabad, India, since 2021, with 150+ projects delivered.
AI showcase

Play back one clip, layer by layer

A nine-second street clip with its labels split out. Pick a layer. The clip is an illustration, and the layers you get are agreed up front.

Pick a part of the sample

The clip

Filmed by a person from our network to your brief for angle, setting and length, with our Video Collection tool.

  • Brief: What happens, where, and from which angle.
  • Length: Clip length agreed with you.
  • Checks: Shaky, dark or off-brief clips are caught before labeling.

Tracking

The same object followed from frame to frame with one id, including the frames where it's partly hidden.

  • Ids: One id per object for the whole clip.
  • Frames: Every frame or key frames, as agreed.
  • Tool: Our own Image Annotation tool.

Events

Actions and events marked with where they start and end, so a model learns what happens in a clip and in what order.

  • Labels: The actions and events you agree on.
  • Timing: A start and an end for each one.
  • Use: Action recognition and video search.

Speech

What people say in the footage, transcribed with timestamps that line up with the picture. See transcription.

  • Timing: Timestamps that match the footage.
  • Speakers: Speaker labels where there are several.
  • Tool: Our own Transcription tool.
What we deliver

From filming to labels

New footage filmed to your brief, and labels that follow it through time: objects in every frame, tracks with one id, actions and events, and the speech in the clip.

Footage filmed to a brief

Clips of actions, gestures, driving and everyday scenes, filmed by people from our network for the angle, setting and length you need.

For new datasets and missing scenes

Objects in every frame

A box around each object in each frame, with its class, drawn to rules agreed for hidden and cut-off objects.

For object detection in video

Tracking

The same object followed across frames with one id, so a model learns how things move.

For tracking, counting and movement

Actions and events

The start and end of each action or event, labeled from a set you agree on.

For action and gesture recognition

Speech in video

Speech in the footage transcribed with timestamps that line up with the picture.

For captions, video search and assistants

Conditions and settings

Footage spread across the times of day, weather and settings your model will meet, planned into the brief.

For models that work outside good daylight

Where it's used

What video data gets used for

A handful of common uses. They show the kind of work, and they aren't client names. If your footage comes with other data, see speech data, image data and text data. Example category: automotive driving scene video.

Driver assistance

Cars, people and signs boxed frame by frame in driving footage, so a model learns what's on the road.

Objects in every frame

Action recognition

Actions marked with their start and end, so a model learns to tell walking from crossing from stopping.

Actions and events

Counting and tracking

Each person or object followed with one id, for models that count or track movement.

Tracking

Gesture recognition

Gestures filmed by many people at many angles, so a model recognizes them from anyone.

Footage filmed to a brief

Captions and video search

Speech transcribed with timestamps, so what's said can be searched and shown on screen.

Speech in video

Testing a video model

Held-back clips from every condition, to check how your model does in each.

Data and model evaluation

Video data categories

Video data by industry

Each page covers what that kind of video project usually needs, and each one is built to your brief. First-person footage from head mounts, action cameras and smart glasses has its own page: egocentric video data. Every category, including speech, image and text, is on the datasets hub.

Before filming starts

Get these right before filming

Reshooting is the expensive fix. Deciding these four things first is the cheap one.

What happens in the clips

The actions, gestures and scenes your model has to learn, and the label set for each.

Camera and setting

Where the camera sits, the settings and light, and how long each clip runs.

How to label over time

Every frame or key frames, and how each object keeps its id when it's hidden or leaves the frame.

Speech in the footage

Whether what's said gets transcribed, with speaker labels and timestamps that match the picture.

How it works

From the filming brief to labeled video

Your named contact runs it from the brief to the last clip. Each step links to the service behind it.

  1. Brief

    You tell us what happens in the clips, where, and what the data is for.

  2. NDA first

    The NDA is signed before any data moves.

  3. Collection

    People from our network film clips in Video Collection.

  4. Labeling

    Objects, tracks and events get labeled and checked.

  5. Transcription

    Speech in the footage is written down with timestamps.

  6. Evaluation

    Held-back clips check your model condition by condition.

Glossary

Frames, tracks and segments

What people mean by the words that come up on a video project.

Frame
One still image in a video. A clip is many frames shown one after another.
Key frame
A frame chosen for labeling when not every frame needs labels.
Object tracking
Following the same object across frames and keeping one id for it the whole time.
Track id
The number that stays with one object for the whole clip, like car 03.
Temporal segment
A stretch of video with a start and an end, labeled with what happens in it.
Action recognition
A model telling what's happening in a clip, like walking, waving or crossing.
Frame rate
How many frames a video has per second. It changes how finely movement is captured.
Occlusion
When an object is partly hidden behind something else for some frames.
Related work

Services a video project uses

A video project usually needs more than one of these. You can also compare all eight.

Data collection

New footage filmed by people in our network.

Computer vision

Detection, segmentation and tracking in depth.

Transcription

Speech in the footage turned into reviewed text.

Data annotation and labeling

Labeling across every data type.

Data and model evaluation

Held-back clips scored against your targets.

FAQ

Questions about video data

Straight answers about video data. The services FAQ covers how the services fit together.

What is video data?

Footage paired with labels over time, like boxes that follow each object from frame to frame, the start and end of actions, and what was said, that a model learns from.

Can you capture new footage?

Yes. People from our network film clips of actions, gestures, driving and everyday scenes to your brief for angle, setting and length, with our Video Collection tool.

Can you film first-person (egocentric) video?

Yes. People from our network film first-person footage on head- or chest-mounted phones, action cameras, smart glasses or devices you send us, and the same team labels hands, objects and task steps. See egocentric video data.

What can be labeled in video?

Objects in each frame, the same object followed across frames with one id, actions and events with their start and end, and speech, which gets transcribed. Our computer vision page covers the image labels.

Do you label every frame?

It depends on the task. Some models need every frame, others only need key frames. We agree it with you before labeling starts, along with how an object keeps its id across frames.

Can you transcribe the speech in the videos?

Yes. Speech in video gets transcribed with timestamps that line up with the footage. See transcription.

How much footage do we need?

It depends on the task and how varied the scenes are, so there's no standard number. We plan it with you, and the free sample shows quality before you commit to volume.

Can we try a small sample first?

Yes. Send a short brief and we'll capture or label a small sample free before you commit.

Does our data stay private?

Yes. The NDA is signed before any data moves, we use it only for the scope we agreed, and only the people working on your project can get to it. It's returned or deleted when you ask.

Start with a free sample

Pick what you need, say what happens in the clips and roughly how much footage, and send it. We'll capture or label a small sample free before you commit.

  1. Your named contact replies within one business day.
  2. We sign an NDA before any data changes hands.
  3. We capture or label your free sample, then agree the full scope.
What do you need?
Email this brief

This opens your email app with the brief filled in. Nothing is sent until you press send. You can also use the contact page.