Keysteps
The start and end of each step of the procedure, from a label set you agree on.
An egocentric data category, built on request
Factory and warehouse work, filmed from the worker's view
First-person footage of hands-on work: assembling parts, picking and packing orders, inspecting and repairing. It's filmed on a head mount, smart glasses or your own device at sites agreed with you, then labeled step by step, for AR guidance, training and robots that learn the job.
✓ reviewed by a person line3_207 · ready to deliver
The short answer
What is egocentric factory and warehouse work video data?
Egocentric factory and warehouse work video data is first-person footage of people doing hands-on work in factories, warehouses and workshops, filmed from a camera they wear, and labeled with the tools, parts and steps of each procedure.
Work on a line or in a warehouse follows a procedure, so the most useful label is usually the step: which one the worker is on, whether it was done in the right order, and how long it took.
Work sites need planning that homes don't: permission from whoever runs the site, safety rules for anyone wearing a camera, and care with screens, documents and colleagues who appear in frame. All of it gets settled in the brief before filming.
This category runs through our Data collection service, with tools, parts and steps labeled through our computer vision service. The egocentric video data page covers the devices and labels in full.
This category at a glance
- Data type
- Egocentric (first-person) video
- Typical tasks
- Assembly, picking and packing, inspection, repair and maintenance.
- Sites
- Agreed with you in the brief, including your own facilities where access can be arranged.
- Devices
- Head mounts, smart glasses, action cameras, or your own hardware.
- Labels
- Keysteps, tools and parts, hands, tracking, and steps done out of order.
- Service
- Data collection
- Your data
- NDA first, used only for the agreed scope, returned or deleted when you ask.
- First step
- A small free sample before you commit.
Before filming starts
Details worth planning for
A short brief that answers these saves sending people back to film again. The egocentric collection guide has a template that covers them all.
The procedure
The step list, the label for each step, and whether mistakes should be filmed too, so a model learns to catch them.
Site access and safety
Who approves filming, the safety rules on site, and the hours when filming can happen.
What's in frame
Screens, documents, product details and colleagues. Agree what stays out of frame and what gets removed before delivery.
The device on the job
A mount that works with helmets, gloves and safety glasses, and a battery that lasts as long as each recording needs to.
What gets labeled
Labels for this footage
The usual label set for this category. The set you get is agreed with you before labeling starts.
Tools and parts
A box around each tool and part in use, with the frames where a hand is on it.
Hands
Each hand followed through the task with one id, gloved or not.
Mistakes and deviations
Steps done out of order, skipped or redone, labeled when your model has to catch them.
Where it's used
What this footage trains
Common uses. They show the kind of work, and they aren't client names.
AR work instructions
Guidance on glasses that knows which step a worker is on and shows the next one.
Training and quality checks
Models that check a procedure was followed, and flag a skipped or out-of-order step.
Robots for picking and assembly
Models that learn a manual task by watching skilled people do it.
What you get
What one delivered clip looks like
Each clip in this category comes with its labels, its keysteps, any transcribed speech and the details of who filmed it, where and on what device.
The example on the right is an illustration of the format, not client data. The fields, label names and file types are agreed with you before collection starts, so the delivery drops straight into your pipeline.
Files for each clip
- Video
- The first-person recording, as filmed on the helmet-mounted camera.
- Labels
- Boxes per frame for bracket, bolt x4, driver and the hands.
- Keysteps
- The start and end of each step: place bracket, tighten bolts, inspect.
- Speech
- What the wearer says, transcribed with timestamps, when the brief asks for it.
- Metadata
- Contributor id, place, device, task and date, so you can split training and test data by person and place.
line3_207.json illustration
{
"clip": "line3_207.mp4",
"device": "helmet-mounted camera",
"task": "fit bracket and tighten 4 bolts",
"length": "00:48.0",
"keysteps": [
{ "step": "place bracket", "start": "00:01.9", "end": "00:16.3" },
{ "step": "tighten bolts", "start": "00:16.3", "end": "00:31.7" },
{ "step": "inspect", "start": "00:31.7", "end": "00:47.0" }
],
"labels": {
"boxes": ["bracket", "bolt x4", "driver"],
"frames": "every frame"
},
"speech": "Third bolt done, checking the torque.",
"contributor": "C-0192",
"site": "S-03"
}
How it works
From your brief to reviewed footage
One named contact owns the project from scoping to the last file.
Brief
You tell us the tasks, the settings, the device and roughly how much you need.
NDA and scope
We sign an NDA before any data moves, then agree the scope with you.
Free sample
We film a small sample free, so you can check framing and quality before you commit.
Production
Contributors from our network film first-person, on the agreed device, to the brief you set.
Review
Footage and labels are reviewed before anything is delivered.
Delivery
The data comes to you, or moves on to labeling or evaluation with us.
Related
Where this footage fits
This category is part of our egocentric video data work. You can also browse every category on the datasets hub.
More egocentric categories: Egocentric walking and navigation video and Egocentric shopping and retail video.
FAQ
Questions about egocentric factory and warehouse work video
The egocentric video FAQ covers questions that apply to every first-person project.
Do you have factory or warehouse footage already recorded?
No. Footage is filmed to your brief: the procedure, the sites, the device and how much you need.
Can you film at our facility?
Footage can be filmed at sites agreed with you, including your own facilities where access can be arranged. Tell us the location, the access rules and the safety requirements, and we'll plan the shoot around them.
Can you label mistakes as well as correct steps?
Yes. Skipped, repeated and out-of-order steps can be labeled alongside the correct ones, from a label set agreed before labeling starts.
Can we try a small sample first?
Yes, a small free sample before you commit to the full brief.
Can this run alongside other egocentric categories?
Yes. Work footage often runs with hand-object close-ups under one brief and one named contact, drawing on our 30,000+ person network and 150+ projects delivered to date.
Request this category
Pick what you need, say which tasks get filmed and roughly how much footage, and send it. We'll film a small sample free before you commit.
- Your named contact replies within one business day.
- We sign an NDA before any data changes hands.
- We film your free sample, then agree the full scope.
This opens your email app with the brief filled in. Nothing is sent until you press send. You can also use the contact page.