Products in hand
A box around each product the wearer holds, with its class or product name.
An egocentric data category, built on request
Shopping video, the way the shopper sees it
First-person footage of people shopping: walking the aisles, picking products off the shelf, reading labels, filling a basket and paying. Filmed on smart glasses or a head mount, it shows products in hand and on the shelf from the angle a shopping assistant or retail model will actually see.
✓ reviewed by a person grocery_152 · ready to deliver
The short answer
What is egocentric shopping and retail video data?
Egocentric shopping and retail video data is first-person footage of people shopping in physical stores, filmed from a camera they wear, and labeled with the products they look at and handle and the actions they take.
Products look different in the hand than in a catalog photo: half-turned, partly covered by fingers, under store lighting. First-person footage gives a recognition model the views it meets in use.
Stores need permission to film in, and other shoppers and staff appear in frame. The brief settles which stores, how permission is handled for each one, and what gets removed before delivery.
This category runs through our Data collection service, with products and actions labeled through our computer vision service. For fixed-camera store footage, see store walkthrough video.
This category at a glance
- Data type
- Egocentric (first-person) video
- Typical tasks
- Browsing, picking up products, reading labels, comparing and paying.
- Stores
- Grocery, pharmacy, fashion or electronics, as agreed in the brief.
- Devices
- Smart glasses or head mounts for eye-level footage, or your own device.
- Labels
- Products in hand and on the shelf, and actions like pick, put back and add to basket.
- Service
- Data collection
- Your data
- NDA first, used only for the agreed scope, returned or deleted when you ask.
- First step
- A small free sample before you commit.
Before filming starts
Details worth planning for
A short brief that answers these saves sending people back to film again. The egocentric collection guide has a template that covers them all.
Store types and regions
Which kinds of stores, in which countries, so packaging and shelf layouts match your market.
The product set
Whether any product counts, or specific brands, categories or items need to appear.
Permission and other shoppers
How filming permission is handled for each store, and what gets removed before delivery.
Actions to label
Pick, put back, read, compare, add to basket and pay, or a set of your own.
What gets labeled
Labels for this footage
The usual label set for this category. The set you get is agreed with you before labeling starts.
Products on the shelf
Products boxed in the shelf view as the wearer looks along the aisle.
Shopper actions
The start and end of each pick, put-back, comparison and checkout.
Talk-through
What the wearer says while shopping, transcribed with timestamps.
Where it's used
What this footage trains
Common uses. They show the kind of work, and they aren't client names.
Shopping assistants on glasses
Assistants that read a label, compare two products or find an item on a list.
Product recognition
Models that identify products from the angles and lighting of a real store.
Shopper behavior
Models that learn how people move through a store and choose what to buy.
What you get
What one delivered clip looks like
Each clip in this category comes with its labels, its keysteps, any transcribed speech and the details of who filmed it, where and on what device.
The example on the right is an illustration of the format, not client data. The fields, label names and file types are agreed with you before collection starts, so the delivery drops straight into your pipeline.
Files for each clip
- Video
- The first-person recording, as filmed on the smart glasses.
- Labels
- Boxes per frame for oats 500g, basket, shelf products and the hands.
- Keysteps
- The start and end of each step: pick, read label, add to basket.
- Speech
- What the wearer says, transcribed with timestamps, when the brief asks for it.
- Metadata
- Contributor id, place, device, task and date, so you can split training and test data by person and place.
grocery_152.json illustration
{
"clip": "grocery_152.mp4",
"device": "smart glasses",
"task": "shop for breakfast items",
"length": "03:40.0",
"keysteps": [
{ "step": "pick", "start": "00:08.8", "end": "01:14.8" },
{ "step": "read label", "start": "01:14.8", "end": "02:25.2" },
{ "step": "add to basket", "start": "02:25.2", "end": "03:35.6" }
],
"labels": {
"boxes": ["oats 500g", "basket", "shelf products"],
"frames": "every frame"
},
"speech": "Checking the sugar on this one.",
"contributor": "C-0192",
"store": "grocery R-12"
}
How it works
From your brief to reviewed footage
One named contact owns the project from scoping to the last file.
Brief
You tell us the tasks, the settings, the device and roughly how much you need.
NDA and scope
We sign an NDA before any data moves, then agree the scope with you.
Free sample
We film a small sample free, so you can check framing and quality before you commit.
Production
Contributors from our network film first-person, on the agreed device, to the brief you set.
Review
Footage and labels are reviewed before anything is delivered.
Delivery
The data comes to you, or moves on to labeling or evaluation with us.
Related
Where this footage fits
This category is part of our egocentric video data work. You can also browse every category on the datasets hub.
More egocentric categories: Egocentric household task video and Egocentric factory and warehouse work video.
FAQ
Questions about egocentric shopping and retail video
The egocentric video FAQ covers questions that apply to every first-person project.
Do you have shopping footage already recorded?
No. Footage is filmed to your brief: the stores, the products, the device and how much you need.
How is filming permission handled?
It's settled in the brief before filming: which stores, how permission is handled for each one, and what gets removed before delivery.
Can this be combined with fixed-camera store footage?
Yes. First-person footage can run alongside our store walkthrough and in-store behavior video categories under one brief.
Can we try a small sample first?
Yes, a small free sample before you commit to the full brief.
Can this run alongside other egocentric categories?
Yes. Shopping footage often runs with walking and navigation footage under one brief and one named contact, drawing on our 30,000+ person network and 150+ projects delivered to date.
Request this category
Pick what you need, say which tasks get filmed and roughly how much footage, and send it. We'll film a small sample free before you commit.
- Your named contact replies within one business day.
- We sign an NDA before any data changes hands.
- We film your free sample, then agree the full scope.
This opens your email app with the brief filled in. Nothing is sent until you press send. You can also use the contact page.