Skip to main content

How do I configure a media analysis widget?

Overview

A media analysis widget shows AI-read results from your photos or text submissions, checked against a Check you configure — for example, counting items in a shelf photo or confirming a display is present.

When to Use

Use this feature when:

  • You want an automatic read on photos or text submitted through a form — counting items, extracting a value, or scoring against a Check
  • You don't need true computer-vision accuracy (facing recognition, object detection, SKU matching) — this feature reads images with a language model, not a vision model built for that

Concepts

  • Media Analysis Widget – Shows the results of an AI read of your media (photos or text submissions) against a Check you configure
  • Check – What the AI is asked to do on each piece of media; choose one of five types. A Check that's already set up shows as "(configured)" in the dropdown
  • Uniform check – A yes/no check against a single condition in the photo, such as whether something matches an expected standard
  • Display / POSM present – A yes/no check for whether a point-of-sale display or material (POSM) is visible in the photo
  • Count items – Counts how many of something appear in the photo — for example, how many units of a product are on a shelf; configured using one or more Values
  • Read a value – Extracts a specific value from the photo or text, such as a price or a label reading; configured using one or more Values
  • Quality score – Scores the photo or submission against quality criteria you describe, instead of a yes/no result or a count
  • Value – A specific thing the AI should extract or count under a Count items or Read a value Check, given a name, a type (such as Number), and a description telling the AI what to look for; Number-type Values become ordinary columns you can sum or average elsewhere in Vantage (a KPI card, chart, or summary/pivot table)
  • Item Reference Images – Optional reference photos you can upload so the AI knows what a correct item looks like
  • Credits – Each media analysis job that completes successfully uses a credit; credit use is capped and tracked by your admin
  • Media Analysis Job – The background task that reads one piece of media against a Check; jobs run asynchronously, and the dashboard refreshes automatically every 15 seconds while jobs are in progress

Set Up Guide

  1. Go to a dashboard and click Add Widget, then set the Title, Apply Dashboard Filters, Widget Type (Media Analysis), and Data Source as usual
  2. Choose the media field to analyze — a photo or text column from your Data Source, such as Shelf Photo Url
  3. Under "What should the AI check?", choose a Check — Uniform check, Display / POSM present, Count items, Read a value, or Quality score
  4. For Count items or Read a value, click + Value to add one or more values — give each a name, a type (such as Number), and a description telling the AI what to look for
  5. Optionally, upload Item reference images so the AI knows what a correct item looks like
  6. Click Save & Apply

Best Practices

  • Stick to photo or text submissions — video and audio analysis exist as legacy options, but they don't produce reliable results today: video analysis only sends the model the file's URL (which it can't actually watch), and audio analysis returns a placeholder instead of a real transcript
  • Treat results as LLM-grade, not CV-grade — there's no true object detection or facing recognition behind this; the model is reading the photo and estimating, so spot-check anything used for a compliance or scoring decision
  • Give each Value a clear, specific description — it's literally the instruction the AI reads to decide what to extract or count, so a vague description gives vague results
  • Avoid saving the same Check multiple times in quick succession — each save can queue new analysis jobs, and resaving repeatedly can create duplicate jobs that use up extra credits
  • What widget types are available in Vantage?
  • How do I configure a calendar widget?
  • How do I configure an AI summary widget?
FAQs

Is media analysis real computer vision, like object detection? 
No — it's a language model reading the photo (or text) against the rubric you set up. There's no true object detection, facing recognition, or SKU matching behind it, so treat results as LLM-grade, not CV-grade.

Can I use it to analyze videos or audio recordings? 
Video and audio options exist but aren't reliable today — video analysis only sends the model the file's URL, which it can't open, and audio analysis returns a placeholder instead of a real transcript. Stick to photos and text submissions.

Does every analysis use up credits? 
Yes — each job that completes successfully uses a credit, and credit use is capped and tracked by your admin.

Version Notes

Last Updated: Oct 2026