Scene Understanding

Scene understanding types analyse photographs of physical locations and objects — not documents. with analysis_type: scene_understanding. They return structured assessments with enumerated values rather than text extraction.

These types are used for merchant onboarding verification, field inspection automation, insurance underwriting, and workplace safety audits.

---

merchant_shopfront — Merchant Shopfront

Analysis type: scene understanding

Analyses the exterior of a business to verify identity, signage quality, and physical condition.

Fields extracted

Validation rules

Example

const result = await client.verify.document({
  doc_type: "merchant_shopfront",
  file_url: "https://storage.example.com/shop_photo.jpg",
});
// result.output.business_name → "Sri Lakshmi General Stores"
// result.output.signage_quality → "semi_professional"
// result.output.storefront_condition → "good"
// result.output.payment_methods_displayed → ["PhonePe", "Paytm"]
// result.output.scripts_detected → ["Tamil", "English"]

---

merchant_interior — Merchant Interior

Analysis type: scene understanding

Analyses the inside of a business to assess scale, stock, operations, and digital readiness.

Fields extracted

Validation rules

---

merchant_neighbourhood — Merchant Neighbourhood

Analysis type: scene understanding

Analyses the street and area around a business to assess commercial viability, foot traffic, and risk.

Fields extracted

Validation rules

---

shop_inventory — Shop / Retail Inventory

Analysis type: scene understanding

Assesses shelf stock levels, product variety, organisation, and inventory health.

Fields extracted

Validation rules

---

site_safety_audit — Construction / Site Safety

Analysis type: scene understanding

Assesses PPE compliance, hazard detection, and safety score for construction or industrial sites.

Fields extracted

Validation rules

Example

const result = await client.verify.document({
  doc_type: "site_safety_audit",
  file_url: "https://storage.example.com/construction_site.jpg",
});
// result.output.safety_score → 6.5
// result.output.ppe_compliance_pct → 72.0
// result.output.violations → ["Two workers not wearing helmets", "Open excavation without barricading"]
// result.output.hazards_detected → ["Open excavation", "Unsecured scaffolding"]

---

vehicle_inspection — Vehicle Inspection

Analysis type: scene understanding

Assesses vehicle condition from photographs — used for insurance pre-inspection, loan collateral checks, and fleet management.

Fields extracted

Validation rules

Example

const result = await client.verify.document({
  doc_type: "vehicle_inspection",
  file_url: "https://storage.example.com/car_front.jpg",
});
// result.output.overall_condition → "fair"
// result.output.damage_severity → "minor"
// result.output.damage_details → [
//   { area: "front bumper", type: "scratch", severity: "minor" }
// ]
// result.output.tire_condition → "good"