rspace-online/backlog/tasks/task-134 - PWA-—-MediaPipe-...

1.2 KiB

id title status assignee created_date labels milestone dependencies priority
TASK-134 PWA — MediaPipe CV pipeline + pointer mapper Done
2026-03-29 20:52
pwa
cv
m-2
high

Description

Write cv-pipeline.js (MediaPipe ObjectDetector from CDN, EfficientDet Lite 0 float16, VIDEO mode, detection overlay drawing) and pointer-mapper.js (FOV-based bbox→pan/tilt angle conversion with exponential smoothing).

Acceptance Criteria

  • #1 Dynamic import from MediaPipe CDN with GPU delegate + CPU fallback
  • #2 detectForVideo returns normalised bboxes with centerX/centerY
  • #3 drawDetections: green for target, amber dashed for others, HiDPI aware
  • #4 pixelToAngles: mirrored X axis, 80/60 FOV default
  • #5 relativeTarget for fallback anchor offsets
  • #6 Exponential smoothing factor 0.3

Final Summary

cv-pipeline.js: MediaPipe Tasks Vision CDN, EfficientDet Lite 0, normalised detections, styled overlay. pointer-mapper.js: FOV mapping, EMA smoothing, relative fallback.