Direct answer
Treat the original camera stream as source evidence, analytics metadata as structured output, and the overlay stream as a derived visualization. Give each a distinct name, timestamp and retention policy.
Why this happens
Burned-in boxes are useful for operators but can hide pixels, drift from the original timestamp or be mistaken for camera-native evidence. A restream also adds another encoder and failure point.
Size the ingest path for the inference job, then keep the original stream, derived metadata and rendered overlays distinct.
A controlled test
Test synchronization by matching a metadata event, original frame and rendered overlay at the same time.
Change one variable at a time. Keep the camera model, firmware, endpoint and account recorded; then test network reachability, protocol response, media transport and decoding as separate layers.
Use a dedicated view-only account and a trusted local diagnostic tool. Redact credentials, private addresses and identifying data before sharing output.
Diagnostic sequence
| Check | Action | Evidence of progress |
|---|---|---|
| Source | Keep an authorized path to the original camera stream. | The unmodified view remains available. |
| Metadata | Store event time, class and confidence separately. | Analytics can be audited without reading pixels from an overlay. |
| Overlay | Label the rendered stream as derived. | Operators know it is not the original feed. |
| Sync | Measure end-to-end timestamp alignment. | Boxes correspond to the displayed frame. |
Evidence to keep
Save a small trace containing source frame time, inference event, overlay frame time and model version.
Boundary and safety note
Do not use a rendered overlay as the only retained record when the workflow requires original video or auditable metadata.
For remote viewing, use a managed VPN instead of exposing RTSP or camera administration ports directly to the public internet.
SmartRTSP
SmartRTSP is a camera-focused RTSP and ONVIF viewer for Apple devices, Windows and Android. It fits direct viewing, discovery and multi-camera checks; keep a dedicated NVR or VMS when continuous recording, evidence export or centralized enterprise controls are required.
Frequently asked questions
Should boxes be burned into the only stream?
No. Preserve the source and treat the overlay as a derived operator view.
Can ONVIF metadata replace the overlay?
Metadata can carry structured events, while an overlay remains a presentation choice for viewers.
Why record model version?
The same scene can produce different outputs after a model or threshold change.
Primary references
- ONVIF — Profile M for metadata and analytics
- NVIDIA — DeepStream architecture overview
- IETF RFC 5905 — Network Time Protocol version 4
Related SmartRTSP guide
Open related guideDesign a pipeline that preserves the original feed while publishing a derived stream with boxes or labels for operators.