Object Tracking
Track vehicles, weapons, and objects across video frames using DeepSORT multi-object tracking with path visualization and interaction detection.
Object Tracking#
FrameCounsel's object tracking module uses the DeepSORT (Deep Simple Online and Realtime Tracking) algorithm to follow objects of interest across video frames. This is essential for establishing the movement of vehicles, weapons, personal items, and other evidence throughout an encounter.
DeepSORT Multi-Object Tracking#
DeepSORT combines motion prediction with deep appearance features to maintain consistent object identities even through temporary occlusions, camera motion, and crowded scenes. FrameCounsel's implementation runs entirely on-device through Core ML and handles:
- Vehicles - Cars, trucks, motorcycles, and bicycles with make/model classification
- Weapons - Firearms, tasers, batons, and edged weapons
- Personal items - Phones, bags, wallets, and clothing articles
- Environmental objects - Traffic signals, signage, barriers, and structures
The tracker maintains identity across brief occlusions (e.g., a person walking behind a vehicle) and re-identifies objects when they reappear in frame.
Performance
DeepSORT processes at approximately 25 FPS on M2 Pro hardware when tracking up to 20 simultaneous objects. For dense scenes with more targets, enable the batch processing mode in Settings > Tracking > Batch Mode.
Setting Up Targets#
You can define tracking targets in two ways:
- Automatic detection - Run the object detection pipeline on your video and FrameCounsel will identify and begin tracking all detected objects automatically. Filter the results by object class to focus on what matters.
- Manual selection - Click on any object in a video frame to begin tracking it. Draw a bounding box around the target if the automatic detector missed it. Press to initiate manual tracking from the current frame.
Each tracked object is assigned a unique ID, a color-coded bounding box, and a label. Rename objects in the Tracking Panel to give them meaningful identifiers (e.g., "Defendant's Vehicle" or "Officer's Taser").
Path Visualization#
FrameCounsel renders the movement path of each tracked object as a colored trail overlaid on the video. Path visualization helps establish:
- The direction and speed of vehicle travel
- Whether a person was moving toward or away from officers
- The trajectory of thrown objects or discharged weapons
- Relative positions of multiple individuals during a confrontation
Toggle path visualization with or from the Overlays menu. Adjust trail length, opacity, and color in the overlay settings.
Export Path Data
Export object paths as coordinate data (CSV) for use with mapping tools or for inclusion in expert witness reports. Each data point includes frame number, timestamp, bounding box coordinates, and confidence score.
Interaction Detection#
FrameCounsel can detect when tracked objects interact with each other. The system flags events such as:
- Two people coming into close proximity (potential use-of-force indicator)
- A person entering or exiting a vehicle
- An object being passed between individuals
- A tracked weapon being drawn or holstered
Interaction events are automatically added to the Findings Panel and can be sent to the Timeline Builder for inclusion in your case chronology.
Next Steps#
When working with multiple camera sources, use Multi-Video Sync to track objects as they move between different camera views.