←back to thread

230 points roryclear | 1 comments | | HN request time: 0.204s | source

This runs YOLOv8 + bytetrack with Tinygrad detections (depending on user config) are saved and can be sent to the companion iOS app along with a notification, all video processing is done locally, all footage is encrypted before leaving your computer, and the sending notifications + videos part is optional. This uses tinygrad, so it runs well on my apple silicon macs and should be able to run on a lot of hardware (or will be able to when I remove other deps).
Show context
formichunter ◴[] No.45012450[source]
I have been trying to tackle this type of "Feature" but object detection and action detection seem to be a totally different problem. Use case: I want to "detect" when a car does not stop at a stop sign. I have researched this over youtube, reddit, etc and other than training it myself there are no models already out there, including YOLO. Can anybody offer advice on how to achieve this use case?
replies(3): >>45012494 #>>45017683 #>>45039041 #
1. teruakohatu ◴[] No.45012494[source]
Try building up a method iteratively. Start by calculating the speed of a car as it crosses the camera frame.

Then try calculating the speed between two points (in car length in front of and a car length behind the stop sign).

Then set a threshold for how fast is too fast for a car to realistically go between those two points without stopping. Get notified with a video snippet when a car is above this threshold. Adjust the threshold based on the videos you are capturing.

It won’t work if your object detection is not running at your camera framerate.