Frigate - Revision history

Leo at 21:07, 23 August 2025

2025-08-23T21:07:05Z

@@ Line 17: / Line 17: @@
 Due to the chip shortage, Google Corals aren't easy to come by. The best alternative is to pick up a cheap NVIDIA Quadro GPU such as the P400. I got a second-hand P400 for around $80 CAD.
 ==== TensorRT ====
 See the documentation on this at: https://docs.frigate.video/configuration/object_detectors/#nvidia-tensorrt-detector

Leo at 20:49, 23 August 2025

2025-08-23T20:49:51Z

← Older revision		Revision as of 20:49, 23 August 2025
Line 114:		Line 114:

	Speculation: All the other cameras are all Wyze Cam v3 with the same firmware and they have no issues. The only difference would possibly be due to a weak Wi-Fi connection which is causing unexpected latency or corruption that's causing go2rtc and ffmpeg to go haywire?		Speculation: All the other cameras are all Wyze Cam v3 with the same firmware and they have no issues. The only difference would possibly be due to a weak Wi-Fi connection which is causing unexpected latency or corruption that's causing go2rtc and ffmpeg to go haywire?

			=== Frigate migration crashes ===
			After my container image automatically updated, frigate now crashes on startup when it tries to do a migration.
			{{Highlight
			\| code = 2025-08-23 11:16:05.485451924 [2025-08-23 11:16:05] peewee_migrate.logs INFO : Starting migrations
			2025-08-23 11:16:05.512447249 [2025-08-23 11:16:05] peewee_migrate.logs INFO : Migrate "030_create_user_review_status"
			2025-08-23 11:16:05.512645584 [2025-08-23 11:16:05] peewee_migrate.logs INFO : sql ('\n CREATE TABLE IF NOT EXISTS "userreviewstatus" (\n "id" INTEGER NOT NULL PRIMARY KEY AUTOINCREMENT,\n "user_id" VARCHAR(30)
			NOT NULL,\n "review_segment_id" VARCHAR(30) NOT NULL,\n "has_been_reviewed" INTEGER NOT NULL DEFAULT 0,\n FOREIGN KEY ("review_segment_id") REFERENCES "reviewsegment" ("id") ON DELETE CASCADE\n )\n ',)
			2025-08-23 11:16:05.513106209 [2025-08-23 11:16:05] peewee_migrate.logs INFO : sql ('CREATE UNIQUE INDEX IF NOT EXISTS "userreviewstatus_user_segment" ON "userreviewstatus" ("user_id", "review_segment_id")',)
			2025-08-23 11:16:05.513623581 [2025-08-23 11:16:05] peewee_migrate.logs INFO : Run <lambda>
			2025-08-23 11:16:05.553604917 Traceback (most recent call last):
			2025-08-23 11:16:05.553628185 File "/usr/local/lib/python3.11/dist-packages/peewee.py", line 3322, in execute_sql
			2025-08-23 11:16:05.553725739 [2025-08-23 11:16:05] peewee_migrate.logs ERROR : Migration failed: 030_create_user_review_status
			2025-08-23 11:16:05.553728331 Traceback (most recent call last):
			2025-08-23 11:16:05.553730349 File "/usr/local/lib/python3.11/dist-packages/peewee.py", line 3322, in execute_sql
			2025-08-23 11:16:05.553731736 cursor.execute(sql, params or ())
			2025-08-23 11:16:05.553734113 pysqlite3.dbapi2.IntegrityError: UNIQUE constraint failed: userreviewstatus.user_id, userreviewstatus.review_segment_id
			\| lang = terminal
			}}
			It appears that the update now creates a new userreviewstatus table that references reviewsegment... review_segment_id has to be unique. Maybe something happened on my instance where there was a duplicate of review_segment_id and now the migration is failing.

			The fix here is to:

			# Stop frigate
			# Edit the sqlite database: <code>sqlite3 frigate.db</code>
			# Delete the duplicate record in the reviewsegment table. I don't really care about the review feature, so I just run <code>delete from reviewsegment</code>.

Leo: /* TensorRT */

2024-02-03T22:21:11Z

TensorRT

← Older revision		Revision as of 22:21, 3 February 2024
Line 19:		Line 19:

	==== TensorRT ====		==== TensorRT ====
	See the documentation on this at: https://docs.frigate.video/configuration/~~detectors~~/#nvidia-tensorrt-detector		See the documentation on this at: https://docs.frigate.video/configuration/object_detectors/#nvidia-tensorrt-detector

	According to the official documentation, there are a long list of models that could be used. I find that the latest YOLO models work best, but they may run slower and require more GPU memory. The YOLOv4-tiny model works well as it is very fast and light on GPU memory, but it had trouble detecting cars in my garage. I eventually decided to go with the YOLOv7-320 model which is more accurate but slower which we'll set up now.		According to the official documentation, there are a long list of models that could be used. I find that the latest YOLO models work best, but they may run slower and require more GPU memory. The YOLOv4-tiny model works well as it is very fast and light on GPU memory, but it had trouble detecting cars in my garage. I eventually decided to go with the YOLOv7-320 model which is more accurate but slower which we'll set up now.

Leo at 23:04, 11 August 2023

2023-08-11T23:04:54Z

← Older revision		Revision as of 23:04, 11 August 2023
Line 100:		Line 100:
	* Enable go2rtc. You'll get higher framerates when viewing live video from the Frigate web interface which won't be limited to the objection detection fps.		* Enable go2rtc. You'll get higher framerates when viewing live video from the Frigate web interface which won't be limited to the objection detection fps.
	* Enabling object detection will automatically have the camera report the objects in Home Assistant (also via MQTT). If you're monitoring for 'car', you'll get a 'car' count in Home Assistant which you can automate on.		* Enabling object detection will automatically have the camera report the objects in Home Assistant (also via MQTT). If you're monitoring for 'car', you'll get a 'car' count in Home Assistant which you can automate on.

			== Troubleshooting ==

			=== ffmpeg frequently OOMs ===
			One of the camera's ffmpeg process periodically chews up all the memory assigned to the container and then gets OOM killed. This [https://github.com/blakeblackshear/frigate/issues/5924 issue seems to happen to others] as well.

			Things that I tried which did not help with the OOM are:

			* Disabled NVIDIA hwaccel flags to ffmpeg - ffmpeg continued to OOM periodically
			* Updated go2rtc from 1.2.0 to 1.6.2 - no change

			What did stop the OOMs completely was to not have the frigate camera config use go2rtc but rather stream from the camera directly.

			Speculation: All the other cameras are all Wyze Cam v3 with the same firmware and they have no issues. The only difference would possibly be due to a weak Wi-Fi connection which is causing unexpected latency or corruption that's causing go2rtc and ffmpeg to go haywire?

Leo: Created page with "Frigate is a self hosted and open source video surveillance system. It is capable of: * streaming video from RTSP/RTMP * performing real-time object detection or simply just motion detection * keeping track of video clips and image snapshots with a retention policy * MQTT integration for messaging events This page will contain some of my notes on using Frigate. == Setup == Frigate is distributed as a Docker image only and has to run as a Docker container. === Objec..."

2023-08-06T23:22:55Z

Created page with "Frigate is a self hosted and open source video surveillance system. It is capable of: * streaming video from RTSP/RTMP * performing real-time object detection or simply just motion detection * keeping track of video clips and image snapshots with a retention policy * MQTT integration for messaging events This page will contain some of my notes on using Frigate. == Setup == Frigate is distributed as a Docker image only and has to run as a Docker container. === Objec..."

New page

Frigate is a self hosted and open source video surveillance system.

It is capable of:

* streaming video from RTSP/RTMP
* performing real-time object detection or simply just motion detection
* keeping track of video clips and image snapshots with a retention policy
* MQTT integration for messaging events

This page will contain some of my notes on using Frigate.

== Setup ==
Frigate is distributed as a Docker image only and has to run as a Docker container.

=== Object detection ===
The object detection system requires a detector set up. By default, Frigate will have a CPU detector enabled. This isn't recommended as the object detection uses a lot of CPU cycles while being slow. Frigate recommends using a USB Google Coral for this task, but you may also choose to use a NVIDIA GPU with TensorRT (supported on post-Pascal GPUs only).

Due to the chip shortage, Google Corals aren't easy to come by. The best alternative is to pick up a cheap NVIDIA Quadro GPU such as the P400. I got a second-hand P400 for around $80 CAD.

==== TensorRT ====
See the documentation on this at: https://docs.frigate.video/configuration/detectors/#nvidia-tensorrt-detector

According to the official documentation, there are a long list of models that could be used. I find that the latest YOLO models work best, but they may run slower and require more GPU memory. The YOLOv4-tiny model works well as it is very fast and light on GPU memory, but it had trouble detecting cars in my garage. I eventually decided to go with the YOLOv7-320 model which is more accurate but slower which we'll set up now.

First, we'll have to convert the YOLO models into a TensorRT model that works with our GPU. Keep in mind that the TensorRT <code>.trt</code> model file has to be built on the same GPU that you will use for detection. We'll generate the model file with NVIDIA's tensorrt container image:
{{Highlight
| code = ## Store the output models and the tensorrt_demos repo
# mkdir trt-models tensorrt_demos

## Launch the tensorrt container
# docker run --gpus=all -it -v `pwd`/trt-models:/tensorrt_models -v `pwd`/tensorrt_demos:/tensorrt_demos -v `pwd`/tensorrt_models.sh:/tensorrt_models.sh nvcr.io/nvidia/tensorrt:22.07-py3 bash

## Download the tensorrt_models.sh script from Frigate and run it. This will download all the YOLO models and then generate the .trt model file.
## If you _don't_ want to download all the YOLO models, you'll have to interrupt the script and edit the 'download.yolo.sh' 'script manually.
container# wget https://github.com/blakeblackshear/frigate/raw/master/docker/tensorrt_models.sh
container# YOLO_MODELS="yolov7-320" bash tensorrt_models.sh
| lang = terminal
}}
With the <code>yolov7-320.trt</code> file generated, we'll configure the TensorRT based detector with the following configuration lines:
{{Highlight
| code = detectors:
path: /trt-models/yolov7x-320.trt
width: 320
height: 320
input_tensor: nchw
input_pixel_format: rgb
| lang = yaml
}}
If you are using a different model, you'll have to make sure the width/height sizes match what was used to train the model for best results.

=== Tuning ===
If you're getting false positives, you may want to adjust the filter thresholds to help tune out the error rates.

For example:
{{Highlight
| code = cameras:
front:
...
detect:
enabled: True
objects:
track:
- person
- bus
filters:
person:
min_score: 0.6 # min score for object to initiate tracking (default: 0.5
threshold: 0.8 # min decimal percentage for tracked object's computed score to be considered a true positive (default: 0.7)
| lang = terminal
}}
Alternatively, if you're using a GPU, you may want to swap out the TensorRT model for another one and see if that helps with the detection.

You may also want to enable object masks to mask out areas that are causing the false positives.

=== Go2rtc ===
go2rtc is a built-in service in the Frigate container that may be used to stream RTSP video from all your cameras. This way, your ffmpeg processes will stream from the internal go2rtc server rather than from the cameras directly. The added bonus with using this is that you may use the webrtc option in the Frigate web interface for higher FPS video streams.

My configuration with my Wyze Cams running the RTSP beta firmware looks like this:
{{Highlight
| code = go2rtc:
streams:
entrance: rtsp://admin:wyzecam@10.1.x.x:554/live
backyard: rtsp://admin:wyzecam@10.1.x.x:554/live
front: rtsp://admin:wyzecam@10.1.x.x:554/live
garage: rtsp://admin:wyzecam@10.1.x.x:554/live
webrtc:
candidates:
- 10.1.x.x:8555
- stun:8555
| lang = terminal
}}

== General tips ==
Some tips I wished I knew earlier when using Frigate.

* Use a GPU or Coral if possible. CPU is okay, but it uses a lot of CPU which in turn means higher power usage. A cheap Quadro is both faster and more efficient than a CPU. Plus, a GPU lets you use hardware acceleration on video encoding (with ffmpeg) which also reduces your CPU usage.
* Object detection only happens when Frigate detects motion (that is, changed pixels) in a frame. It then sends the portion of the frame that it detected motion on for object detection. As a result, using motion masks on areas you aren't interested in can reduce the amount of object detection being performed.
* If you want to save clips when a specific object appears (such as 'person' appearing in the garage) while also wanting Frigate to also keep track of persistent objects but not record them (such as a 'car' in the garage), the best approach I've had is to create two cameras in Frigate: One for 'person' with clip recording enabled and another for 'car' with clip recording disabled.
** This was done so that I can count how many 'cars' are in the garage for Home Assistant to act on. I do not want constant video clips of a stationary 'car', however.
* Enable go2rtc. You'll get higher framerates when viewing live video from the Frigate web interface which won't be limited to the objection detection fps.
* Enabling object detection will automatically have the camera report the objects in Home Assistant (also via MQTT). If you're monitoring for 'car', you'll get a 'car' count in Home Assistant which you can automate on.