[Bug]: FFmpeg cannot read Frames on RockChip

[ImCodingCat]

Describe the problem you are having

Hey i recently had device CM3588 which using RockChip RK3588 (https://wiki.friendlyelec.com/wiki/index.php/CM3588_NAS_Kit)
So i tried Frigate for first time and i follow installation guide.
For first time im using regular Frigate and works fine, camera shown in Frigate dashboard.
Then i move into Rockchip Frigate by adding -rk at the end.
After changing image to rockchip, " Unable to read frames from ffmpeg process" i got that error.
I have everything i need like in the screenshot below

Im using official image from the wiki, debian 12.
And i have no idea why that happen and even my jellyfin rockchip clearly works fine.

Im using portainer for adding compose file

Steps to reproduce

Using rockchip on frigate

Version

frigate:stable-rk

Frigate config file

mqtt:
  enabled: False

cameras:
  dummy_camera: # <--- this will be changed to your actual camera later
    enabled: True
    ffmpeg:
      inputs:
        - path: Censored
          roles:
            - detect

Relevant log output

2024-06-26 09:05:54.124778781  [2024-06-26 09:05:54] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:05:54.125982510  [2024-06-26 09:05:54] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:05:54.126438101  [2024-06-26 09:05:54] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:05:54.127083570  [2024-06-26 09:05:54] frigate.video                  ERROR   : dummy_camera: ffmpeg process is not running. exiting capture thread...
2024-06-26 09:06:03.084146897  [2024-06-26 09:06:03] watchdog.dummy_camera          ERROR   : Ffmpeg process crashed unexpectedly for dummy_camera.
2024-06-26 09:06:03.084449652  [2024-06-26 09:06:03] watchdog.dummy_camera          ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-06-26 09:06:04.342800852  [2024-06-26 09:06:04] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:04.343734201  [2024-06-26 09:06:04] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:04.344148083  [2024-06-26 09:06:04] frigate.video                  ERROR   : dummy_camera: ffmpeg process is not running. exiting capture thread...
2024-06-26 09:06:13.124264167  [2024-06-26 09:06:13] watchdog.dummy_camera          ERROR   : Ffmpeg process crashed unexpectedly for dummy_camera.
2024-06-26 09:06:13.124572173  [2024-06-26 09:06:13] watchdog.dummy_camera          ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-06-26 09:06:14.240597548  [2024-06-26 09:06:14] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:14.241433479  [2024-06-26 09:06:14] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:14.242485247  [2024-06-26 09:06:14] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:14.243194884  [2024-06-26 09:06:14] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:14.243485972  [2024-06-26 09:06:14] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:14.244039857  [2024-06-26 09:06:14] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:14.244841953  [2024-06-26 09:06:14] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:14.245856096  [2024-06-26 09:06:14] frigate.video                  ERROR   : dummy_camera: ffmpeg process is not running. exiting capture thread...
2024-06-26 09:06:23.176912525  [2024-06-26 09:06:23] watchdog.dummy_camera          ERROR   : Ffmpeg process crashed unexpectedly for dummy_camera.
2024-06-26 09:06:23.177310073  [2024-06-26 09:06:23] watchdog.dummy_camera          ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-06-26 09:06:24.371858985  [2024-06-26 09:06:24] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:24.372656999  [2024-06-26 09:06:24] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:24.374661074  [2024-06-26 09:06:24] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:24.374839869  [2024-06-26 09:06:24] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:24.375046372  [2024-06-26 09:06:24] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:24.375295168  [2024-06-26 09:06:24] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:24.375489130  [2024-06-26 09:06:24] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:24.375703800  [2024-06-26 09:06:24] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:24.376088223  [2024-06-26 09:06:24] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:24.376815944  [2024-06-26 09:06:24] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:24.377283202  [2024-06-26 09:06:24] frigate.video                  ERROR   : dummy_camera: ffmpeg process is not running. exiting capture thread...
2024-06-26 09:06:33.200409764  [2024-06-26 09:06:33] watchdog.dummy_camera          ERROR   : Ffmpeg process crashed unexpectedly for dummy_camera.
2024-06-26 09:06:33.200549183  [2024-06-26 09:06:33] watchdog.dummy_camera          ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-06-26 09:06:34.355601677  [2024-06-26 09:06:34] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:34.356034809  [2024-06-26 09:06:34] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:34.356154686  [2024-06-26 09:06:34] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:34.357141119  [2024-06-26 09:06:34] frigate.video                  ERROR   : dummy_camera: ffmpeg process is not running. exiting capture thread...
2024-06-26 09:06:43.240755121  [2024-06-26 09:06:43] watchdog.dummy_camera          ERROR   : Ffmpeg process crashed unexpectedly for dummy_camera.
2024-06-26 09:06:43.241067793  [2024-06-26 09:06:43] watchdog.dummy_camera          ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-06-26 09:06:44.401111955  [2024-06-26 09:06:44] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:44.401410043  [2024-06-26 09:06:44] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:44.401659131  [2024-06-26 09:06:44] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:44.402913027  [2024-06-26 09:06:44] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:44.403253407  [2024-06-26 09:06:44] frigate.video                  ERROR   : dummy_camera: Unable to read frames from ffmpeg process.
2024-06-26 09:06:44.404038004  [2024-06-26 09:06:44] frigate.video                  ERROR   : dummy_camera: ffmpeg process is not running. exiting capture thread...
2024-06-26 09:06:53.296544197  [2024-06-26 09:06:53] watchdog.dummy_camera          ERROR   : Ffmpeg process crashed unexpectedly for dummy_camera.
2024-06-26 09:06:53.296857744  [2024-06-26 09:06:53] watchdog.dummy_camera          ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.

Operating system

Debian

Install method

Docker Compose

Network connection

Wired

Camera make and model

Imou Life

Any other information that may be helpful

My docker compose file
version: "3.9"
services:
frigate:
container_name: frigate
privileged: true # this may not be necessary for all setups
restart: unless-stopped
image: ghcr.io/blakeblackshear/frigate:stable-rk
shm_size: "64mb" # update for your cameras based on calculation above
security_opt:
- apparmor=unconfined
- systempaths=unconfined
devices:
- /dev/dri
- /dev/dma_heap
- /dev/rga
- /dev/mpp_service
volumes:
- /etc/localtime:/etc/localtime:ro
- /mnt/NVME_2/Frigate:/config
- /mnt/NVME_2/Frigate/storage:/media/frigate
ports:
- "5000:5000"
- "8554:8554" # RTSP feeds
- "8555:8555/tcp" # WebRTC over tcp
- "8555:8555/udp" # WebRTC over udp
environment:
FRIGATE_RTSP_PASSWORD: "password"

[NickM-27]

This is most likely fixed already in 0.14, @MarcA711 can confirm

[ImCodingCat]

How do i switch to 0.14?

[MarcA711]

Hey,
yes, these issues will likely be gone in 0.14

0.14 is still in beta, so you might encounter some bugs. However, Rockchip runs pretty stable as far as I can tell.

To upgrade, first read the new docs:
https://deploy-preview-11419--frigate-docs.netlify.app/

Especially the prerequisites here:
https://deploy-preview-11419--frigate-docs.netlify.app/frigate/installation#rockchip-platform

Update instructions can be found here under "latest news":

#11502

[GMagician]

I had the same error, moved to 0.14 but this new version seems to have other issues, birdview works but hangs after some time and then works again. I'll do some logging check and report result as new issues if I have some remarkable info

[NickM-27]

I think that is just timing coincidence, the problem is clearly the model. You should follow the latest docs https://deploy-preview-11419--frigate-docs.netlify.app/configuration/object_detectors#configuration

[MarcA711]

The error was fixed here:
#12042

Unfortunately, the fix did not make it in beta3. You can try the latest dev image or you wait for beta4.

However, it is not sufficient to just set the path to a yolov8 model, since post processing is not implemented in frigate. You would need to write your own code for post processing.

May I ask why you don't want to switch to Yolonas? Is it because of Yolonas license? I don't know if the frigate maintainers allow it, but I thought about adding post-processing for yolov8. It can't be forbidden to implement your own code for post-processing of yolo...

[MarcA711]

Could You try if it works, if you use one of the Yolonas preset models by using: path: deci-fp16-yolonas_s

[GMagician]

Well, I didn't read yolonas licence yet, I come from a previous Frigate version and I was using yolov8. Not skilled enough to handle post models processing, I'm new in this field and trying to learn something.
I try to do some test

[MarcA711]

If you use frigate privately at home, the Yolonas license is no issue.

In this case I recommend using yolonas. We don't support yolov8 anymore and it seems that you have no specific reason to stick to it. You can just switch to Yolonas, there shouldn't be any noticeable differences and Yolonas performs even better. This will likely fix your issues. If not, just ask again.