[Support]: New Beta UI is extremely slow to save config changes #11609

jftanner · 2024-05-29T02:36:16Z

jftanner
May 29, 2024

Describe the problem you are having

In the new beta UI (which is fantastic, btw!) any operation which edits the config file takes roughly 30 seconds to complete. Looking at the network traffic and server logs, it appears to be the PUT /api/config/set endpoint which takes a long time to return.

This is a mild inconvenience when creating/updating camera groups. But it's downright painful when trying to configure masks or zones, since each zone/mask change must be saved before moving on to others.

I suspect this is a bug, but perhaps it's caused by something in config file? Some sort of regex backtracking, perhaps?

Version

0.14.0-b97e274

Frigate config file

# yaml-language-server: $schema=https://frigate.local/api/config/schema.json

mqtt:
  host: [REDACTED]
  port: 1883
  user: '{FRIGATE_MQTT_USER}'
  password: '{FRIGATE_MQTT_PASSWORD}'

detectors:
  coral:
    type: edgetpu
    device: pci:0

ffmpeg:
  hwaccel_args: preset-vaapi
  input_args: preset-rtsp-restream
  output_args:
    record: preset-record-generic-audio-copy

# These can be assumed from the camera feeds.
# detect:
#   width: 1280
#   height: 720
#   fps: 5

model:
  labelmap: # Simplify the labels to merge commonly-confused types
    2: car # Car
    3: car # Motorcycle
    5: car # Bus
    7: car # Car (Truck)
    #16: animal # Cat
    #17: animal # Dog
    #18: animal # Horse
    #22: animal # Bear

objects:
  track:
    - person
    - face
    - license_plate
    - dog
    - cat
    - car
    - amazon
    - fedex
    - ups
    - package

record:
  enabled: true

snapshots:
  enabled: true
  timestamp: true
  bounding_box: true
  crop: false

ui:
  live_mode: webrtc

camera_groups:
  Back:
    order: 1
    icon: LuDog
    cameras:
      - backyard_cam
      - garden_cam
      - porch_cam
  Front:
    order: 2
    icon: LuDoorClosed
    cameras:
      - front_cam
      - driveway_cam
      - garden_cam

go2rtc:
  streams:
    driveway_cam:
      - rtsp:https://{FRIGATE_RTSP_USER}:{FRIGATE_RTSP_PASSWORD}@[REDACTED]/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:driveway_cam#audio=opus
    driveway_cam_sub:
      - rtsp:https://{FRIGATE_RTSP_USER}:{FRIGATE_RTSP_PASSWORD}@[REDACTED]/cam/realmonitor?channel=1&subtype=2
    front_cam:
      - rtsp:https://{FRIGATE_RTSP_USER}:{FRIGATE_RTSP_PASSWORD}@[REDACTED]/cam/realmonitor?channel=2&subtype=0
      - ffmpeg:front_cam#audio=opus
    front_cam_sub:
      - rtsp:https://{FRIGATE_RTSP_USER}:{FRIGATE_RTSP_PASSWORD}@[REDACTED]/cam/realmonitor?channel=2&subtype=2
    porch_cam:
      - rtsp:https://{FRIGATE_RTSP_USER}:{FRIGATE_RTSP_PASSWORD}@[REDACTED]/cam/realmonitor?channel=3&subtype=0
      - ffmpeg:porch_cam#audio=opus
    porch_cam_sub:
      - rtsp:https://{FRIGATE_RTSP_USER}:{FRIGATE_RTSP_PASSWORD}@[REDACTED]/cam/realmonitor?channel=3&subtype=2
    backyard_cam:
      - rtsp:https://{FRIGATE_RTSP_USER}:{FRIGATE_RTSP_PASSWORD}@[REDACTED]/cam/realmonitor?channel=4&subtype=0
      - ffmpeg:backyard_cam#audio=opus
    backyard_cam_sub:
      - rtsp:https://{FRIGATE_RTSP_USER}:{FRIGATE_RTSP_PASSWORD}@[REDACTED]/cam/realmonitor?channel=4&subtype=2
    garden_cam:
      - rtsp:https://{FRIGATE_RTSP_USER}:{FRIGATE_RTSP_PASSWORD}@[REDACTED]/cam/realmonitor?channel=5&subtype=0
      - ffmpeg:garden_cam#audio=opus
    garden_cam_sub:
      - rtsp:https://{FRIGATE_RTSP_USER}:{FRIGATE_RTSP_PASSWORD}@[REDACTED]/cam/realmonitor?channel=5&subtype=2
  webrtc:
    candidates:
      - [REDACTED]:8555
      - stun:8555

cameras:
  driveway_cam:
    ui:
      order: 1
    ffmpeg:
      inputs:
        - path: rtsp:https://127.0.0.1:8554/driveway_cam_sub
          roles:
            - detect
        - path: rtsp:https://127.0.0.1:8554/driveway_cam
          input_args: preset-rtsp-restream
          roles:
            - record
    snapshots:
      required_zones:
        - driveway
        - frontyard
    motion:
      mask: 1,0,1,0.349,0.761,0.201,0.525,0.146,0.351,0.158,0.159,0.172,0,0.202,0,0
    zones:
      driveway:
        coordinates: 334,1080,976,1080,959,327,1349,358,1310,281,985,228,762,242,554,546,385,813
      parking:
        coordinates: 1,1,1,0.546,0.848,0.345,0.716,0.286,0.735,0.384,0.509,0.358,0.521,1
        inertia: 3
      frontyard:
        coordinates: 554,546,385,813,223,513,77,290,164,259,726,239
    review:
      alerts:
        required_zones:
          - driveway
          - frontyard
  front_cam:
    ui:
      order: 2
    ffmpeg:
      inputs:
        - path: rtsp:https://127.0.0.1:8554/front_cam_sub
          roles:
            - detect
        - path: rtsp:https://127.0.0.1:8554/front_cam
          roles:
            - record
    motion:
      mask:
        - 1920,0,1920,433,1294,344,190,388,0,450,0,0
    zones:
      driveway:
        coordinates: 1920,418,1920,1080,1274,438,963,304,1148,296
      frontyard:
        coordinates: 1920,1080,0,1080,0,430,272,329,963,304,1274,438

  porch_cam:
    ui:
      order: 3
    ffmpeg:
      inputs:
        - path: rtsp:https://127.0.0.1:8554/porch_cam_sub
          roles:
            - detect
        - path: rtsp:https://127.0.0.1:8554/porch_cam
          roles:
            - record
    motion:
      mask:
        - 1255,233,793,146,458,142,276,200,236,0,1920,0,1920,473
    zones:
      porch:
        coordinates: 304,181,404,185,639,221,659,412,1022,876,813,1057,468,586,122,754,0,199,229,128
      backyard:
        coordinates: 
          825,1057,1061,896,736,501,704,343,903,270,1920,655,1920,1080,830,1080,302,1080,164,791,448,627

  backyard_cam:
    ui:
      order: 4
    ffmpeg:
      inputs:
        - path: rtsp:https://127.0.0.1:8554/backyard_cam_sub
          roles:
            - detect
        - path: rtsp:https://127.0.0.1:8554/backyard_cam
          roles:
            - record
    motion:
      mask:
        - 0,0,0,433,257,292,604,149,804,86,1002,38,1426,98,1920,248,1920,0

  garden_cam:
    ui:
      order: 5
    ffmpeg:
      inputs:
        - path: rtsp:https://127.0.0.1:8554/garden_cam_sub
          roles:
            - detect
        - path: rtsp:https://127.0.0.1:8554/garden_cam
          roles:
            - record
    motion:
      mask:
        - 359,0,1920,0,1920,466,1476,159,895,21,532,21,357,49,197,81,0,144,0,0

Relevant log output

frigate  | 2024-05-28 22:12:24.708612608  ::ffff:192.168.50.132 - - [28/May/2024:22:12:24 -0400] "PUT /api/config/set?cameras.driveway_cam.motion.mask=1,0,1,0.349,0.761,0.201,0.525,0.146,0.351,0.158,0.159,0.172,0,0.202,0,0& HTTP/1.1" 200 75 "https://frigate.local/settings" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36 Edg/125.0.0.0" "-"
frigate  | 2024-05-28 22:12:24.730042199  ::ffff:192.168.50.132 - - [28/May/2024:22:12:24 -0400] "GET /api/config HTTP/1.1" 200 31552 "https://frigate.local/settings" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36 Edg/125.0.0.0" "-"

FFprobe output from your camera

N/A

Frigate stats

{
    "cameras": {
        "backyard_cam": {
            "audio_dBFS": 0,
            "audio_rms": 0,
            "camera_fps": 5,
            "capture_pid": 499,
            "detection_enabled": true,
            "detection_fps": 5,
            "ffmpeg_pid": 506,
            "pid": 439,
            "process_fps": 5,
            "skipped_fps": 0
        },
        "driveway_cam": {
            "audio_dBFS": 0,
            "audio_rms": 0,
            "camera_fps": 5.1,
            "capture_pid": 465,
            "detection_enabled": true,
            "detection_fps": 0.2,
            "ffmpeg_pid": 485,
            "pid": 428,
            "process_fps": 5.1,
            "skipped_fps": 0
        },
        "front_cam": {
            "audio_dBFS": 0,
            "audio_rms": 0,
            "camera_fps": 5,
            "capture_pid": 479,
            "detection_enabled": true,
            "detection_fps": 0,
            "ffmpeg_pid": 488,
            "pid": 429,
            "process_fps": 5,
            "skipped_fps": 0
        },
        "garden_cam": {
            "audio_dBFS": 0,
            "audio_rms": 0,
            "camera_fps": 5.1,
            "capture_pid": 504,
            "detection_enabled": true,
            "detection_fps": 0,
            "ffmpeg_pid": 524,
            "pid": 447,
            "process_fps": 5.1,
            "skipped_fps": 0
        },
        "porch_cam": {
            "audio_dBFS": 0,
            "audio_rms": 0,
            "camera_fps": 5,
            "capture_pid": 487,
            "detection_enabled": true,
            "detection_fps": 5.2,
            "ffmpeg_pid": 500,
            "pid": 433,
            "process_fps": 5,
            "skipped_fps": 0
        }
    },
    "cpu_usages": {
        "1": {
            "cmdline": "/package/admin/s6/command/s6-svscan -d4 -- /run/service",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.0"
        },
        "14": {
            "cmdline": "s6-supervise s6-linux-init-shutdownd",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.0"
        },
        "16": {
            "cmdline": "/package/admin/s6-linux-init/command/s6-linux-init-shutdownd -c /run/s6/basedir -g 3000 -C -B",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.0"
        },
        "23": {
            "cmdline": "s6-supervise s6rc-oneshot-runner",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.0"
        },
        "24": {
            "cmdline": "s6-supervise go2rtc-log",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.0"
        },
        "25": {
            "cmdline": "s6-supervise s6rc-fdholder",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.0"
        },
        "26": {
            "cmdline": "s6-supervise nginx",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.0"
        },
        "27": {
            "cmdline": "s6-supervise nginx-log",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.0"
        },
        "28": {
            "cmdline": "s6-supervise go2rtc-healthcheck",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.0"
        },
        "29": {
            "cmdline": "s6-supervise frigate-log",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.0"
        },
        "30": {
            "cmdline": "s6-supervise go2rtc",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.0"
        },
        "31": {
            "cmdline": "s6-supervise frigate",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.0"
        },
        "42": {
            "cmdline": "/package/admin/s6-2.11.3.2/command/s6-fdholderd -1 -i data/rules",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.0"
        },
        "43": {
            "cmdline": "/package/admin/s6/command/s6-ipcserverd -1 -- /package/admin/s6/command/s6-ipcserver-access -v0 -E -l0 -i data/rules -- /package/admin/s6/command/s6-sudod -t 30000 -- /package/admin/s6-rc/command/s6-rc-oneshot-run -l ../.. --",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.0"
        },
        "80": {
            "cmdline": "s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/nginx",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.0"
        },
        "82": {
            "cmdline": "s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/go2rtc",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.0"
        },
        "83": {
            "cmdline": "s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/frigate",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.0"
        },
        "90": {
            "cmdline": "/usr/local/go2rtc/bin/go2rtc -config=/dev/shm/go2rtc.yaml",
            "cpu": "10.6",
            "cpu_average": "10",
            "mem": "0.7"
        },
        "110": {
            "cmdline": "bash ./run.user go2rtc-healthcheck",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.0"
        },
        "111": {
            "cmdline": "python3 -u -m frigate",
            "cpu": "4.2",
            "cpu_average": "4",
            "mem": "11.7"
        },
        "120": {
            "cmdline": "nginx: master process nginx",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.2"
        },
        "146": {
            "cmdline": "nginx: worker process",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.1"
        },
        "147": {
            "cmdline": "nginx: worker process",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.1"
        },
        "148": {
            "cmdline": "nginx: worker process",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.1"
        },
        "152": {
            "cmdline": "nginx: worker process",
            "cpu": "0.1",
            "cpu_average": "0",
            "mem": "0.1"
        },
        "162": {
            "cmdline": "nginx: cache manager process",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.1"
        },
        "298": {
            "cmdline": "frigate.logger       ",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "1.8"
        },
        "368": {
            "cmdline": "frigate.recording_manager",
            "cpu": "9.9",
            "cpu_average": "8",
            "mem": "2.4"
        },
        "377": {
            "cmdline": "frigate.review_segment_manager",
            "cpu": "0.6",
            "cpu_average": "0",
            "mem": "2.1"
        },
        "396": {
            "cmdline": "/usr/bin/python3 -c from multiprocessing.resource_tracker import main;main(65)",
            "cpu": "0.4",
            "cpu_average": "0",
            "mem": "0.1"
        },
        "397": {
            "cmdline": "frigate.detector.coral",
            "cpu": "2.9",
            "cpu_average": "2",
            "mem": "2.2"
        },
        "401": {
            "cmdline": "frigate.output       ",
            "cpu": "5.3",
            "cpu_average": "3",
            "mem": "2.1"
        },
        "428": {
            "cmdline": "frigate.process:driveway_cam",
            "cpu": "2.0",
            "cpu_average": "3",
            "mem": "2.6"
        },
        "429": {
            "cmdline": "frigate.process:front_cam",
            "cpu": "1.7",
            "cpu_average": "1",
            "mem": "2.7"
        },
        "432": {
            "cmdline": "ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1920x1080 -i pipe: -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.2"
        },
        "433": {
            "cmdline": "frigate.process:porch_cam",
            "cpu": "3.8",
            "cpu_average": "3",
            "mem": "2.6"
        },
        "439": {
            "cmdline": "frigate.process:backyard_cam",
            "cpu": "3.8",
            "cpu_average": "3",
            "mem": "2.9"
        },
        "441": {
            "cmdline": "ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1920x1080 -i pipe: -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.2"
        },
        "447": {
            "cmdline": "frigate.process:garden_cam",
            "cpu": "1.7",
            "cpu_average": "1",
            "mem": "2.4"
        },
        "465": {
            "cmdline": "frigate.capture:driveway_cam",
            "cpu": "3.3",
            "cpu_average": "3",
            "mem": "2.2"
        },
        "479": {
            "cmdline": "frigate.capture:front_cam",
            "cpu": "3.5",
            "cpu_average": "3",
            "mem": "2.2"
        },
        "482": {
            "cmdline": "ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1920x1080 -i pipe: -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.2"
        },
        "485": {
            "cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.14.0-b97e274 -rtsp_transport tcp -timeout 5000000 -i rtsp:https://127.0.0.1:8554/driveway_cam_sub -r 5 -vf fps=5,scale_vaapi=w=1920:h=1080:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:",
            "cpu": "5.8",
            "cpu_average": "5",
            "mem": "0.9"
        },
        "487": {
            "cmdline": "frigate.capture:porch_cam",
            "cpu": "3.1",
            "cpu_average": "3",
            "mem": "2.2"
        },
        "488": {
            "cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.14.0-b97e274 -rtsp_transport tcp -timeout 5000000 -i rtsp:https://127.0.0.1:8554/front_cam_sub -r 5 -vf fps=5,scale_vaapi=w=1920:h=1080:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:",
            "cpu": "5.9",
            "cpu_average": "5",
            "mem": "0.9"
        },
        "499": {
            "cmdline": "frigate.capture:backyard_cam",
            "cpu": "3.3",
            "cpu_average": "3",
            "mem": "2.2"
        },
        "500": {
            "cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.14.0-b97e274 -rtsp_transport tcp -timeout 5000000 -i rtsp:https://127.0.0.1:8554/porch_cam_sub -r 5 -vf fps=5,scale_vaapi=w=1920:h=1080:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:",
            "cpu": "5.2",
            "cpu_average": "5",
            "mem": "1.1"
        },
        "503": {
            "cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.14.0-b97e274 -rtsp_transport tcp -timeout 5000000 -i rtsp:https://127.0.0.1:8554/front_cam -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy /tmp/cache/front_cam@%Y%m%d%H%M%S%z.mp4",
            "cpu": "0.8",
            "cpu_average": "0",
            "mem": "0.4"
        },
        "504": {
            "cmdline": "frigate.capture:garden_cam",
            "cpu": "3.4",
            "cpu_average": "3",
            "mem": "2.2"
        },
        "506": {
            "cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.14.0-b97e274 -rtsp_transport tcp -timeout 5000000 -i rtsp:https://127.0.0.1:8554/backyard_cam_sub -r 5 -vf fps=5,scale_vaapi=w=1920:h=1080:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:",
            "cpu": "5.6",
            "cpu_average": "5",
            "mem": "1.1"
        },
        "510": {
            "cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.14.0-b97e274 -rtsp_transport tcp -timeout 5000000 -i rtsp:https://127.0.0.1:8554/driveway_cam -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy /tmp/cache/driveway_cam@%Y%m%d%H%M%S%z.mp4",
            "cpu": "1.0",
            "cpu_average": "0",
            "mem": "0.4"
        },
        "512": {
            "cmdline": "ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1920x1080 -i pipe: -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.2"
        },
        "524": {
            "cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.14.0-b97e274 -rtsp_transport tcp -timeout 5000000 -i rtsp:https://127.0.0.1:8554/garden_cam_sub -r 5 -vf fps=5,scale_vaapi=w=1920:h=1080:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:",
            "cpu": "5.8",
            "cpu_average": "5",
            "mem": "0.9"
        },
        "525": {
            "cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.14.0-b97e274 -rtsp_transport tcp -timeout 5000000 -i rtsp:https://127.0.0.1:8554/backyard_cam -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy /tmp/cache/backyard_cam@%Y%m%d%H%M%S%z.mp4",
            "cpu": "0.8",
            "cpu_average": "0",
            "mem": "0.3"
        },
        "526": {
            "cmdline": "ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1920x1080 -i pipe: -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.2"
        },
        "533": {
            "cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.14.0-b97e274 -rtsp_transport tcp -timeout 5000000 -i rtsp:https://127.0.0.1:8554/garden_cam -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy /tmp/cache/garden_cam@%Y%m%d%H%M%S%z.mp4",
            "cpu": "0.8",
            "cpu_average": "0",
            "mem": "0.4"
        },
        "534": {
            "cmdline": "ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.2"
        },
        "634": {
            "cmdline": "/usr/bin/python3 -c from multiprocessing.resource_tracker import main;main(54)",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.1"
        },
        "13480": {
            "cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.14.0-b97e274 -rtsp_transport tcp -timeout 5000000 -i rtsp:https://127.0.0.1:8554/porch_cam -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy /tmp/cache/porch_cam@%Y%m%d%H%M%S%z.mp4",
            "cpu": "0.9",
            "cpu_average": "0",
            "mem": "0.3"
        },
        "15313": {
            "cmdline": "sleep 30s",
            "cpu": "0.0",
            "cpu_average": "0",
            "mem": "0.0"
        },
        "frigate.full_system": {
            "cpu": "27.0",
            "mem": "43.5"
        }
    },
    "detection_fps": 10.4,
    "detectors": {
        "coral": {
            "detection_start": 0,
            "inference_speed": 7.67,
            "pid": 397
        }
    },
    "gpu_usages": {
        "intel-vaapi": {
            "gpu": "1.4%",
            "mem": "-%"
        }
    },
    "processes": {
        "go2rtc": {
            "pid": 90
        },
        "logger": {
            "pid": 298
        },
        "recording": {
            "pid": 368
        },
        "review_segment": {
            "pid": 377
        }
    },
    "service": {
        "last_updated": 1716949254,
        "latest_version": "0.13.2",
        "storage": {
            "/dev/shm": {
                "free": 1006.3,
                "mount_type": "tmpfs",
                "total": 1024,
                "used": 17.7
            },
            "/media/frigate/clips": {
                "free": 328117.7,
                "mount_type": "ext4",
                "total": 467850.7,
                "used": 115895.7
            },
            "/media/frigate/recordings": {
                "free": 328117.7,
                "mount_type": "ext4",
                "total": 467850.7,
                "used": 115895.7
            },
            "/tmp/cache": {
                "free": 910.8,
                "mount_type": "tmpfs",
                "total": 953.7,
                "used": 42.9
            }
        },
        "temperatures": {
            "apex_0": 64.8
        },
        "uptime": 4296,
        "version": "0.14.0-b97e274"
    }
}

Operating system

Debian

Install method

Docker Compose

Coral version

M.2

Network connection

Wireless

Camera make and model

N/A

Any other information that may be helpful

Frigate is running on a micro-pc in a docker container. The computer is equipped with an SSD, and frigate is only storing events, not everything, so disk speed shouldn't be a factor. In fact, while waiting for the API call to return, top never showed an io-wait above 0.8%.

It's also not network or other general slowness, as everything else (including restreaming 4k video) works great.

Answered by hawkeye217

May 29, 2024

I have a hunch. Can you change your config and manually specify the correct detect width and height for your cameras?

For example:

cameras:
...
  garden_cam:
    detect:
      height: 720
      width: 1280
      fps: 5

Then, after restarting with those changes, try saving a mask/zone again.

View full answer

hawkeye217 · 2024-05-29T02:46:24Z

hawkeye217
May 29, 2024
Collaborator

As you noted, the frontend is just making an api call to update your Frigate config file's yaml and write it out to disk, so the delay is likely happening somewhere on the backend. This operation takes less than 1 second for me.

Does the amount of time frigate has been running affect the speed? If you restart Frigate and try to edit a mask/zone, does it perform any better than if Frigate has been running for a few hours?

16 replies

jftanner May 29, 2024
Author

Heh. I didn't see your comment until I'd already finished doing just that. The lag was not where I expected it to be!

These are the logs:

frigate  | 2024-05-28 23:27:08.509718450  [2024-05-28 23:27:08] root                           INFO    : Starting config_set
frigate  | 2024-05-28 23:27:08.509843469  [2024-05-28 23:27:08] root                           INFO    : Loading old config
frigate  | 2024-05-28 23:27:08.510349733  [2024-05-28 23:27:08] root                           INFO    : Calling update_yaml_from_url
frigate  | 2024-05-28 23:27:08.742130761  [2024-05-28 23:27:08] root                           INFO    : Loading new config
frigate  | 2024-05-28 23:27:08.747319412  [2024-05-28 23:27:08] root                           INFO    : Validating new config
frigate  | 2024-05-28 23:27:08.764809490  [2024-05-28 23:27:08] root                           INFO    : Checking if restart is required
frigate  | 2024-05-28 23:27:37.535941685  [2024-05-28 23:27:37] root                           INFO    : Sending response

All the config and file stuff is super fast (quarter second), but the checking for restart takes a whopping 29 seconds.

For reference, here's the relevant code with my injected logs:

    logging.info("Checking if restart is required")
    json = request.get_json(silent=True) or {}

    if json.get("requires_restart", 1) == 0:
        current_app.frigate_config = FrigateConfig.runtime_config(
            config_obj, current_app.plus_api
        )

    logging.info("Sending response")
    return make_response(
        jsonify(
            {
                "success": True,
                "message": "Config successfully updated, restart to apply",
            }
        ),
        200,
    )

I think request.get_json just be the thing taking all the time, because I'm pretty sure that it's not dropping into that if statement (my change does, in fact, require a restart.) I'll double-check that and keep digging. Though, likely it'll have to be tomorrow.

hawkeye217 May 29, 2024
Collaborator

No, it's likely that the pydantic runtime_config call is what's taking the time there. I didn't write that part of the code, but the requires_restart flag logic looks like it's actually backward to the way it would be intuitively understood. "Requires restart to take effect in the runtime config" might be a better way to alias the variable in pseudocode. So a 0 value would mean that, no, a restart is not required to apply this value to the runtime config.

We don't apply zones dynamically in the rest of the codebase, so this should really be changed in the frontend so that requires_restart is passed as 1, bypassing that check in the backend.

The only other thing that would matter for that though would be motion settings. Those are applied dynamically. Does changing values and hitting Save in the Motion Tuner also take a long time? I would guess that it would...

jftanner May 29, 2024
Author

No, it's likely that the pydantic runtime_config call is what's taking the time there.

You're absolutely correct.

With updated logging:

logging.info("Calling request.get_json")
    json = request.get_json(silent=True) or {}

    logging.info("Checking requires_restart")
    if json.get("requires_restart", 1) == 0:
        logging.info("Applying new config")
        current_app.frigate_config = FrigateConfig.runtime_config(
            config_obj, current_app.plus_api
        )
    else:
        logging.info("Config required restart, no change.")

    logging.info("Sending response")
    return make_response(
        jsonify(
            {
                "success": True,
                "message": "Config successfully updated, restart to apply",
            }
        ),
        200,
    )

Saving a mask:

frigate  | 2024-05-28 23:55:21.644330780  [2024-05-28 23:55:21] root                           INFO    : Starting config_set
frigate  | 2024-05-28 23:55:21.644442744  [2024-05-28 23:55:21] root                           INFO    : Loading old config
frigate  | 2024-05-28 23:55:21.645146051  [2024-05-28 23:55:21] root                           INFO    : Calling update_yaml_from_url
frigate  | 2024-05-28 23:55:21.879306454  [2024-05-28 23:55:21] root                           INFO    : Loading new config
frigate  | 2024-05-28 23:55:21.884955689  [2024-05-28 23:55:21] root                           INFO    : Validating new config
frigate  | 2024-05-28 23:55:21.907903113  [2024-05-28 23:55:21] root                           INFO    : Calling request.get_json
frigate  | 2024-05-28 23:55:21.908210829  [2024-05-28 23:55:21] root                           INFO    : Checking requires_restart
frigate  | 2024-05-28 23:55:21.908214482  [2024-05-28 23:55:21] root                           INFO    : Applying new config
frigate  | 2024-05-28 23:55:50.647533901  [2024-05-28 23:55:50] root                           INFO    : Sending response

So, it does save the config, so it's FrigateConfig.runtime_config that is taking all that time.

So a 0 value would mean that, no, a restart is not required to apply this value to the runtime config.

That's how I read it, but I thought that masks did require a restart. Though, I only think that because the UI tells me that. So, perhaps they're a related problem: the UI thinks that a restart is required when it's not?

I hadn't realized that that json was the request itself. But that makes sense. (Did I mention that I'm weak in Python? :D)

Does changing values and hitting Save in the Motion Tuner also take a long time?

Yep. Identical behavior.

frigate  | 2024-05-28 23:58:40.334367157  [2024-05-28 23:58:40] root                           INFO    : Applying new config
[lots of cam/latest logs removed]
frigate  | 2024-05-28 23:59:08.930523811  [2024-05-28 23:59:08] root                           INFO    : Sending response

hawkeye217 May 29, 2024
Collaborator

I have a hunch. Can you change your config and manually specify the correct detect width and height for your cameras?

For example:

cameras:
...
  garden_cam:
    detect:
      height: 720
      width: 1280
      fps: 5

Then, after restarting with those changes, try saving a mask/zone again.

Answer selected by jftanner

jftanner May 29, 2024
Author

Yup. That's set in the request. I totally missed that.

jftanner May 29, 2024
Author

Sorry for the wait. Restarting takes a while too. Unrelated to this, it seems to always hang on exiting with this:

usr/lib/python3.9/multiprocessing/resource_tracker.py:216: UserWarning: resource_tracker: There appear to be 4 leaked shared_memory objects to clean up at shutdown

But that's for another issue. :D

Can you change your config and manually specify the correct detect width and height for your cameras?

Yep! No problem. I already had it in there before but removed it when I saw it was no longer required.

Your hunch was absolutely spot-on.

I added the global detect settings:

detect:
  width: 1920
  height: 1080
  fps: 5

And I got:

frigate  | 2024-05-29 00:12:46.815216606  [2024-05-29 00:12:46] root                           INFO    : Starting config_set
frigate  | 2024-05-29 00:12:46.817842453  [2024-05-29 00:12:46] root                           INFO    : Loading old config
frigate  | 2024-05-29 00:12:46.817851760  [2024-05-29 00:12:46] root                           INFO    : Calling update_yaml_from_url
frigate  | 2024-05-29 00:12:47.060426003  [2024-05-29 00:12:47] root                           INFO    : Loading new config
frigate  | 2024-05-29 00:12:47.065655596  [2024-05-29 00:12:47] root                           INFO    : Validating new config
frigate  | 2024-05-29 00:12:47.081663215  [2024-05-29 00:12:47] root                           INFO    : Calling request.get_json
frigate  | 2024-05-29 00:12:47.082478407  [2024-05-29 00:12:47] root                           INFO    : Checking requires_restart
frigate  | 2024-05-29 00:12:47.082712827  [2024-05-29 00:12:47] root                           INFO    : Applying new config
frigate  | 2024-05-29 00:12:47.118290515  [2024-05-29 00:12:47] root                           INFO    : Sending response

Total time: 0.3s!

I have no idea how you came up with that, but that was it. :)

jftanner May 29, 2024
Author

If there's anything I can do to help make fixes, I'd be happy to take a crack at it.

For example, I'm sure I could find and implement:

this should really be changed in the frontend so that requires_restart is passed as 1, bypassing that check in the backend.

hawkeye217 May 29, 2024
Collaborator

Great!

The reason why this worked is because when you don't manually set a detect resolution in your config, Frigate runs ffprobe on all of your cameras when initializing to determine their resolution. The runtime_config function is what does this at startup, and when it's called again on config changes from the UI, it has to run through all of that again.

A positive side effect of this is that your startup time may be faster now.

There are a few things in the code worth looking at, and I'll discuss the way forward with the other devs in the morning. For now at least, we know how to mitigate the issue.

Thanks for your help! Users like you make fixing bugs a lot easier for us.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Support]: New Beta UI is extremely slow to save config changes #11609

{{title}}

Replies: 1 comment 16 replies

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

[Support]: New Beta UI is extremely slow to save config changes #11609

jftanner May 29, 2024

Describe the problem you are having

Version

Frigate config file

Relevant log output

FFprobe output from your camera

Frigate stats

Operating system

Install method

Coral version

Network connection

Camera make and model

Any other information that may be helpful

Replies: 1 comment · 16 replies

hawkeye217 May 29, 2024 Collaborator

jftanner May 29, 2024 Author

hawkeye217 May 29, 2024 Collaborator

jftanner May 29, 2024 Author

hawkeye217 May 29, 2024 Collaborator

jftanner May 29, 2024 Author

jftanner May 29, 2024 Author

jftanner May 29, 2024 Author

hawkeye217 May 29, 2024 Collaborator

jftanner
May 29, 2024

Replies: 1 comment 16 replies

hawkeye217
May 29, 2024
Collaborator

jftanner May 29, 2024
Author

hawkeye217 May 29, 2024
Collaborator

jftanner May 29, 2024
Author

hawkeye217 May 29, 2024
Collaborator

jftanner May 29, 2024
Author

jftanner May 29, 2024
Author

jftanner May 29, 2024
Author

hawkeye217 May 29, 2024
Collaborator