[Support]: Problems with WebRTC and MSE on various platforms. #11731

lordratner · 2024-06-04T05:11:20Z

lordratner
Jun 4, 2024

Describe the problem you are having

I can't get the MSE and WebRTC streams to work reliably (or at all) on my phone.

Three cameras:
Nursery: h265 - Reolink RLC-822A
Living Room: h264 - Reolink E1
Litter Box: h264 - Reolink E1 Pro

On Chrome on my desktop, everything works on all three cameras.

On my Google Pixel 8 and Google Pixel 8 Pro running Chrome, JSMPEG works for everything. MSE only works for the two h264 cameras. WebRTC does not work on any camera.

If I use Firefox on the phones, the only difference is that MSE works on the h265 camera. WebRTC still does not work for any camera.

Version

0.13.1-34FB1C2

Frigate config file

mqtt:
  host: 192.168.30.105
  port: 1883
  user: frigate
  password: xxx

detectors:
  # coralusb:
  #   type: edgetpu
  #   device: usb
  coralpci1:
     type: edgetpu
     device: pci:0
  coralpci2:
     type: edgetpu
     device: pci:1

database:
  path: /media/frigate/frigate.db

logger:
  # Optional: Default log verbosity (default: shown below)
  default: info
  # Optional: Component specific logger overrides
#  logs:
#    frigate.event: debug

environment_vars:
  EXAMPLE_VAR: value

birdseye:
  enabled: True
  width: 1280
  height: 720
  # Optional: Encoding quality of the mpeg1 feed (default: shown below)
  # 1 is the highest quality, and 31 is the lowest. Lower quality feeds utilize less CPU resources.
  quality: 8
  # Optional: Mode of the view. Available options are: objects, motion, and continuous
  #   objects - cameras are included if they have had a tracked object within the last 30 seconds
  #   motion - cameras are included if motion was detected in the last 30 seconds
  #   continuous - all cameras are included always
  mode: motion

detect:
  fps: 5
  enabled: True
  # stationary:
  #   interval: 50
  #   threshold: 50

go2rtc:
  streams:
    living_room:
      - rtsp:https://frigate:[email protected]:554//h264Preview_01_main # <- stream which supports video & aac audio. This is only supported for rtsp streams, http must use ffmpeg
      - "ffmpeg:living_room#audio=opus" # <- copy of the stream which transcodes audio to opus
    living_room_sub:
      - rtsp:https://frigate:[email protected]:554//h264Preview_01_sub # <- stream which supports video & aac audio. This is only supported for rtsp streams, http must use ffmpeg
    nursery:
      - rtsp:https://frigate:[email protected]:554//h265Preview_01_main # <- stream which supports video & aac audio. This is only supported for rtsp streams, http must use ffmpeg
      - "ffmpeg:nursery#audio=opus" # <- copy of the stream which transcodes audio to opus
    nursery_sub:
      - rtsp:https://frigate:[email protected]:554//h264Preview_01_sub # <- stream which supports video & aac audio. This is only supported for rtsp streams, http must use ffmpeg

    litter_box:
      - http:https://192.168.41.101/flv?port=1935&app=bcs&stream=channel0_main.bcs&user=frigate&password=xxx# <- stream which supports video & aac audio. This is only supported for rtsp streams, http must use ffmpeg
      - "ffmpeg:litter_box#audio=opus" # <- copy of the stream which transcodes audio to opus
    litter_box_sub:
      - http:https://192.168.41.101/flv?port=1935&app=bcs&stream=channel0_ext.bcs&user=frigate&password=xxx # <- stream which supports video & aac audio. This is only supported for rtsp streams, http must use ffmpeg
  webrtc:
    candidates:
      - 192.168.30.125:8555

ffmpeg:
  hwaccel_args: preset-nvidia-h264

record:
  enabled: True
  expire_interval: 60
  retain:
    days: 0
    mode: all
  events:
    pre_capture: 5
    post_capture: 5
#    objects:
#      - cat
#    required_zones:
#    - feeder
    retain:
      default: 5
      mode: all

snapshots:
  enabled: True
  timestamp: True
  bounding_box: False
  crop: True
  retain:
    default: 7

# rtmp:
#   enabled: True

live:
  height: 720
  quality: 8

timestamp_style:
  position: "bl"
  format: "%Y/%m/%d %H:%M:%S"
  color:
    red: 252
    green: 111
    blue: 3
  thickness: 3

objects:
  track:
    - person
    - cat
  filters:
    cat:
      min_score: 0.5
      threshold: 0.6

cameras:
  living_room:
    ffmpeg:
      inputs:
        # - path: rtsp:https://127.0.0.1:8554/living_room_sub
        #   roles:
        #     - detect
        - path: rtsp:https://127.0.0.1:8554/living_room
          roles:
            - record
            - detect
    detect:
    #  width: 640 # <---- update for your camera's resolution
    #  height: 360 # <---- update for your camera's resolution
      width: 2560 # <---- update for your camera's resolution
      height: 1440 # <---- update for your camera's resolution
    objects:
      track:
        - person
        - cat
      filters:
        person:
          mask:
            - 2287,177,2303,355,2133,328,2167,151
    zones:
      feeders:
        coordinates: 0,563,0,1171,873,1440,1729,1005,1809,383,1336,184,1069,309,568,362
        objects:
          - cat
    snapshots:
      required_zones:
        - feeders
    record:
      enabled: True
      events:
        objects:
          - person
          - cat
        required_zones:
          - feeders
    mqtt:
      enabled: True
      timestamp: True
      bounding_box: False
      crop: True
      height: 500
      quality: 100
      #required_zones: []

  litter_box:
    ffmpeg:
      inputs:
#        - path: rtsp:https://127.0.0.1:8554/litter_box_sub
#          roles:
#            - detect
        - path: rtsp:https://127.0.0.1:8554/litter_box
          roles:
            - record
            - detect
    detect:
      width: 2560 # <---- update for your camera's resolution
      height: 1920 # <---- update for your camera's resolution
#      width: 640 # <---- update for your camera's resolution
#      height: 480 # <---- update for your camera's resolution
    objects:
      track:
        - cat
    zones:
      entrance:
        coordinates: 2202,1747,2161,759,2036,556,2014,302,1963,134,1700,0,1287,127,1192,453,917,633,894,1753
        objects:
          - cat
      litter_room:
        coordinates: 0,0,2560,0,2560,1920,0,1920
#         coordinates: 1251,743,1234,596,1267,480,1354,384,1465,338,1591,334,1756,397,1849,460,1907,568,1931,691,1913,817,1872>
        objects:
          - cat
#          - person
    snapshots:
      required_zones:
        - entrance
    record:
      enabled: True
      events:
        objects:
          - cat
        required_zones:
          - entrance
          - litter_room
    mqtt:
      enabled: True
      timestamp: True
      bounding_box: True
      crop: True
      height: 500
      quality: 100
      #required_zones: []

  nursery:
    ffmpeg:
      input_args: preset-rtsp-restream
      output_args:
        record: preset-record-generic-audio-copy
      inputs:
#        - path: rtsp:https://frigate:[email protected]:554//h264Preview_01_sub
#          roles:
#            - detect
        - path: rtsp:https://127.0.0.1:8554/nursery
          # input_args: preset-rtsp-restream
          roles:
            - record
            - detect
    detect:
      width: 2304 # <---- update for your camera's resolution
      height: 1296 # <---- update for your camera's resolution
      stationary:
        interval: 50
        threshold: 150
    objects:
      track:
        - person
        - cat
    zones:
      crib:
        coordinates: 541,1296,343,1063,773,641,1072,824,1101,905,760,1296
        objects:
         - person
         - cat
      changing_table:
        coordinates: 1543,469,1866,627,1655,1073,1237,874
        objects:
         - person
         - cat
      nursery_room:
        coordinates: 0,0,2304,0,2304,1296,0,1296
        objects:
          - cat
          - person
#    zones:
#      front_door:
#        coordinates: 690,1068,1394,1064,1490,276,579,277

#    snapshots:
#      required_zones:
#        - front_door
    record:
      enabled: True
      retain:
        days: 7
        mode: motion
      events:
        retain:
          default: 30
          mode: active_objects
          objects:
            person: 30
            cat: 7
        objects:
          - person
          - cat
        required_zones:
          - crib
          - changing_table
    mqtt:
      enabled: True
      timestamp: True
      bounding_box: False
      crop: True
      height: 500
      quality: 100
      #required_zones: []

Relevant log output

Nothing I can find

FFprobe output from your camera

Living Room:
[{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"40/3","codec_long_name":"H.264/AVC/MPEG-4AVC/MPEG-4part10","height":1440,"width":2560},{"avg_frame_rate":"0/0","codec_long_name":"AAC(AdvancedAudioCoding)"}]}}]

Litter Box:
[{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"0/0","codec_long_name":"H.264/AVC/MPEG-4AVC/MPEG-4part10","height":1920,"width":2560},{"avg_frame_rate":"0/0","codec_long_name":"AAC(AdvancedAudioCoding)"}]}}]

Nursery:
[{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"40/3","codec_long_name":"H.264/AVC/MPEG-4AVC/MPEG-4part10","height":1296,"width":2304},{"avg_frame_rate":"0/0","codec_long_name":"AAC(AdvancedAudioCoding)"}]}}]

Frigate stats

{
  "cameras": {
    "litter_box": {
      "audio_dBFS": 0,
      "audio_rms": 0,
      "camera_fps": 5.1,
      "capture_pid": 1289,
      "detection_enabled": 1,
      "detection_fps": 0,
      "ffmpeg_pid": 1303,
      "pid": 1285,
      "process_fps": 5.1,
      "skipped_fps": 0
    },
    "living_room": {
      "audio_dBFS": 0,
      "audio_rms": 0,
      "camera_fps": 5.1,
      "capture_pid": 1288,
      "detection_enabled": 1,
      "detection_fps": 0,
      "ffmpeg_pid": 1296,
      "pid": 1284,
      "process_fps": 5.1,
      "skipped_fps": 0
    },
    "nursery": {
      "audio_dBFS": 0,
      "audio_rms": 0,
      "camera_fps": 5,
      "capture_pid": 1294,
      "detection_enabled": 1,
      "detection_fps": 0,
      "ffmpeg_pid": 1300,
      "pid": 1287,
      "process_fps": 5,
      "skipped_fps": 0
    }
  },
  "cpu_usages": {
    "1": {
      "cmdline": "/package/admin/s6/command/s6-svscan -d4 -- /run/service",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "15": {
      "cmdline": "s6-supervise s6-linux-init-shutdownd",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "17": {
      "cmdline": "/package/admin/s6-linux-init/command/s6-linux-init-shutdownd -c /run/s6/basedir -g 3000 -C -B",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "24": {
      "cmdline": "s6-supervise s6rc-oneshot-runner",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "25": {
      "cmdline": "s6-supervise go2rtc-healthcheck",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "26": {
      "cmdline": "s6-supervise nginx",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "27": {
      "cmdline": "s6-supervise frigate-log",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "28": {
      "cmdline": "s6-supervise nginx-log",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "29": {
      "cmdline": "s6-supervise go2rtc-log",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "30": {
      "cmdline": "s6-supervise frigate",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "31": {
      "cmdline": "s6-supervise s6rc-fdholder",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "32": {
      "cmdline": "s6-supervise go2rtc",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "43": {
      "cmdline": "/package/admin/s6/command/s6-ipcserverd -1 -- /package/admin/s6/command/s6-ipcserver-access -v0 -E -l0 -i data/rules -- /package/admin/s6/command/s6-sudod -t 30000 -- /package/admin/s6-rc/command/s6-rc-oneshot-run -l ../.. --",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "44": {
      "cmdline": "/package/admin/s6-2.11.3.2/command/s6-fdholderd -1 -i data/rules",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "86": {
      "cmdline": "s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/nginx",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "89": {
      "cmdline": "s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/go2rtc",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "92": {
      "cmdline": "s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/frigate",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "106": {
      "cmdline": "/usr/local/go2rtc/bin/go2rtc -config=/dev/shm/go2rtc.yaml",
      "cpu": "2.6",
      "cpu_average": "3",
      "mem": "0.0"
    },
    "117": {
      "cmdline": "bash ./run.user go2rtc-healthcheck",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "122": {
      "cmdline": "python3 -u -m frigate",
      "cpu": "1.2",
      "cpu_average": "0",
      "mem": "0.5"
    },
    "130": {
      "cmdline": "nginx: master process nginx",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "135": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "136": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "137": {
      "cmdline": "nginx: worker process",
      "cpu": "0.2",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "138": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "139": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "140": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "141": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "142": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "143": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "144": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "145": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "146": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "147": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "148": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "149": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "536": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "537": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "538": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "539": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "540": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "541": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "542": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "543": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "544": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "545": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "546": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "547": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "548": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "549": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "550": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "551": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "552": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "553": {
      "cmdline": "nginx: cache manager process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "1221": {
      "cmdline": "frigate.logger       ",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.1"
    },
    "1223": {
      "cmdline": "frigate.recording_manager",
      "cpu": "1.3",
      "cpu_average": "1",
      "mem": "0.2"
    },
    "1232": {
      "cmdline": "/usr/bin/python3 -c from multiprocessing.resource_tracker import main;main(49)",
      "cpu": "0.2",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "1233": {
      "cmdline": "frigate.detector.coralpci1",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.2"
    },
    "1234": {
      "cmdline": "frigate.detector.coralpci2",
      "cpu": "0.1",
      "cpu_average": "0",
      "mem": "0.2"
    },
    "1235": {
      "cmdline": "frigate.output       ",
      "cpu": "1.3",
      "cpu_average": "1",
      "mem": "0.1"
    },
    "1240": {
      "cmdline": "ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 2560x1440 -i pipe: -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "1244": {
      "cmdline": "ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 2560x1920 -i pipe: -f mpegts -s 960x720 -codec:v mpeg1video -q 8 -bf 0 pipe:",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "1247": {
      "cmdline": "ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 2304x1296 -i pipe: -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "1258": {
      "cmdline": "ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "1284": {
      "cmdline": "frigate.process:living_room",
      "cpu": "0.6",
      "cpu_average": "0",
      "mem": "0.2"
    },
    "1285": {
      "cmdline": "frigate.process:litter_box",
      "cpu": "0.8",
      "cpu_average": "0",
      "mem": "0.2"
    },
    "1287": {
      "cmdline": "frigate.process:nursery",
      "cpu": "0.7",
      "cpu_average": "0",
      "mem": "0.2"
    },
    "1288": {
      "cmdline": "frigate.capture:living_room",
      "cpu": "3.5",
      "cpu_average": "3",
      "mem": "0.2"
    },
    "1289": {
      "cmdline": "frigate.capture:litter_box",
      "cpu": "4.5",
      "cpu_average": "4",
      "mem": "0.2"
    },
    "1294": {
      "cmdline": "frigate.capture:nursery",
      "cpu": "2.6",
      "cpu_average": "2",
      "mem": "0.2"
    },
    "1296": {
      "cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.1-34fb1c2 -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp:https://127.0.0.1:8554/living_room -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy -an /tmp/cache/living_room@%Y%m%d%H%M%S%z.mp4 -r 5 -vf fps=5,scale_cuda=w=2560:h=1440:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:",
      "cpu": "2.7",
      "cpu_average": "2",
      "mem": "0.2"
    },
    "1300": {
      "cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.1-34fb1c2 -rtsp_transport tcp -timeout 5000000 -i rtsp:https://127.0.0.1:8554/nursery -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy /tmp/cache/nursery@%Y%m%d%H%M%S%z.mp4 -r 5 -vf fps=5,scale_cuda=w=2304:h=1296:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:",
      "cpu": "2.5",
      "cpu_average": "2",
      "mem": "0.2"
    },
    "1303": {
      "cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.1-34fb1c2 -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp:https://127.0.0.1:8554/litter_box -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy -an /tmp/cache/litter_box@%Y%m%d%H%M%S%z.mp4 -r 5 -vf fps=5,scale_cuda=w=2560:h=1920:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:",
      "cpu": "3.5",
      "cpu_average": "3",
      "mem": "0.2"
    },
    "2983": {
      "cmdline": "ffmpeg -hide_banner -v error -fflags nobuffer -flags low_delay -timeout 5000000 -user_agent go2rtc/ffmpeg -rtsp_flags prefer_tcp -i rtsp:https://127.0.0.1:8554/litter_box?audio -c:a libopus -application:a lowdelay -frame_duration 20 -min_comp 0 -vn -user_agent ffmpeg/go2rtc -rtsp_transport tcp -f rtsp rtsp:https://127.0.0.1:8554/eec3ba5f158e34f19888f060ecd58eb3",
      "cpu": "0.1",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "3487": {
      "cmdline": "sleep 30s",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    }
  },
  "detection_fps": 0,
  "detectors": {
    "coralpci1": {
      "detection_start": 0,
      "inference_speed": 6.17,
      "pid": 1233
    },
    "coralpci2": {
      "detection_start": 0,
      "inference_speed": 6.17,
      "pid": 1234
    }
  },
  "gpu_usages": {
    "NVIDIA GeForce GTX 1070 Ti": {
      "dec": "12.0%",
      "enc": "0.0%",
      "gpu": "1.0%",
      "mem": "14.68%"
    }
  },
  "processes": {
    "go2rtc": {
      "pid": 106
    },
    "logger": {
      "pid": 1221
    },
    "recording": {
      "pid": 1223
    }
  },
  "service": {
    "last_updated": 1717477620,
    "latest_version": "0.13.2",
    "storage": {
      "/dev/shm": {
        "free": 2029.4,
        "mount_type": "tmpfs",
        "total": 2048,
        "used": 18.6
      },
      "/media/frigate/clips": {
        "free": 55587845,
        "mount_type": "nfs4",
        "total": 58354177,
        "used": 2766332
      },
      "/media/frigate/recordings": {
        "free": 55587845,
        "mount_type": "nfs4",
        "total": 58354177,
        "used": 2766332
      },
      "/tmp/cache": {
        "free": 1898.1,
        "mount_type": "tmpfs",
        "total": 1907.4,
        "used": 9.2
      }
    },
    "temperatures": {
      "apex_0": 71.05,
      "apex_1": 65.3
    },
    "uptime": 1508,
    "version": "0.13.1-34fb1c2"
  }
}

Operating system

Debian

Install method

Docker Compose

Coral version

PCIe

Network connection

Wired

Camera make and model

Reolink E1, E1 Pro, and RLC-822A

Any other information that may be helpful

go2rtc stream info:

{
  "litter_box": {
    "consumers": [
      {
        "medias": [
          "video, sendonly, H264, H265",
          "audio, sendonly, MPEG4-GENERIC"
        ],
        "remote_addr": "127.0.0.1:48996",
        "sdp": "v=0\r\no=- 1 1 IN IP4 0.0.0.0\r\ns=go2rtc/1.8.4\r\nc=IN IP4 0.0.0.0\r\nt=0 0\r\nm=video 0 RTP/AVP 96\r\na=rtpmap:96 H264/90000\r\na=fmtp:96 packetization-mode=1;profile-level-id=640033;sprop-parameter-sets=Z2QAM6wVFKAoAPGQ,aO48sA==\r\na=control:trackID=0\r\nm=audio 0 RTP/AVP 97\r\na=rtpmap:97 MPEG4-GENERIC/16000/1\r\na=fmtp:97 streamtype=5;profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3;config=1408\r\na=control:trackID=1\r\n",
        "send": 339874102,
        "senders": [
          "96 H264, bytes=323317693, receivers=1",
          "97 MPEG4-GENERIC/16000/1, bytes=12326400, receivers=1"
        ],
        "type": "RTSP passive consumer",
        "url": "rtsp:https://127.0.0.1:8554/litter_box",
        "user_agent": "FFmpeg Frigate/0.13.1-34fb1c2"
      },
      {
        "medias": [
          "audio, sendonly, ANY"
        ],
        "remote_addr": "127.0.0.1:56686",
        "sdp": "v=0\r\no=- 1 1 IN IP4 0.0.0.0\r\ns=go2rtc/1.8.4\r\nc=IN IP4 0.0.0.0\r\nt=0 0\r\nm=audio 0 RTP/AVP 96\r\na=rtpmap:96 MPEG4-GENERIC/16000/1\r\na=fmtp:96 streamtype=5;profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3;config=1408\r\na=control:trackID=0\r\n",
        "send": 3371816,
        "senders": [
          "96 MPEG4-GENERIC/16000/1, bytes=3245056, receivers=1"
        ],
        "type": "RTSP passive consumer",
        "url": "rtsp:https://127.0.0.1:8554/litter_box?audio",
        "user_agent": "go2rtc/ffmpeg"
      }
    ],
    "producers": [
      {
        "medias": [
          "video, recvonly, H.264 High 5.1",
          "audio, recvonly, MPEG4-GENERIC/16000/1"
        ],
        "receivers": [
          "255 H264, bytes=323316373, senders=1",
          "255 MPEG4-GENERIC/16000/1, bytes=12326400, senders=2"
        ],
        "recv": 335752822,
        "type": "FLV producer",
        "url": ""
      },
      {
        "url": "ffmpeg:litter_box#audio=opus"
      }
    ]
  },
  "litter_box_sub": {
    "consumers": null,
    "producers": [
      {
        "url": "http:https://192.168.41.101/flv?port=1935&app=bcs&stream=channel0_ext.bcs&user=*&password=*"
      }
    ]
  },
  "living_room": {
    "consumers": [
      {
        "medias": [
          "video, sendonly, H264, H265",
          "audio, sendonly, MPEG4-GENERIC"
        ],
        "remote_addr": "127.0.0.1:48994",
        "sdp": "v=0\r\no=- 1 1 IN IP4 0.0.0.0\r\ns=go2rtc/1.8.4\r\nc=IN IP4 0.0.0.0\r\nt=0 0\r\nm=video 0 RTP/AVP 96\r\na=rtpmap:96 H264/90000\r\na=fmtp:96 packetization-mode=1;profile-level-id=640033;sprop-parameter-sets=Z2QAM6zoAoALWQ==,aO48sA==\r\na=control:trackID=0\r\nm=audio 0 RTP/AVP 97\r\na=rtpmap:97 MPEG4-GENERIC/16000\r\na=fmtp:97 streamtype=5;profile-level-id=15;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3;config=1408; profile=1;\r\na=control:trackID=1\r\n",
        "send": 468021229,
        "senders": [
          "96 H264, bytes=454044355, receivers=1",
          "97 MPEG4-GENERIC/16000, bytes=12420636, receivers=1"
        ],
        "type": "RTSP passive consumer",
        "url": "rtsp:https://127.0.0.1:8554/living_room",
        "user_agent": "FFmpeg Frigate/0.13.1-34fb1c2"
      }
    ],
    "producers": [
      {
        "medias": [
          "video, recvonly, H.264 High 5.1",
          "audio, recvonly, MPEG4-GENERIC/16000"
        ],
        "receivers": [
          "96 H264, bytes=454044355, senders=1",
          "97 MPEG4-GENERIC/16000, bytes=12420636, senders=1"
        ],
        "recv": 467768879,
        "remote_addr": "192.168.41.100:554",
        "sdp": "v=0\r\no=- 1562112000730311 1 IN IP4 192.168.41.100\r\ns=Session streamed by \"preview\"\r\ni=h264Preview_01_main\r\nt=0 0\r\na=tool:LIVE555 Streaming Media v2013.04.08\r\na=type:broadcast\r\na=control:*\r\na=range:npt=0-\r\na=x-qt-text-nam:Session streamed by \"preview\"\r\na=x-qt-text-inf:h264Preview_01_main\r\nm=video 0 RTP/AVP 96\r\nc=IN IP4 0.0.0.0\r\nb=AS:500\r\na=rtpmap:96 H264/90000\r\na=range:npt=0-\r\na=fmtp:96 packetization-mode=1;profile-level-id=640033;sprop-parameter-sets=Z2QAM6zoAoALWQ==,aO48sA==\r\na=control:trackID=1\r\nm=audio 0 RTP/AVP 97\r\nc=IN IP4 0.0.0.0\r\nb=AS:256\r\na=rtpmap:97 MPEG4-GENERIC/16000\r\na=fmtp:97 streamtype=5;profile-level-id=15;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3;config=1408; profile=1;\r\na=control:trackID=2\r\n",
        "type": "RTSP active producer",
        "url": "rtsp:https://192.168.41.100/h264Preview_01_main/",
        "user_agent": "go2rtc/1.8.4"
      },
      {
        "url": "ffmpeg:living_room#audio=opus"
      }
    ]
  },
  "living_room_sub": {
    "consumers": null,
    "producers": [
      {
        "url": "rtsp:https://*:*@192.168.41.100:554//h264Preview_01_sub"
      }
    ]
  },
  "nursery": {
    "consumers": [
      {
        "medias": [
          "video, sendonly, H264, H265",
          "audio, sendonly, MPEG4-GENERIC"
        ],
        "remote_addr": "127.0.0.1:48982",
        "sdp": "v=0\r\no=- 1 1 IN IP4 0.0.0.0\r\ns=go2rtc/1.8.4\r\nc=IN IP4 0.0.0.0\r\nt=0 0\r\nm=video 0 RTP/AVP 96\r\na=rtpmap:96 H264/90000\r\na=fmtp:96 packetization-mode=1;profile-level-id=640033;sprop-parameter-sets=Z2QAM6wVFKAkAKOQ,aO48sA==\r\na=control:trackID=0\r\nm=audio 0 RTP/AVP 97\r\na=rtpmap:97 MPEG4-GENERIC/16000\r\na=fmtp:97 streamtype=5;profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3;config=1408\r\na=control:trackID=1\r\n",
        "send": 667170663,
        "senders": [
          "96 H264, bytes=646844983, receivers=1",
          "97 MPEG4-GENERIC/16000, bytes=12585472, receivers=1"
        ],
        "type": "RTSP passive consumer",
        "url": "rtsp:https://127.0.0.1:8554/nursery",
        "user_agent": "FFmpeg Frigate/0.13.1-34fb1c2"
      },
      {
        "medias": [
          "video, sendonly, H264",
          "audio, sendonly, MPEG4-GENERIC, PCMA, PCMU, L16, PCML, OPUS"
        ],
        "remote_addr": "192.168.20.211, 127.0.0.1:58724",
        "send": 181121155,
        "senders": [
          "96 H264, bytes=176886334, receivers=1",
          "97 MPEG4-GENERIC/16000, bytes=3442386, receivers=1"
        ],
        "type": "MSE/WebSocket active consumer",
        "user_agent": "Mozilla/5.0 (Android 14; Mobile; rv:126.0) Gecko/126.0 Firefox/126.0"
      }
    ],
    "producers": [
      {
        "medias": [
          "video, recvonly, H.264 High 5.1",
          "audio, recvonly, MPEG4-GENERIC/16000"
        ],
        "receivers": [
          "96 H264, bytes=646844983, senders=2",
          "97 MPEG4-GENERIC/16000, bytes=12585472, senders=2"
        ],
        "recv": 665265611,
        "remote_addr": "192.168.41.102:554",
        "sdp": "v=0\r\no=- 1717311606570203 1 IN IP4 192.168.41.102\r\ns=Session streamed by \"preview\"\r\ni=h265Preview_01_main\r\nt=0 0\r\na=tool:LIVE555 Streaming Media v2020.08.12\r\na=type:broadcast\r\na=control:*\r\na=range:npt=0-\r\na=x-qt-text-nam:Session streamed by \"preview\"\r\na=x-qt-text-inf:h265Preview_01_main\r\nm=video 0 RTP/AVP 96\r\nc=IN IP4 0.0.0.0\r\nb=AS:500\r\na=rtpmap:96 H264/90000\r\na=fmtp:96 packetization-mode=1;profile-level-id=640033;sprop-parameter-sets=Z2QAM6wVFKAkAKOQ,aO48sA==\r\na=control:track1\r\nm=audio 0 RTP/AVP 97\r\nc=IN IP4 0.0.0.0\r\nb=AS:256\r\na=rtpmap:97 MPEG4-GENERIC/16000\r\na=fmtp:97 streamtype=5;profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3;config=1408\r\na=control:track2\r\n",
        "type": "RTSP active producer",
        "url": "rtsp:https://192.168.41.102/h265Preview_01_main/",
        "user_agent": "go2rtc/1.8.4"
      },
      {
        "url": "ffmpeg:nursery#audio=opus"
      }
    ]
  },
  "nursery_sub": {
    "consumers": null,
    "producers": [
      {
        "url": "rtsp:https://*:*@192.168.41.102:554//h264Preview_01_sub"
      }
    ]
  }
}

lineumaciel · 2024-06-04T07:41:33Z

lineumaciel
Jun 4, 2024

This is how the new automatic livemode works. I have similar symptoms. As far as getting MSE under control, like you sometimes MSE closes stream for no reason. This works nice on desktop browsers but on ios it is a bit tiresome

1 reply

hawkeye217 Jun 4, 2024
Collaborator

The user is not using 0.14-beta, so this is a different issue.

NickM-27 · 2024-06-04T12:15:54Z

NickM-27
Jun 4, 2024
Collaborator Sponsor

webrtc does not support h.265 so we already expect that to not work on some cameras. not seeing anything obvious of why it isn't working for the h.264 cameras

0 replies

lordratner · 2024-06-04T13:06:07Z

lordratner
Jun 4, 2024
Author

That's what I thought, yet it does work on a desktop. Does frigate convert to h264 based on my config? I've hesitated to upgrade because I wanted to get this sorted out, but maybe I need to and just hope it fixes?

…

On Tue, Jun 4, 2024, 07:16 Nicolas Mowen ***@***.***> wrote: webrtc does not support h.265 so we already expect that to not work on some cameras. not seeing anything obvious of why it isn't working for the h.264 cameras — Reply to this email directly, view it on GitHub <#11731 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ALZSL5UCEDAXJJJY2EELN5TZFWVY7AVCNFSM6AAAAABIXX2NZKVHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM4TMNRTHA3TE> . You are receiving this because you authored the thread.Message ID: ***@***.*** com>

1 reply

NickM-27 Jun 4, 2024
Collaborator Sponsor

no, there is no transcoding occurring

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Support]: Problems with WebRTC and MSE on various platforms. #11731

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 3 comments 2 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

[Support]: Problems with WebRTC and MSE on various platforms. #11731

lordratner Jun 4, 2024

Describe the problem you are having

Version

Frigate config file

Relevant log output

FFprobe output from your camera

Frigate stats

Operating system

Install method

Coral version

Network connection

Camera make and model

Any other information that may be helpful

Replies: 3 comments · 2 replies

lineumaciel Jun 4, 2024

hawkeye217 Jun 4, 2024 Collaborator

NickM-27 Jun 4, 2024 Collaborator Sponsor

lordratner Jun 4, 2024 Author

NickM-27 Jun 4, 2024 Collaborator Sponsor

lordratner
Jun 4, 2024

Replies: 3 comments 2 replies

lineumaciel
Jun 4, 2024

hawkeye217 Jun 4, 2024
Collaborator

NickM-27
Jun 4, 2024
Collaborator Sponsor

lordratner
Jun 4, 2024
Author

NickM-27 Jun 4, 2024
Collaborator Sponsor