[Bug]: Video stops updating after random period of time #13047

xtj7 · 2024-08-14T05:30:26Z

xtj7
Aug 14, 2024

Describe the problem you are having

After some time of having the video stream open, it stops working. In both full screen mode as well as the overview when live video is enabled with active ongoing movement. This can sometimes take 10 minutes, sometimes an hour, but eventually the video stops updating and never starts again - even with movement being actively detected by frigate.

I have had this issue before on 0.13 when viewing a camera in MSE, so I switched the camera to WebRTC and it ran 24 hours no problem, every day. Unfortunately it seems in 0.14 I can no longer force WebRTC and the intelligent stream selection favors MSE, which would explain the issue. All cameras are RTSP streams, that I restream through go2rtc. I have both a Coral TPU as well as a Quadro P2000 for acceleration, which are both utilised and work fine just like they did in 0.13

I should mention that MSE streams have been problematic for me on multiple devices, Chrome in Linux as well as Android. So this is not a client problem with a specific device.

Steps to reproduce

Open a video stream (that presumably uses MSE?), wait between several minutes and an hour, video will stop updating.

Version

0.14.0

Frigate config file

record:
  enabled: true
  retain:
    days: 7
    mode: all
  events:
    retain:
      default: 30
      mode: active_objects

detect:
  enabled: true
  width: 1280
  height: 720
  fps: 5
  max_disappeared: 25
  stationary:
    interval: 50
    threshold: 50
    max_frames:
      default: 3000
      objects:
        person: 1000

detectors:
  coral:
    type: edgetpu
    device: usb

objects:
  track:
    - person

birdseye:
  enabled: true
  mode: continuous
  width: 1920
  height: 1080

mqtt:
  enabled: true
  host: 192.168.0.11
  port: 1883
  user: frigate
  password: 123456

ffmpeg:
  output_args:
    record: preset-record-generic-audio-aac

go2rtc:
  streams:
    bedroom:
      - ffmpeg:rtsp://admin:[email protected]:554/stream1#input=rtsp/udp#video=h264#audio=aac#hardware=cuda
    bedroom_sub:
      - ffmpeg:rtsp://admin:[email protected]:554/stream2#input=rtsp/udp#video=h264#audio=aac#hardware=cuda
    babyroom:
      - ffmpeg:rtsp://admin:[email protected]:554/stream1#input=rtsp/udp#video=h264#audio=aac#hardware=cuda
    babyroom_sub:
      - ffmpeg:rtsp://admin:[email protected]:554/stream2#input=rtsp/udp#video=h264#audio=aac#hardware=cuda
    livingroom:
      - ffmpeg:rtsp://admin:[email protected]:554/stream1#input=rtsp/udp#video=h264#audio=aac#hardware=cuda
    livingroom_sub:
      - ffmpeg:rtsp://admin:[email protected]:554/stream2#input=rtsp/udp#video=h264#audio=aac#hardware=cuda
    livingroom2:
      - ffmpeg:rtsp://admin:[email protected]:554/stream1#input=rtsp/udp#video=h264#audio=aac#hardware=cuda
    livingroom2_sub:
      - ffmpeg:rtsp://admin:[email protected]:554/stream2#input=rtsp/udp#video=h264#audio=aac#hardware=cuda
    office:
      - ffmpeg:rtsp://admin:[email protected]:554/stream1#input=rtsp/udp#video=h264#audio=aac#hardware=cuda
    office_sub:
      - ffmpeg:rtsp://admin:[email protected]:554/stream2#input=rtsp/udp#video=h264#audio=aac#hardware=cuda
    kitchen:
      - ffmpeg:rtsp://admin:[email protected]:554/stream1#input=rtsp/udp#video=h264#audio=aac#hardware=cuda
    kitchen_sub:
      - ffmpeg:rtsp://admin:[email protected]:554/stream2#input=rtsp/udp#video=h264#audio=aac#hardware=cuda
    hallway:
      - ffmpeg:rtsp://admin:[email protected]:554/stream1#input=rtsp/udp#video=h264#audio=aac#hardware=cuda
    hallway_sub:
      - ffmpeg:rtsp://admin:[email protected]:554/stream2#input=rtsp/udp#video=h264#audio=aac#hardware=cuda
  webrtc:
    candidates:
      - 192.168.0.10:8555
      - stun:8555

cameras:
  bedroom:
    enabled: true
    birdseye:
      order: 6
    ffmpeg:
      hwaccel_args: preset-nvidia-h264
      inputs:
        - path: rtsp://192.168.0.10:8554/bedroom
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://192.168.0.10:8554/bedroom_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    detect:
      width: 800
      height: 448
    motion:
      mask: 0.007,0.076,0.008,0.004,0.207,0.011,0.206,0.063
  livingroom:
    enabled: true
    birdseye:
      order: 2
    ffmpeg:
      hwaccel_args: preset-nvidia-h264
      inputs:
        - path: rtsp://192.168.0.10:8554/livingroom
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://192.168.0.10:8554/livingroom_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    detect:
      width: 800
      height: 448
    motion:
      mask:
        - 0.007,0.07,0.21,0.072,0.219,0.004,0.014,-0.001
        - 0.068,0.285,0.054,0.134,0.224,0.134,0.227,0.252
  hallway:
    enabled: true
    birdseye:
      order: 5
    ffmpeg:
      hwaccel_args: preset-nvidia-h264
      inputs:
        - path: rtsp://192.168.0.10:8554/hallway
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://192.168.0.10:8554/hallway_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    detect:
      width: 800
      height: 448
    motion:
      mask: 0.01,0.072,0.008,0.007,0.219,0.004,0.217,0.063
  livingroom2:
    enabled: true
    birdseye:
      order: 1
    ffmpeg:
      hwaccel_args: preset-nvidia-h264
      inputs:
        - path: rtsp://192.168.0.10:8554/livingroom2
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://192.168.0.10:8554/livingroom2_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    detect:
      width: 800
      height: 448
    motion:
      mask: 0.003,0.074,0.219,0.059,0.213,-0.005,0.004,-0.001
  kitchen:
    enabled: true
    birdseye:
      order: 3
    ffmpeg:
      hwaccel_args: preset-nvidia-h264
      inputs:
        - path: rtsp://192.168.0.10:8554/kitchen
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://192.168.0.10:8554/kitchen_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    detect:
      width: 800
      height: 448
    motion:
      mask: 0.005,0.001,0.222,0.007,0.224,0.078,0.009,0.088
  babyroom:
    enabled: true
    birdseye:
      order: 8
    ffmpeg:
      hwaccel_args: preset-nvidia-h264
      inputs:
        - path: rtsp://192.168.0.10:8554/babyroom
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://192.168.0.10:8554/babyroom_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    detect:
      width: 800
      height: 448
    motion:
      mask: 0.006,0.013,0.212,0.004,0.217,0.08,0.005,0.07
  entrance:
    enabled: true
    birdseye:
      order: 4
    ffmpeg:
      hwaccel_args: preset-nvidia-h265
      inputs:
        - path: rtsp://admin:[email protected]:554/onvif1
          input_args: -rtsp_transport udp
          roles:
            - record
            - detect
    detect:
      width: 800
      height: 448
  office:
    enabled: true
    birdseye:
      order: 7
    ffmpeg:
      hwaccel_args: preset-nvidia-h264
      inputs:
        - path: rtsp://192.168.0.10:8554/office
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://192.168.0.10:8554/office_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    detect:
      width: 800
      height: 448
    motion:
      mask: 0.005,0.076,0.219,0.063,0.212,0.003,0.008,0.004
version: 0.14
camera_groups:
  Bedrooms:
    order: 1
    icon: LuBed
    cameras:
      - babyroom
      - bedroom

Relevant log output

There is nothing in the logs when this issue happens.

Operating system

Other Linux

Install method

Docker Compose

Network connection

Wired

Camera make and model

Hamrol 4K 8MP Fisheye IP Security Camera (PoE)

Any other information that may be helpful

As mentioned in #12695 one possibility would be to give us back a setting to prefer WebRTC over MSE? I believe that could already fix the issue for me, although we might still want to figure out why MSE keeps cutting out after some time. Which may be entirely something within my setup, but I could not figure out what. I had the same problem with previous cameras as well, MSE never worked stable for extended periods of time for me, while WebRTC worked perfectly in my setup.

On another note I have to say, despite my complaints: 0.14 is a massive step up from 0.13 and you have my respects for such an incredible update. It makes frigate infinitely more usable and I love it.

Answered by hawkeye217

Aug 17, 2024

I have a PR up (#13143) with these improvements and more that should mitigate your issues. If you're still having problems, let me know and we can debug further. Thanks for your help to test this code!

View full answer

hawkeye217 · 2024-08-14T11:00:04Z

hawkeye217
Aug 14, 2024
Collaborator

There are a few possibilities why this might be happening.

In Frigate, navigate to the live stream of a single camera. Open your browser dev tools to the Network pane, select the WS option to only view websockets, and look for a ws?src=<camera_name> entry. Click on that entry, and then choose the "Response" tab in the inspector pane.

You should see video data coming through the socket.

When the video stops visually, do you see this data still streaming?

It'd be helpful to see a screenshot of the first few entries of this pane as well, just as you start streaming a single camera.

12 replies

xtj7 Aug 16, 2024
Author

Well, I jinxed it by reporting too early I suppose, haha. First one stream stopped, then the second. Both while there was still activity and while frigate was showing the little icon for "person detected". I did not notice any drift before it crashed, so maybe my theory of this being the problem behind the video stopping is wrong. Nonetheless, your fix definitely appears to have resolved the drift issue, because that was steadily increasing before and is now remaining constant.

Back to the video stopping, interesting about the media-internals is: the pipeline_state of that player is STILL kPlaying. The last message is "pipeline_buffering_state": DEMUXER_UNDERFLOW with BUFFERING_HAVE_NOTHING, as previously reported. But then it just stays there, as if it does not care that the buffer is empty and remains empty without the player ever getting destroyed. I will also leave it open on my Mac next, so I can verify if the websocket messages stop or continue when it is in this state.

And lastly I will leave the "stopped" streams open on my dashboard until there is no activity anymore, to see if frigate catches that, kills the player and then restarts the stream when activity resumes. Because I have the suspicion it does.

The mystery is not quite resolved yet, but this is a big step in the right direction :)

hawkeye217 Aug 16, 2024
Collaborator

You should be seeing logs in the browser console with my build as well. When the stream stops, can you send those as well?

xtj7 Aug 16, 2024
Author

That is great to know, I will do that.
One small update: when the activity stopped it did in fact switch back to the static mode and once activity resumed, it picked up the refresh.

What somewhat puzzles me: usually I get very chatty updates in the console, about every second or so? And it looks like this:
kitchen normal playback rate 0.32002699999998185 0.5623372499999846
But just now, even after a refresh, when I looked at the N100 computer, I saw one single message:
kitchen normal playback rate 0 0
And no further updates, while it had the red border around it and the icon for person detected. It was clearly not in MSE mode but in the static mode (I am not sure if I use the correct terminology, apologies) with infrequent image updates like every second or so.
After some more refreshing it finally switched back to MSE mode and I have chatty updates.

Worth mentioning while that happened: that camera was fully in the viewport the entire time. I am aware that once it leaves the viewport you switch away from the MSE stream to the static view, which is a great feature. But the kitchen camera has not left the viewport, so it should have been in the faster MSE mode.

Once I get logs from the stream stopping, I will post them here.

hawkeye217 Aug 16, 2024
Collaborator

Thanks, those numbers look good and the frequency of updates in the console is expected. Would be helpful to see those numbers when the stream stops unexpectedly after running for a while.

hawkeye217 Aug 16, 2024
Collaborator

I've made some improvements just now - if you're able, can you pull my latest build and test? ghcr.io/hawkeye217/frigate:dev-c20c598

hawkeye217 · 2024-08-14T11:33:35Z

hawkeye217
Aug 14, 2024
Collaborator

Additionally, if you could use Chrome for this test and in another tab, open chrome://media-internals/ and look at the stream's log. When the stream visually stops, what do you see in the player properties and the log?

2 replies

xtj7 Aug 16, 2024
Author

Just now the stream died again and this time I got the full logs. This is still with version 0.14, not using your proposed fix yet. I will test that next.

Player Properties:

render_id: 11
player_id: 239
created: 2024-08-16 01:52:36.127815 UTC
origin_url: http://192.168.0.10:5000/
kFrameUrl: http://192.168.0.10:5000/
kFrameTitle: Live - Frigate
url: blob:http://192.168.0.10:5000/5fba067d-a421-49a6-b747-860e583a77e5
info: Selected FFmpegVideoDecoder for video decoding, config: codec: h264, profile: h264 high, level: not available, alpha_mode: is_opaque, coded size: [2560,1440], visible rect: [0,0,2560,1440], natural size: [2560,1440], has extra data: false, encryption scheme: Unencrypted, rotation: 0°, flipped: 0, color space: {primaries:BT709, transfer:BT709, matrix:BT709, range:LIMITED}
kRendererName: RendererImpl
pipeline_state: kPlaying
kVideoTracks: [object Object]
kAudioTracks: [object Object]
event: kPlay
kIsAudioDecryptingDemuxerStream: false
kAudioDecoderName: FFmpegAudioDecoder
kIsPlatformAudioDecoder: false
debug: (Log limit reached. Further similar entries may be suppressed): Media segment did not contain any coded frames for track 2, mismatching initialization segment. Therefore, MSE coded frame processing may not interoperably detect discontinuities in appended media.
kIsVideoDecryptingDemuxerStream: false
kVideoDecoderName: FFmpegVideoDecoder
kIsPlatformVideoDecoder: false
duration: unknown
dimensions: 2560x1440
kResolution: 2560x1440
pipeline_buffering_state: [object Object]
audio_buffering_state: [object Object]
kVideoPlaybackRoughness: 28.125
kVideoPlaybackFreezing: 0.051425
kFramerate: 15

Log:

{
  "properties": {
    "render_id": 11,
    "player_id": 239,
    "created": "2024-08-16 01:52:36.127815 UTC",
    "origin_url": "http://192.168.0.10:5000/",
    "kFrameUrl": "http://192.168.0.10:5000/",
    "kFrameTitle": "Live - Frigate",
    "url": "blob:http://192.168.0.10:5000/5fba067d-a421-49a6-b747-860e583a77e5",
    "info": "Selected FFmpegVideoDecoder for video decoding, config: codec: h264, profile: h264 high, level: not available, alpha_mode: is_opaque, coded size: [2560,1440], visible rect: [0,0,2560,1440], natural size: [2560,1440], has extra data: false, encryption scheme: Unencrypted, rotation: 0°, flipped: 0, color space: {primaries:BT709, transfer:BT709, matrix:BT709, range:LIMITED}",
    "kRendererName": "RendererImpl",
    "pipeline_state": "kPlaying",
    "kVideoTracks": [
      {
        "alpha mode": "is_opaque",
        "codec": "h264",
        "coded size": "2560x1440",
        "color space": {
          "matrix": "BT709",
          "primaries": "BT709",
          "range": "LIMITED",
          "transfer": "BT709"
        },
        "encryption scheme": "Unencrypted",
        "has extra data": false,
        "hdr metadata": "unset",
        "natural size": "2560x1440",
        "orientation": "0°",
        "profile": "h264 high",
        "visible rect": "0,0 2560x1440"
      }
    ],
    "kAudioTracks": [
      {
        "bytes per channel": 2,
        "bytes per frame": 2,
        "channel layout": "MONO",
        "channels": 1,
        "codec": "aac",
        "codec delay": 0,
        "discard decoder delay": false,
        "encryption scheme": "Unencrypted",
        "has extra data": false,
        "profile": "unknown",
        "sample format": "Signed 16-bit",
        "samples per second": 8000,
        "seek preroll": "0us"
      }
    ],
    "event": "kPlay",
    "kIsAudioDecryptingDemuxerStream": false,
    "kAudioDecoderName": "FFmpegAudioDecoder",
    "kIsPlatformAudioDecoder": false,
    "debug": "(Log limit reached. Further similar entries may be suppressed): Media segment did not contain any coded frames for track 2, mismatching initialization segment. Therefore, MSE coded frame processing may not interoperably detect discontinuities in appended media.",
    "kIsVideoDecryptingDemuxerStream": false,
    "kVideoDecoderName": "FFmpegVideoDecoder",
    "kIsPlatformVideoDecoder": false,
    "duration": "unknown",
    "dimensions": "2560x1440",
    "kResolution": "2560x1440",
    "pipeline_buffering_state": {
      "for_suspended_start": false,
      "reason": "DEMUXER_UNDERFLOW",
      "state": "BUFFERING_HAVE_NOTHING"
    },
    "audio_buffering_state": {
      "reason": "DEMUXER_UNDERFLOW",
      "state": "BUFFERING_HAVE_NOTHING"
    },
    "kVideoPlaybackRoughness": 28.125,
    "kVideoPlaybackFreezing": 0.051425,
    "kFramerate": 15
  },
  "events": [
    {
      "time": 0,
      "key": "created",
      "value": "2024-08-16 01:52:36.127815 UTC"
    },
    {
      "time": 0.17099999636411667,
      "key": "origin_url",
      "value": "http://192.168.0.10:5000/"
    },
    {
      "time": 0.17599999904632568,
      "key": "kFrameUrl",
      "value": "http://192.168.0.10:5000/"
    },
    {
      "time": 0.17999999970197678,
      "key": "kFrameTitle",
      "value": "Live - Frigate"
    },
    {
      "time": 0.2719999998807907,
      "key": "url",
      "value": "blob:http://192.168.0.10:5000/5fba067d-a421-49a6-b747-860e583a77e5"
    },
    {
      "time": 0.3179999962449074,
      "key": "info",
      "value": "ChunkDemuxer"
    },
    {
      "time": 0.33799999952316284,
      "key": "kRendererName",
      "value": "RendererImpl"
    },
    {
      "time": 9.689000003039837,
      "key": "pipeline_state",
      "value": "kStarting"
    },
    {
      "time": 35.876999996602535,
      "key": "kVideoTracks",
      "value": [
        {
          "alpha mode": "is_opaque",
          "codec": "h264",
          "coded size": "2560x1440",
          "color space": {
            "matrix": "BT709",
            "primaries": "BT709",
            "range": "LIMITED",
            "transfer": "BT709"
          },
          "encryption scheme": "Unencrypted",
          "has extra data": false,
          "hdr metadata": "unset",
          "natural size": "2560x1440",
          "orientation": "0°",
          "profile": "h264 high",
          "visible rect": "0,0 2560x1440"
        }
      ]
    },
    {
      "time": 35.94500000029802,
      "key": "kAudioTracks",
      "value": [
        {
          "bytes per channel": 2,
          "bytes per frame": 2,
          "channel layout": "MONO",
          "channels": 1,
          "codec": "aac",
          "codec delay": 0,
          "discard decoder delay": false,
          "encryption scheme": "Unencrypted",
          "has extra data": false,
          "profile": "unknown",
          "sample format": "Signed 16-bit",
          "samples per second": 8000,
          "seek preroll": "0us"
        }
      ]
    },
    {
      "time": 59.306000001728535,
      "key": "info",
      "value": "Effective playback rate changed from 0 to 1"
    },
    {
      "time": 59.45099999755621,
      "key": "event",
      "value": "kPlay"
    },
    {
      "time": 91.79999999701977,
      "key": "kIsAudioDecryptingDemuxerStream",
      "value": false
    },
    {
      "time": 91.81000000238419,
      "key": "kAudioDecoderName",
      "value": "FFmpegAudioDecoder"
    },
    {
      "time": 91.81199999898672,
      "key": "kIsPlatformAudioDecoder",
      "value": false
    },
    {
      "time": 91.8640000000596,
      "key": "info",
      "value": "Selected FFmpegAudioDecoder for audio decoding, config: codec: aac, profile: unknown, bytes_per_channel: 2, channel_layout: MONO, channels: 1, samples_per_second: 8000, sample_format: Signed 16-bit, bytes_per_frame: 2, seek_preroll: 0us, codec_delay: 0, has extra data: false, encryption scheme: Unencrypted, discard decoder delay: false, target_output_channel_layout: STEREO, target_output_sample_format: Unknown sample format, has aac extra data: true"
    },
    {
      "time": 92.02600000053644,
      "key": "debug",
      "value": "Video rendering in low delay mode."
    },
    {
      "time": 92.13700000196695,
      "key": "info",
      "value": "Cannot select DecryptingVideoDecoder for video decoding"
    },
    {
      "time": 92.14999999850988,
      "key": "info",
      "value": "Cannot select VaapiVideoDecoder for video decoding"
    },
    {
      "time": 92.17599999904633,
      "key": "info",
      "value": "Cannot select VpxVideoDecoder for video decoding"
    },
    {
      "time": 92.19200000166893,
      "key": "info",
      "value": "Cannot select Dav1dVideoDecoder for video decoding"
    },
    {
      "time": 94.8779999986291,
      "key": "kIsVideoDecryptingDemuxerStream",
      "value": false
    },
    {
      "time": 94.88499999791384,
      "key": "kVideoDecoderName",
      "value": "FFmpegVideoDecoder"
    },
    {
      "time": 94.8859999999404,
      "key": "kIsPlatformVideoDecoder",
      "value": false
    },
    {
      "time": 94.92300000041723,
      "key": "info",
      "value": "Selected FFmpegVideoDecoder for video decoding, config: codec: h264, profile: h264 high, level: not available, alpha_mode: is_opaque, coded size: [2560,1440], visible rect: [0,0,2560,1440], natural size: [2560,1440], has extra data: false, encryption scheme: Unencrypted, rotation: 0°, flipped: 0, color space: {primaries:BT709, transfer:BT709, matrix:BT709, range:LIMITED}"
    },
    {
      "time": 94.97999999672174,
      "key": "pipeline_state",
      "value": "kPlaying"
    },
    {
      "time": 36.02799999713898,
      "key": "duration",
      "value": "unknown"
    },
    {
      "time": 3259.1459999978542,
      "key": "debug",
      "value": "Media segment did not contain any coded frames for track 2, mismatching initialization segment. Therefore, MSE coded frame processing may not interoperably detect discontinuities in appended media."
    },
    {
      "time": 3259.3039999976754,
      "key": "debug",
      "value": "Media segment did not contain any coded frames for track 2, mismatching initialization segment. Therefore, MSE coded frame processing may not interoperably detect discontinuities in appended media."
    },
    {
      "time": 3259.314999997616,
      "key": "debug",
      "value": "Media segment did not contain any coded frames for track 2, mismatching initialization segment. Therefore, MSE coded frame processing may not interoperably detect discontinuities in appended media."
    },
    {
      "time": 3259.3250000029802,
      "key": "debug",
      "value": "Media segment did not contain any coded frames for track 1, mismatching initialization segment. Therefore, MSE coded frame processing may not interoperably detect discontinuities in appended media."
    },
    {
      "time": 3259.3310000002384,
      "key": "debug",
      "value": "Media segment did not contain any coded frames for track 1, mismatching initialization segment. Therefore, MSE coded frame processing may not interoperably detect discontinuities in appended media."
    },
    {
      "time": 3259.337999999523,
      "key": "debug",
      "value": "Media segment did not contain any coded frames for track 2, mismatching initialization segment. Therefore, MSE coded frame processing may not interoperably detect discontinuities in appended media."
    },
    {
      "time": 3312.7149999961257,
      "key": "dimensions",
      "value": "2560x1440"
    },
    {
      "time": 3312.7299999967217,
      "key": "kResolution",
      "value": "2560x1440"
    },
    {
      "time": 3759.872999995947,
      "key": "debug",
      "value": "Media segment did not contain any coded frames for track 2, mismatching initialization segment. Therefore, MSE coded frame processing may not interoperably detect discontinuities in appended media."
    },
    {
      "time": 3769.947999998927,
      "key": "debug",
      "value": "Media segment did not contain any coded frames for track 2, mismatching initialization segment. Therefore, MSE coded frame processing may not interoperably detect discontinuities in appended media."
    },
    {
      "time": 3788.429999999702,
      "key": "debug",
      "value": "Media segment did not contain any coded frames for track 2, mismatching initialization segment. Therefore, MSE coded frame processing may not interoperably detect discontinuities in appended media."
    },
    {
      "time": 3809.6639999970794,
      "key": "debug",
      "value": "(Log limit reached. Further similar entries may be suppressed): Media segment did not contain any coded frames for track 2, mismatching initialization segment. Therefore, MSE coded frame processing may not interoperably detect discontinuities in appended media."
    },
    {
      "time": 3819.130000002682,
      "key": "pipeline_buffering_state",
      "value": {
        "for_suspended_start": false,
        "state": "BUFFERING_HAVE_ENOUGH"
      }
    },
    {
      "time": 4814.815999999642,
      "key": "pipeline_buffering_state",
      "value": {
        "for_suspended_start": false,
        "state": "BUFFERING_HAVE_ENOUGH"
      }
    },
    {
      "time": 10899.449000000954,
      "key": "audio_buffering_state",
      "value": {
        "reason": "DEMUXER_UNDERFLOW",
        "state": "BUFFERING_HAVE_NOTHING"
      }
    },
    {
      "time": 11635.372999995947,
      "key": "pipeline_buffering_state",
      "value": {
        "for_suspended_start": false,
        "state": "BUFFERING_HAVE_ENOUGH"
      }
    },
    {
      "time": 82284.93299999833,
      "key": "kVideoPlaybackRoughness",
      "value": 28.125
    },
    {
      "time": 82284.94099999964,
      "key": "kVideoPlaybackFreezing",
      "value": 0.051425
    },
    {
      "time": 82284.94200000167,
      "key": "kFramerate",
      "value": 15
    },
    {
      "time": 84563.06000000238,
      "key": "audio_buffering_state",
      "value": {
        "reason": "DEMUXER_UNDERFLOW",
        "state": "BUFFERING_HAVE_NOTHING"
      }
    },
    {
      "time": 84565.17899999768,
      "key": "pipeline_buffering_state",
      "value": {
        "for_suspended_start": false,
        "reason": "DEMUXER_UNDERFLOW",
        "state": "BUFFERING_HAVE_NOTHING"
      }
    }
  ]
}

hawkeye217 Aug 16, 2024
Collaborator

Thanks. Will be interested to see how my branch performs for you.

hawkeye217 · 2024-08-17T18:07:48Z

hawkeye217
Aug 17, 2024
Collaborator

I have a PR up (#13143) with these improvements and more that should mitigate your issues. If you're still having problems, let me know and we can debug further. Thanks for your help to test this code!

5 replies

xtj7 Aug 19, 2024
Author

I have just deployed that and will report back how it works out for me. Unfortunately during the weekend I was mostly out, so I don't have much to report at this point, but while there is the occasional glitch, that is pretty much now about frigate taking an extended period of time to switch to MSE on the overview even if there is activity.
The issue where it just stopped refreshing altogther happens so rarely now that it gets difficult to reproduce at all with the previous build. Which is great news obviously :) Will see if this build improves on it even further. For reference: I am using ghcr.io/blakeblackshear/frigate:dev-8e31244 now.

xtj7 Aug 20, 2024
Author

After a day of use I can say: it seems pretty dang stable. The latency does seem to be a bit more on average (maybe 5-6 seconds total latency) compared to the previous build, but I have no more stopped video in the overview even if it is running all day long. This is probably the most stable build yet for me!

hawkeye217 Aug 20, 2024
Collaborator

Great to hear!

The code tries to balance correcting latency with quick changes in bandwidth not causing a switch to jsmpeg mode, so it might be slightly more conservative than some of my original builds you tested.

I think we can close this bug report as resolved now. If there's anything else problematic you find related to this, feel free to reopen.

xtj7 Aug 20, 2024
Author

Thank you so much for your hard work, I agree, this is absolutely resolved now. Now that you mention it: I also did have the occasional flickering on the previous build. This might have been from it constantly switching streams. After a couple seconds it stopped, but I have not seen this with the current build. Again, thank you so much for your fantastic work :)

hawkeye217 Aug 20, 2024
Collaborator

Happy to help! And yes, the flickering could have been caused by the switching. Glad to know it's been mitigated.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Bug]: Video stops updating after random period of time #13047

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 3 comments 19 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

Select a reply

[Bug]: Video stops updating after random period of time #13047

xtj7 Aug 14, 2024

Describe the problem you are having

Steps to reproduce

Version

Frigate config file

Relevant log output

Operating system

Install method

Network connection

Camera make and model

Any other information that may be helpful

Replies: 3 comments · 19 replies

hawkeye217 Aug 14, 2024 Collaborator

xtj7 Aug 16, 2024 Author

hawkeye217 Aug 16, 2024 Collaborator

xtj7 Aug 16, 2024 Author

hawkeye217 Aug 16, 2024 Collaborator

hawkeye217 Aug 16, 2024 Collaborator

hawkeye217 Aug 14, 2024 Collaborator

xtj7 Aug 16, 2024 Author

hawkeye217 Aug 16, 2024 Collaborator

hawkeye217 Aug 17, 2024 Collaborator

xtj7 Aug 19, 2024 Author

xtj7 Aug 20, 2024 Author

hawkeye217 Aug 20, 2024 Collaborator

xtj7 Aug 20, 2024 Author

hawkeye217 Aug 20, 2024 Collaborator

xtj7
Aug 14, 2024

Replies: 3 comments 19 replies

hawkeye217
Aug 14, 2024
Collaborator

xtj7 Aug 16, 2024
Author

hawkeye217 Aug 16, 2024
Collaborator

xtj7 Aug 16, 2024
Author

hawkeye217 Aug 16, 2024
Collaborator

hawkeye217 Aug 16, 2024
Collaborator

hawkeye217
Aug 14, 2024
Collaborator

xtj7 Aug 16, 2024
Author

hawkeye217 Aug 16, 2024
Collaborator

hawkeye217
Aug 17, 2024
Collaborator

xtj7 Aug 19, 2024
Author

xtj7 Aug 20, 2024
Author

hawkeye217 Aug 20, 2024
Collaborator

xtj7 Aug 20, 2024
Author

hawkeye217 Aug 20, 2024
Collaborator