[Detector Support]: #10438

Niko-La · 2024-03-14T01:44:44Z

Niko-La
Mar 14, 2024

Describe the problem you are having

I am using a C270 Logitech USB Webcam

I had to add the input_args to get the webcam to be seen in the UI.

However, the detector is not recognizing a person.

When I enable recording in config.yml, the webcam not loading properly on refresh.

Additionally, the TPU USB is detected, but my inference time is 30ms instead of the expected 10ms.

Is my issue the usb camera as input ?

Version

latest

Frigate config file

mqtt:
  enabled: False

cameras:
  usb_cam:
    rtmp:
      enabled: false
    ffmpeg:
      inputs:
        - path: /dev/video0
          roles:
            - detect
            - record
      input_args: -f v4l2 -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -use_wallclock_as_timestamps 1
      output_args:
        detect: -f rawvideo -pix_fmt yuv420p
    detect:
      enabled: True
      fps: 10
      width: 1280
      height: 720

detectors:
  coral:
    type: edgetpu
    device: usb

docker-compose file or Docker CLI command

ersion: "3.9"
services:
  frigate:
    container_name: frigate
    privileged: true # this may not be necessary for all setups
    restart: unless-stopped
    image: ghcr.io/blakeblackshear/frigate:stable
    shm_size: "64mb" # update for your cameras based on calculation above
    devices:
      - /dev/bus/usb:/dev/bus/usb  # Passes the USB Coral, needs to be modified for other versions
      - /dev/apex_0:/dev/apex_0    # Passes a PCIe Coral, follow driver instructions here https://coral.ai/docs/m2/get-started/#2a-on-linux
      - /dev/video11:/dev/video11  # For Raspberry Pi 4B
      - /dev/dri/renderD128:/dev/dri/renderD128 # For intel hwaccel, needs to be updated for your hardware
    volumes:
      - /etc/localtime:/etc/localtime:ro
      - ./config:/config
      - ./storage:/media/frigate
      - type: tmpfs # Optional: 1GB of memory, reduces SSD/SD Card wear
        target: /tmp/cache
        tmpfs:
          size: 1000000000
    ports:
      - "5000:5000"
      - "8554:8554" # RTSP feeds
      - "8555:8555/tcp" # WebRTC over tcp
      - "8555:8555/udp" # WebRTC over udp
    environment:
      FRIGATE_RTSP_PASSWORD: "password"

Relevant log output

2024-03-13 05:51:48.169309524  [INFO] Preparing Frigate...
2024-03-13 05:51:48.176559270  [INFO] Starting Frigate...
2024-03-13 05:51:48.978924834  [2024-03-13 05:51:48] frigate.app                    INFO    : Starting Frigate (0.13.2-6476f8a)
2024-03-13 05:51:49.001066954  [2024-03-13 05:51:49] peewee_migrate.logs            INFO    : Starting migrations
2024-03-13 05:51:49.004056631  [2024-03-13 05:51:49] peewee_migrate.logs            INFO    : There is nothing to migrate
2024-03-13 05:51:49.008685733  [2024-03-13 05:51:49] frigate.app                    INFO    : Recording process started: 584
2024-03-13 05:51:49.010487562  [2024-03-13 05:51:49] frigate.app                    INFO    : go2rtc process pid: 89
2024-03-13 05:51:49.025785698  [2024-03-13 05:51:49] detector.coral                 INFO    : Starting detection process: 593
2024-03-13 05:51:49.028043430  [2024-03-13 05:51:49] frigate.app                    INFO    : Output process started: 595
2024-03-13 05:51:49.037200880  [2024-03-13 05:51:49] frigate.app                    INFO    : Camera processor started for usb_cam: 603
2024-03-13 05:51:49.043253056  [2024-03-13 05:51:49] frigate.app                    INFO    : Capture process started for usb_cam: 605
2024-03-13 05:51:52.247486721  [2024-03-13 05:51:49] frigate.detectors.plugins.edgetpu_tfl INFO    : Attempting to load TPU as usb
2024-03-13 05:51:52.252121406  [2024-03-13 05:51:52] frigate.detectors.plugins.edgetpu_tfl INFO    : TPU found

Operating system

Debian

Install method

Docker Compose

Coral version

USB

Any other information that may be helpful

USB Webcam shows up as 2 video list when connected to the ubuntu system
cpu amd apu 5600g /w USB Coral Accell

NickM-27 · 2024-03-14T02:54:05Z

NickM-27
Mar 14, 2024
Collaborator Sponsor

If you have amd apu then you'll want to use hwaccel args

The bandwidth of the camera could definitely be slowing down the coral

1 reply

Niko-La Mar 14, 2024
Author

i first ensured the storage folder had the right permission to write

When adding hwaccell args and added the right amd apu setting in the docker-compose
i did see the inference drop to 10ms
but this also broke the usb camera.

Likewise the same happend when enabling global record

mqtt:
  enabled: False

cameras:
  usb_cam:
    rtmp:
      enabled: false
    ffmpeg:
      inputs:
        - path: /dev/video0
          roles:
            - detect
            - record
      input_args: -f v4l2 -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -use_wallclock_as_timestamps 1
      output_args:
        detect: -f rawvideo -pix_fmt yuv420p
      hwaccel_args:   preset-vaapi

    detect:
      enabled: True
      fps: 10
      width: 1280
      height: 720

detectors:
  coral:
    type: edgetpu
    device: usb

#record:
#  enabled: True

console log when enabling hardware accel only

2024-03-14 01:26:48.439191241  [INFO] Preparing Frigate...
2024-03-14 01:26:48.447033791  [INFO] Starting Frigate...
2024-03-14 01:26:49.416837338  [2024-03-14 01:26:49] frigate.app                    INFO    : Starting Frigate (0.13.2-6476f8a)
2024-03-14 01:26:49.439598050  [2024-03-14 01:26:49] peewee_migrate.logs            INFO    : Starting migrations
2024-03-14 01:26:49.442633181  [2024-03-14 01:26:49] peewee_migrate.logs            INFO    : There is nothing to migrate
2024-03-14 01:26:49.447510810  [2024-03-14 01:26:49] frigate.app                    INFO    : Recording process started: 585
2024-03-14 01:26:49.449390829  [2024-03-14 01:26:49] frigate.app                    INFO    : go2rtc process pid: 89
2024-03-14 01:26:49.467017735  [2024-03-14 01:26:49] detector.coral                 INFO    : Starting detection process: 594
2024-03-14 01:26:52.688964490  [2024-03-14 01:26:49] frigate.app                    INFO    : Output process started: 596
2024-03-14 01:26:52.689149129  [2024-03-14 01:26:50] frigate.video                  ERROR   : usb_cam: Unable to read frames from ffmpeg process.
2024-03-14 01:26:52.693628981  [2024-03-14 01:26:49] frigate.detectors.plugins.edgetpu_tfl INFO    : Attempting to load TPU as usb
2024-03-14 01:26:52.693720699  [2024-03-14 01:26:49] frigate.app                    INFO    : Camera processor started for usb_cam: 604
2024-03-14 01:26:52.693805454  [2024-03-14 01:26:52] frigate.detectors.plugins.edgetpu_tfl INFO    : TPU found
2024-03-14 01:26:52.693890228  [2024-03-14 01:26:50] frigate.video                  ERROR   : usb_cam: ffmpeg process is not running. exiting capture thread...
2024-03-14 01:26:52.693956597  [2024-03-14 01:26:49] frigate.app                    INFO    : Capture process started for usb_cam: 605
2024-03-14 01:27:09.503686342  [2024-03-14 01:27:09] watchdog.usb_cam               ERROR   : Ffmpeg process crashed unexpectedly for usb_cam.
2024-03-14 01:27:09.503782569  [2024-03-14 01:27:09] watchdog.usb_cam               ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-03-14 01:27:09.503879478  [2024-03-14 01:27:09] ffmpeg.usb_cam.detect          ERROR   : Impossible to convert between the formats supported by the filter 'Parsed_fps_0' and the filter 'auto_scale_0'
2024-03-14 01:27:09.503959444  [2024-03-14 01:27:09] ffmpeg.usb_cam.detect          ERROR   : Error reinitializing filters!
2024-03-14 01:27:09.504033128  [2024-03-14 01:27:09] ffmpeg.usb_cam.detect          ERROR   : Failed to inject frame into filter network: Function not implemented
2024-03-14 01:27:09.504099577  [2024-03-14 01:27:09] ffmpeg.usb_cam.detect          ERROR   : Error while processing the decoded data for stream #0:0
2024-03-14 01:27:09.504155186  [2024-03-14 01:27:09] ffmpeg.usb_cam.detect          ERROR   : [video4linux2,v4l2 @ 0x566809e1acc0] Some buffers are still owned by the caller on close.
2024-03-14 01:27:09.504213309  [2024-03-14 01:27:09] ffmpeg.usb_cam.detect          ERROR   : ioctl(VIDIOC_QBUF): Bad file descriptor

console log when enabling hardware accel and record global enabled

024-03-14 01:30:09.555608345  [2024-03-14 01:30:06] frigate.detectors.plugins.edgetpu_tfl INFO    : Attempting to load TPU as usb
2024-03-14 01:30:09.555704526  [2024-03-14 01:30:07] frigate.video                  ERROR   : usb_cam: Unable to read frames from ffmpeg process.
2024-03-14 01:30:09.555778834  [2024-03-14 01:30:06] frigate.app                    INFO    : Camera processor started for usb_cam: 604
2024-03-14 01:30:09.555896888  [2024-03-14 01:30:07] frigate.video                  ERROR   : usb_cam: ffmpeg process is not running. exiting capture thread...
2024-03-14 01:30:09.555945054  [2024-03-14 01:30:06] frigate.app                    INFO    : Capture process started for usb_cam: 605
2024-03-14 01:30:09.560199613  [2024-03-14 01:30:09] frigate.detectors.plugins.edgetpu_tfl INFO    : TPU found
2024-03-14 01:30:11.327384630  [mov,mp4,m4a,3gp,3g2,mj2 @ 0x76108c008f80] moov atom not found
2024-03-14 01:30:11.328109630  [ERROR:[email protected]] global cap.cpp:164 open VIDEOIO(CV_IMAGES): raised OpenCV exception:
2024-03-14 01:30:11.328111293  
2024-03-14 01:30:11.328112606  OpenCV(4.7.0) /io/opencv/modules/videoio/src/cap_images.cpp:267: error: (-215:Assertion failed) number < max_number in function 'icvExtractPattern'
2024-03-14 01:30:11.328116093  
2024-03-14 01:30:11.328116634  
2024-03-14 01:30:11.342635601  [2024-03-14 01:30:11] frigate.record.maintainer      WARNING : Failed to probe corrupt segment /tmp/cache/[email protected]
2024-03-14 01:30:11.342709829  [2024-03-14 01:30:11] frigate.record.maintainer      WARNING : Discarding a corrupt recording segment: /tmp/cache/[email protected]
2024-03-14 01:30:26.373587650  [2024-03-14 01:30:26] watchdog.usb_cam               ERROR   : Ffmpeg process crashed unexpectedly for usb_cam.
2024-03-14 01:30:26.373698581  [2024-03-14 01:30:26] watchdog.usb_cam               ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-03-14 01:30:26.373792137  [2024-03-14 01:30:26] ffmpeg.usb_cam.detect          ERROR   : [mp4 @ 0x626754e26040] Could not find tag for codec rawvideo in stream #0, codec not currently supported in container
2024-03-14 01:30:26.373864942  [2024-03-14 01:30:26] ffmpeg.usb_cam.detect          ERROR   : Could not write header for output file #0 (incorrect codec parameters ?): Invalid argument
2024-03-14 01:30:26.373931133  [2024-03-14 01:30:26] ffmpeg.usb_cam.detect          ERROR   : Error initializing output stream 0:0 -- 
2024-03-14 01:30:26.373988227  [2024-03-14 01:30:26] ffmpeg.usb_cam.detect          ERROR   : 
2024-03-14 01:30:26.374045681  [2024-03-14 01:30:26] ffmpeg.usb_cam.detect          ERROR   : [video4linux2,v4l2 @ 0x626754c13040] Some buffers are still owned by the caller on close.
2024-03-14 01:30:26.374089338  [2024-03-14 01:30:26] ffmpeg.usb_cam.detect          ERROR   : ioctl(VIDIOC_QBUF): Bad file descriptor
2024-03-14 01:30:27.581711706  [2024-03-14 01:30:27] frigate.video                  ERROR   : usb_cam: Unable to read frames from ffmpeg process.
2024-03-14 01:30:27.581788799  [2024-03-14 01:30:27] frigate.video                  ERROR   : usb_cam: ffmpeg process is not running. exiting capture thread...
2024-03-14 01:30:31.326242915  [mov,mp4,m4a,3gp,3g2,mj2 @ 0x76108c00de80] moov atom not found
2024-03-14 01:30:31.326330840  [ERROR:[email protected]] global cap.cpp:164 open VIDEOIO(CV_IMAGES): raised OpenCV exception:
2024-03-14 01:30:31.326331952  
2024-03-14 01:30:31.326333194  OpenCV(4.7.0) /io/opencv/modules/videoio/src/cap_images.cpp:267: error: (-215:Assertion failed) number < max_number in function 'icvExtractPattern'
2024-03-14 01:30:31.326333886

console log when only record global enabled
inference back at 30ms

2024-03-14 01:32:42.060273140  [INFO] Preparing Frigate...
2024-03-14 01:32:42.069681773  [INFO] Starting Frigate...
2024-03-14 01:32:42.877431179  [2024-03-14 01:32:42] frigate.app                    INFO    : Starting Frigate (0.13.2-6476f8a)
2024-03-14 01:32:42.899861119  [2024-03-14 01:32:42] peewee_migrate.logs            INFO    : Starting migrations
2024-03-14 01:32:42.903134739  [2024-03-14 01:32:42] peewee_migrate.logs            INFO    : There is nothing to migrate
2024-03-14 01:32:42.908115081  [2024-03-14 01:32:42] frigate.app                    INFO    : Recording process started: 583
2024-03-14 01:32:42.909870832  [2024-03-14 01:32:42] frigate.app                    INFO    : go2rtc process pid: 89
2024-03-14 01:32:42.928367439  [2024-03-14 01:32:42] detector.coral                 INFO    : Starting detection process: 592
2024-03-14 01:32:42.932985288  [2024-03-14 01:32:42] frigate.app                    INFO    : Output process started: 595
2024-03-14 01:32:42.942588578  [2024-03-14 01:32:42] frigate.app                    INFO    : Camera processor started for usb_cam: 602
2024-03-14 01:32:42.947403440  [2024-03-14 01:32:42] frigate.app                    INFO    : Capture process started for usb_cam: 603
2024-03-14 01:32:44.122415751  [2024-03-14 01:32:44] frigate.video                  ERROR   : usb_cam: Unable to read frames from ffmpeg process.
2024-03-14 01:32:44.122532904  [2024-03-14 01:32:44] frigate.video                  ERROR   : usb_cam: ffmpeg process is not running. exiting capture thread...
2024-03-14 01:32:46.149803182  [2024-03-14 01:32:42] frigate.detectors.plugins.edgetpu_tfl INFO    : Attempting to load TPU as usb
2024-03-14 01:32:46.154461563  [2024-03-14 01:32:46] frigate.detectors.plugins.edgetpu_tfl INFO    : TPU found
2024-03-14 01:32:47.916559790  [mov,mp4,m4a,3gp,3g2,mj2 @ 0x784d10008f80] moov atom not found
2024-03-14 01:32:47.917279295  [ERROR:[email protected]] global cap.cpp:164 open VIDEOIO(CV_IMAGES): raised OpenCV exception:
2024-03-14 01:32:47.917280788  
2024-03-14 01:32:47.917281971  OpenCV(4.7.0) /io/opencv/modules/videoio/src/cap_images.cpp:267: error: (-215:Assertion failed) number < max_number in function 'icvExtractPattern'

Aspect	Log 1	Log 2	Log 3
Date and Time	2024-03-14 01:32:42.xxx	2024-03-14 01:30:09.xxx	2024-03-14 01:26:48.xxx
Frigate Version	0.13.2-6476f8a	0.13.2-6476f8a	0.13.2-6476f8a
Frigate Startup	Starting Frigate	Starting Frigate	Starting Frigate
Detection Process	Starting detection process	Starting detection process	Starting detection process
Output Process	Output process started	Output process started	Output process started
Camera Processor	Camera processor started for usb_cam	Camera processor started for usb_cam	Camera processor started for usb_cam
Capture Process	Capture process started for usb_cam	Capture process started for usb_cam	Capture process started for usb_cam
TPU Loading	Attempting to load TPU as usb	Attempting to load TPU as usb	Attempting to load TPU as usb
TPU Found	TPU found	TPU found	TPU found
Ffmpeg Process Error	Unable to read frames from ffmpeg...	Unable to read frames from ffmpeg...	Unable to read frames from ffmpeg...
Ffmpeg Process Not Running	Ffmpeg process is not running	Ffmpeg process is not running	Ffmpeg process is not running
Ffmpeg Process Crash	-	-	Ffmpeg process crashed unexpectedly
Error Messages from Ffmpeg	-	-	Various ffmpeg errors
Buffer Ownership Error	-	-	Buffer ownership error

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Detector Support]: #10438

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 1 comment 1 reply

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Select a reply

[Detector Support]: #10438

Niko-La Mar 14, 2024

Describe the problem you are having

Version

Frigate config file

docker-compose file or Docker CLI command

Relevant log output

Operating system

Install method

Coral version

Any other information that may be helpful

Replies: 1 comment · 1 reply

NickM-27 Mar 14, 2024 Collaborator Sponsor

Niko-La Mar 14, 2024 Author

Niko-La
Mar 14, 2024

Replies: 1 comment 1 reply

NickM-27
Mar 14, 2024
Collaborator Sponsor

Niko-La Mar 14, 2024
Author