[Detector Support]: Detection appears to be stuck. Restarting detection process

[will-riley]

Describe the problem you are having

Log Info: "Detection appears to be stuck. Restarting detection process"

USB 3 speeds appear to be working. Cables and ports have been swapped around. No change.
HassOS add-on, on proxmox 8.2.4.

Version

0.14.0-da913d8

Frigate config file

birdseye:
  enabled: true
  restream: true
  quality: 4
  height: 1080
  width: 1920
  mode: continuous

mqtt:
  enabled: true
  host: core-mosquitto
  port: 1883
  user: ***
  password: ***
  topic_prefix: frigate
  client_id: frigate

database:
  path: /config/frigate.db

detectors:
  coral_1:
    type: edgetpu
    device: usb:0
  coral_2:
    type: edgetpu
    device: usb:1

go2rtc:
  streams:
    gate:
      - rtsp://***@192.168.2.5:554/cam/realmonitor?channel=1&subtype=1
    north:
      - rtsp://***@192.168.2.7:554/cam/realmonitor?channel=1&subtype=0
    south:
      - rtsp://***@192.168.2.6:554/cam/realmonitor?channel=1&subtype=1
    west:
      - rtsp://***@192.168.2.8:554/cam/realmonitor?channel=1&subtype=1
    garage:
      - rtsp://***@192.168.2.9:554/cam/realmonitor?channel=1&subtype=1
    aux1:
      - rtsp://***@192.168.2.12:554/cam/realmonitor?channel=1&subtype=1
    front:
      - rtsp://***@192.168.2.11:554/cam/realmonitor?channel=1&subtype=1

motion:
  threshold: 20
  contour_area: 30
  lightning_threshold: 0.8
  improve_contrast: true
  frame_alpha: 0.01
  frame_height: 100
  mqtt_off_delay: 10

record:
  enabled: true
  sync_recordings: true
  retain:
    days: 4
    mode: motion
  events:
    pre_capture: 2
    retain:
      default: 6
      mode: motion

timestamp_style:
  position: tr
  effect: solid

snapshots:
  enabled: true
  clean_copy: true
  timestamp: false
  crop: true
  retain:
    default: 20
    objects:
      person: 30

ffmpeg:
  output_args:
    record: preset-record-generic-audio-aac
  hwaccel_args: preset-vaapi

detect:
  fps: 6
  width: 704
  height: 480

objects:
  track:
    - car
    - person
    - dog
    - cat
    - bird
    - motorcycle
    - fedex
    - ups
    - amazon
    - truck

audio:
  enabled: true
  min_volume: 200
  max_not_heard: 20
  listen:
    - bark
    - babbling
    - laughter
    - fire_alarm
    - scream
    - speech
    - yell
    - whoop
    - singing
    - footsteps
    - owl
    - music
    - rain
    - wind
    - car
    - honk
    - motorcycle
    - aircraft
    - slam
    - squeak
    - gunshot
    - explosion

cameras:
  front:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://***@192.168.2.11:554/cam/realmonitor?channel=1&subtype=1
          roles:
            - detect
        - path: rtsp://***@192.168.2.11:554/cam/realmonitor?channel=1&subtype=0
          roles:
            - audio
            - record
    motion:
      threshold: 20
      contour_area: 33
      improve_contrast: false
      mask:
        - 1,0,1,0.235,0.294,0.279,0.264,0.366,0.197,0.37,0.164,0.292,0,0.296,0,0
        - 0.229,1,0.713,1,0.565,0.485,0.48,0.519
        - 0.659,0.753,0.798,0.766,0.814,0.953,0.785,0.996,0.657,0.995
    detect:
      width: 704
      height: 480
    record:
      enabled: true
    snapshots:
      required_zones:
        - street_left
        - street_right
        - wide_area
    webui_url: http://192.168.2.11/
    zones:
      street_left:
        coordinates: 168,223,179,151,25,159,22,228
        inertia: 3
        objects:
          - car
          - motorcycle
          - amazon
          - fedex
          - ups
          - person
      street_right:
        coordinates: 395,220,503,227,488,139,386,135
        inertia: 3
        objects:
          - car
          - motorcycle
          - truck
          - amazon
          - fedex
          - ups
          - person
      wide_area:
        coordinates: 0,403,704,480,704,138,0,157
        inertia: 3
        objects:
          - person
          - cat
          - dog

    review:
      alerts:
        required_zones:
          - street_left
          - street_right
          - wide_area
  gate:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://***@192.168.2.5:554/cam/realmonitor?channel=1&subtype=1
          roles:
            - detect
        - path: rtsp://***@192.168.2.5:554/cam/realmonitor?channel=1&subtype=0
          roles:
            - audio
            - record
    motion:
      threshold: 14
      contour_area: 31
      mask:
        - 0,480,0,0,704,0,704,147,442,232,383,255,304,253,314,325,376,480
    detect:
      width: 704
      height: 480
    record:
      enabled: true
    webui_url: http://192.168.2.5/

  north:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://***@192.168.2.7:554/cam/realmonitor?channel=1&subtype=1
          roles:
            - detect
        - path: rtsp://***@192.168.2.7:554/cam/realmonitor?channel=1&subtype=0
          roles:
            - audio
            - record
    motion:
      threshold: 13
      contour_area: 10
      mask:
        - 0,203,0,314,0,480,113,480,282,132,315,57,325,0
        - 439,43,475,64,528,64,600,64,704,60,704,0,366,0
    detect:
      width: 704
      height: 480
    record:
      enabled: true
    webui_url: http://192.168.2.7/

  south:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://***@192.168.2.6:554/cam/realmonitor?channel=1&subtype=1
          roles:
            - detect
        - path: rtsp://***@192.168.2.6:554/cam/realmonitor?channel=1&subtype=0
          roles:
            - audio
            - record
    motion:
      threshold: 15
      contour_area: 30
      improve_contrast: false
      mask:
        - 522,480,704,480,704,449,522,454
        - 704,0,704,132,704,0,704,236,704,304,704,480,484,480,527,314,558,0
        - 290,125,527,36,558,0,0,0,0,209
    detect:
      width: 704
      height: 480
    record:
      enabled: true
    webui_url: http://192.168.2.6/

  west:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://***@192.168.2.8:554/cam/realmonitor?channel=1&subtype=1
          roles:
            - detect
        - path: rtsp://***@192.168.2.8:554/cam/realmonitor?channel=1&subtype=0
          roles:
            - audio
            - record
    motion:
      threshold: 13
      contour_area: 10
      mask:
        - 153,51,184,0,0,0,0,114
        - 704,0,704,128,418,0
    detect:
      width: 704
      height: 480
    record:
      enabled: true
    webui_url: http://192.168.2.8/

  garage:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://***@192.168.2.9:554/cam/realmonitor?channel=1&subtype=1
          roles:
            - detect
        - path: rtsp://***@192.168.2.9:554/cam/realmonitor?channel=1&subtype=0
          roles:
            - audio
            - record
    motion:
      threshold: 13
      contour_area: 33
      improve_contrast: false
      mask:
        - 477,23,704,21,704,0,477,0
    detect:
      width: 704
      height: 480
    record:
      enabled: true
      events:
        objects:
          - person
          - dog
          - cat
    webui_url: http://192.168.2.9/

  aux1:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://***@192.168.2.12:554/cam/realmonitor?channel=1&subtype=1
          roles:
            - detect
        - path: rtsp://***@192.168.2.12:554/cam/realmonitor?channel=1&subtype=0
          roles:
            - audio
            - record
    motion:
      threshold: 13
      contour_area: 30
      improve_contrast: false
      mask:
        - 523,98,611,98,704,88,704,63,522,64
    detect:
      width: 704
      height: 480
    record:
      enabled: true
      events:
        objects:
          - person
          - dog
          - cat
    webui_url: http://192.168.2.12/

telemetry:
  stats:
    # Enable AMD GPU stats (default: shown below)
    amd_gpu_stats: false
    # Enable Intel GPU stats (default: shown below)
    intel_gpu_stats: true
    # Enable network bandwidth stats monitoring for camera ffmpeg processes, go2rtc, and object detectors. (default: shown below)
    # NOTE: The container must either be privileged or have cap_net_admin, cap_net_raw capabilities enabled.
    network_bandwidth: true
version: 0.14
camera_groups:
  Main:
    order: 1
    icon: LuBookmark
    cameras:
      - front
      - gate
      - north
      - west
      - south
      - aux1
  Bird:
    order: 2
    icon: LuBird
    cameras: birdseye

docker-compose file or Docker CLI command

none used

Relevant log output

info
2024-08-18 09:38:17
frigate.detectors.plugins.edgetpu_tfl
Attempting to load TPU as usb:1
info
2024-08-18 09:38:20
frigate.detectors.plugins.edgetpu_tfl
TPU found
info
2024-08-18 12:10:17
frigate.watchdog
Detection appears to be stuck. Restarting detection process...
info
2024-08-18 12:10:17
root
Waiting for detection process to exit gracefully...
info
2024-08-18 12:10:47
root
Detection process didn't exit. Force killing...
info
2024-08-18 12:10:47
root
Detection process has exited...
info
2024-08-18 12:10:47
detector.coral_2
Starting detection process: 2251533

Operating system

Proxmox

Install method

HassOS Addon

Object Detector

Coral

Any other information that may be helpful

root@pmox1:~# lsusb
Bus 002 Device 005: ID 18d1:9302 Google Inc. 
Bus 002 Device 003: ID 0bda:0411 Realtek Semiconductor Corp. Hub
Bus 002 Device 002: ID 18d1:9302 Google Inc. 
Bus 002 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 001 Device 003: ID 051d:0002 American Power Conversion Uninterruptible Power Supply
Bus 001 Device 002: ID 0bda:5411 Realtek Semiconductor Corp. RTS5411 Hub
Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub

root@pmox1:~# lsusb -t
/:  Bus 02.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/10p, 10000M
    |__ Port 3: Dev 2, If 0, Class=Vendor Specific Class, Driver=usbfs, 5000M
    |__ Port 7: Dev 3, If 0, Class=Hub, Driver=hub/4p, 5000M
        |__ Port 1: Dev 5, If 0, Class=Vendor Specific Class, Driver=usbfs, 5000M
/:  Bus 01.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/16p, 480M
    |__ Port 7: Dev 2, If 0, Class=Hub, Driver=hub/4p, 480M
    |__ Port 9: Dev 3, If 0, Class=Human Interface Device, Driver=usbhid, 12M

[NickM-27]

there have been some reports of this when running a VM in proxmox, I believe some users solved it by using an LXC instead

[vuminhkh]

Hello, I confirmed the suspicion about proxmox, I moved frigate from an intel nuc to a proxmox VM and surprised, I had this error. Is there any solution apart from not running on proxmox VM ? In fact I have a k3s cluster with master running on the VM proxmox, it'll be very sad to have to run frigate independently outside of my k3s on the proxmox host it-self. Apart from the fact that detection is down every 2 hours or so for 1 minute, what's the consequence of this bug ?

[Cold-Lemonade]

@NickM-27 -- I am getting these same errors too, but I'm not running Frigate 0.14.1 in Proxmox. I am running it in a docker container in Ubuntu 24.04 LTS. I also have an M.2 coral tpu and a USB coral tpu connected and it is the usb that is having the trouble.

Here's the relevant portion of my log file:

2024-11-26 02:28:13
frigate.watchdog
Detection appears to be stuck. Restarting detection process...
info
2024-11-26 02:28:13
root
Waiting for detection process to exit gracefully...
info
2024-11-26 02:28:43
root
Detection process didn't exit. Force killing...
info
2024-11-26 02:28:43
root
Detection process has exited...
info
2024-11-26 02:28:43
detector.coral2
Starting detection process: 894257
info
2024-11-26 02:28:43
frigate.detectors.plugins.edgetpu_tfl
Attempting to load TPU as usb
info
2024-11-26 02:28:46
frigate.detectors.plugins.edgetpu_tfl
TPU found
info
2024-11-26 12:27:15
frigate.watchdog
Detection appears to be stuck. Restarting detection process...
info
2024-11-26 12:27:15
root
Waiting for detection process to exit gracefully...
info
2024-11-26 12:27:45
root
Detection process didn't exit. Force killing...
info
2024-11-26 12:27:45
root
Detection process has exited...
info
2024-11-26 12:27:45
detector.coral2
Starting detection process: 1152110
info
2024-11-26 12:27:45
frigate.detectors.plugins.edgetpu_tfl
Attempting to load TPU as usb
info
2024-11-26 12:27:47
frigate.detectors.plugins.edgetpu_tfl
TPU found

What do you think is causing the issue?

[flip1900]

exactly the same setup as i do, intel nuc with ubuntu 24 and coral usb. getting the same problem with detection appears to be stuck.

[harrv]

There are all sorts of USB C data cables out there. Some are not capable of supplying enough power. Some are not capable of the required speed. Some are poorly engineered and will act flaky. A few years ago I needed an expensive repair to a laptop because of the data cable burning out the port.

When I first plugged in my Google Coral USB with the supplied USB cable I started seeing occasional "Detection appears to be stuck" log messages within the first hour and they continued every hour or two. I suspected the cable.

Based on a suggestion from the NYT Wirecutter reviews I ordered "Cable Matters [USB-IF Certified] 10 Gbps Gen 2 USB C to USB C Cable 3.3 ft / 1m with 4K@60Hz Video and 100W Power Delivery in Black".

If you try another cable, and it's not that one, I would at least verify that it is USB-IF certified.

I installed it yesterday and so far there have been no more "Detection appears to be stuck" messages, but it's only been about 20 hours so far. I'll come back and reply or edit if I see any more of those errors. One thing to note if you try this particular cable, it is USB-C to USB-C so you need a free USB-C port on your PC to utilize it. The device mapping in my docker compose yaml file didn't need to change.