[Camera Support]: Troubleshooting 2-way audio with Reolink Doorbell #10619

soonerfan237 · 2024-03-22T22:03:45Z

soonerfan237
Mar 22, 2024

Describe the problem you are having

I haven't been able to get 2-way audio working with my Reolink Doorbell WiFi and at this point I'm unsure what else to try. It seems like I'm quite close. In my Frigate lovelace card, I get audio and video. And I see the microphone button. My browser and OS reports that it's using my microphone. When I click the button, it turns red as if its in use. However, when I speak into my microphone, no audio comes out of the doorbell speaker. This feature works via the official Reolink iOS app.
https://youtu.be/F2fxWTnrEYY

go2rtc version 1.8.4

Here are my server settings in the Reolink Doorbell:

I am accessing through https using Nabu Casa. I have not done anything else regarding https.

I believe I have WebRTC set up correctly. I did the WebRTC extra configuration including forwarding port 8555 in my router for TCP and UDP.

I haven't changed any other router settings. Here are some other settings I can see (not sure if any of these are relevant).

Here is my Frigate lovelace card config:

type: custom:frigate-card
cameras:
  - camera_entity: camera.doorbell_camera
    engine: frigate
    live_provider: go2rtc
    icon: mdi:doorbell-video
    go2rtc:
      modes:
        - webrtc
live:
  auto_mute: never
  transition_effect: slide
  microphone:
    always_connected: true
  controls:
    builtin: true
    title:
      mode: none
  show_image_during_load: false
  preload: true
  draggable: false
  zoomable: false
  auto_unmute: all
view:
  default: live
  camera_select: live
dimensions:
  aspect_ratio_mode: static
  aspect_ratio: '4:3'
menu:
  style: overlay
  buttons:
    microphone:
      enabled: true
      type: toggle
    frigate:
      enabled: false
    cameras:
      enabled: false
    substreams:
      enabled: false
    clips:
      enabled: false
    snapshots:
      enabled: false
    timeline:
      enabled: false
    mute:
      enabled: false
timeline:
  show_recordings: false

Version

2024.3.3

Frigate config file

mqtt:
  host: core-mosquitto
  user:
    xxxx
  password:
    xxxx

go2rtc:
  streams:
    doorbell_camera:
      - ffmpeg:http://xxx.xxx.xx.xxx/flv?port=1935&app=bcs&stream=channel0_ext.bcs&user=xxxx&password=xxxx#video=copy#audio=copy#audio=opus
      - rtsp://xxxx:[email protected]:554/h264Preview_01_sub
  ffmpeg:
    bin: ffmpeg
    volume: "-af \"volume=30dB\""
  webrtc:
    candidates:
      - http://xxx.xxx.xx.xxx:8555
      - stun:8555

cameras:
  doorbell_camera:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/doorbell_camera
          input_args: preset-rtsp-restream
          roles:
            - record
            - detect
            - audio
      output_args:
        record: preset-record-generic-audio-copy
    detect:
      width: 1280
      height: 720
      fps: 5
    zones:
      front_porch_zone:
        coordinates: 0,87,0,264,0,720,1034,720,864,388,453,385,455,265
    motion:
      mask:
        - 949,411,450,401,455,244,389,168,987,82
        - 935,0,935,50,325,50,325,0
        - 735,424,733,545,538,542,545,446
    record:
      enabled: True
      events:
        retain:
          default: 7
          mode: all
    snapshots:
      enabled: True
      retain:
        default: 14
    audio:
      enabled:
        true
      listen:
        - bark
        - speech
    objects:
      track:
        - person
        - dog
        - car
      filters:
        person:
          min_score: 0.8
        dog:
          min_score: 0.75
        car:
          min_score: 0.7

detectors:
  coral:
    type: edgetpu
    device: usb

Relevant log output

2024-03-22 22:00:57.687202270  172.30.32.1 - - [22/Mar/2024:17:00:57 -0500] "GET /api/events?cameras=doorbell_camera&limit=50&include_thumbnails=0 HTTP/1.1" 200 25437 "-" "HomeAssistant/2024.3.3 aiohttp/3.9.3 Python/3.12" "-"
2024-03-22 22:00:59.452236781  172.30.32.1 - - [22/Mar/2024:17:00:59 -0500] "GET /live/mse/api/ws?src=doorbell_camera&authSig=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiI4NzA2YTdiNjFlOTA0YmIwYTMyMDlkMjE5NzczMDJiZSIsInBhdGgiOiIvYXBpL2ZyaWdhdGUvZnJpZ2F0ZS9tc2UvYXBpL3dzIiwicGFyYW1zIjpbWyJzcmMiLCJkb29yYmVsbF9jYW1lcmEiXV0sImlhdCI6MTcxMTE0NDg1NywiZXhwIjoxNzExMjMxMjU3fQ.QbC5cHtz5nd_OHEpnf0WO1AjNKY642cLzx5TfHVHJ1Y HTTP/1.1" 101 3141 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36" "127.0.0.1"
2024-03-22 22:00:59.456189914  172.30.32.1 - - [22/Mar/2024:17:00:59 -0500] "GET /live/mse/api/ws?src=doorbell_camera&authSig=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiI4NzA2YTdiNjFlOTA0YmIwYTMyMDlkMjE5NzczMDJiZSIsInBhdGgiOiIvYXBpL2ZyaWdhdGUvZnJpZ2F0ZS9tc2UvYXBpL3dzIiwicGFyYW1zIjpbWyJzcmMiLCJkb29yYmVsbF9jYW1lcmEiXV0sImlhdCI6MTcxMTE0NDg1NywiZXhwIjoxNzExMjMxMjU3fQ.QbC5cHtz5nd_OHEpnf0WO1AjNKY642cLzx5TfHVHJ1Y HTTP/1.1" 101 3144 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36" "127.0.0.1"

FFprobe output from your camera

Input #0, rtsp, from 'rtsp://xxxx:[email protected]:554/h264Preview_01_sub':
  Metadata:
    title           : Session streamed by "preview"
  Duration: N/A, start: 0.000750, bitrate: N/A
  Stream #0:0: Video: h264 (High), yuv420p(progressive), 640x480, 15 fps, 25 tbr, 90k tbn
  Stream #0:1: Audio: aac (LC), 16000 Hz, mono, fltp

Frigate stats

No response

Operating system

HassOS

Install method

HassOS Addon

Coral version

USB

Network connection

Wireless

Camera make and model

Reolink Doorbell WiFi

Any other information that may be helpful

Stream info from go2rtc while microphone is active:

{
  "producers": [
    {
      "type": "RTSP passive producer",
      "url": "rtsp://127.0.0.1:8554/4ac90777626806e7d200b282a5fcda8a",
      "remote_addr": "127.0.0.1:34836",
      "user_agent": "ffmpeg/go2rtc",
      "sdp": "v=0\r\no=- 0 0 IN IP4 127.0.0.1\r\ns=No Name\r\nc=IN IP4 127.0.0.1\r\nt=0 0\r\na=tool:libavformat LIBAVFORMAT_VERSION\r\nm=video 0 RTP/AVP 96\r\na=rtpmap:96 H264/90000\r\na=fmtp:96 packetization-mode=1; sprop-parameter-sets=Z2QAM6wVFKDgFWQ=,aO48sA==; profile-level-id=640033\r\na=control:streamid=0\r\nm=audio 0 RTP/AVP 97\r\na=rtpmap:97 MPEG4-GENERIC/16000/1\r\na=fmtp:97 profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3; config=1408\r\na=control:streamid=1\r\nm=audio 0 RTP/AVP 98\r\nb=AS:64\r\na=rtpmap:98 opus/48000/2\r\na=control:streamid=2\r\n",
      "medias": [
        "video, recvonly, H.264 High 5.1",
        "audio, recvonly, MPEG4-GENERIC/16000",
        "audio, recvonly, OPUS/48000/2"
      ],
      "receivers": [
        "96 H264, bytes=841850279, senders=6",
        "97 MPEG4-GENERIC/16000, bytes=21018850, senders=2",
        "98 OPUS/48000/2, bytes=52647915, senders=4"
      ],
      "recv": 926780480
    },
    {
      "type": "RTSP active producer",
      "url": "rtsp://192.168.86.152/Preview_01_sub/",
      "remote_addr": "192.168.86.152:554",
      "user_agent": "go2rtc/1.8.4",
      "sdp": "v=0\r\no=- 1711139203173092 1 IN IP4 192.168.86.152\r\ns=Session streamed by \"preview\"\r\nt=0 0\r\na=tool:BC Streaming Media v202210012022.10.01\r\na=type:broadcast\r\na=control:*\r\na=range:npt=now-\r\na=x-qt-text-nam:Session streamed by \"preview\"\r\nm=video 0 RTP/AVP 96\r\nc=IN IP4 0.0.0.0\r\nb=AS:8192\r\na=rtpmap:96 H264/90000\r\na=fmtp:96 packetization-mode=1;profile-level-id=640033;sprop-parameter-sets=Z2QAM6wVFKCgPZA=,aO48sA==\r\na=recvonly\r\na=control:track1\r\nm=audio 0 RTP/AVP 97\r\nc=IN IP4 0.0.0.0\r\nb=AS:8192\r\na=rtpmap:97 MPEG4-GENERIC/16000\r\na=fmtp:97 streamtype=5;profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3;config=1408\r\na=recvonly\r\na=control:track2\r\nm=audio 0 RTP/AVP 0\r\na=control:track3\r\na=rtpmap:0 PCMU/8000\r\na=sendonly",
      "medias": [
        "video, recvonly, H.264 High 5.1",
        "audio, recvonly, MPEG4-GENERIC/16000",
        "audio, sendonly, PCMU/8000"
      ],
      "senders": [
        "0 PCMU/8000, bytes=92480, receivers=7"
      ],
      "recv": 1248,
      "send": 100848
    }
  ],
  "consumers": [
    {
      "type": "RTSP passive consumer",
      "url": "rtsp://127.0.0.1:8554/doorbell_camera",
      "remote_addr": "127.0.0.1:34820",
      "user_agent": "FFmpeg Frigate/0.13.2-6476f8a",
      "sdp": "v=0\r\no=- 1 1 IN IP4 0.0.0.0\r\ns=go2rtc/1.8.4\r\nc=IN IP4 0.0.0.0\r\nt=0 0\r\nm=video 0 RTP/AVP 96\r\na=rtpmap:96 H264/90000\r\na=fmtp:96 packetization-mode=1; sprop-parameter-sets=Z2QAM6wVFKDgFWQ=,aO48sA==; profile-level-id=640033\r\na=control:trackID=0\r\nm=audio 0 RTP/AVP 97\r\na=rtpmap:97 MPEG4-GENERIC/16000\r\na=fmtp:97 profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3; config=1408\r\na=control:trackID=1\r\n",
      "medias": [
        "video, sendonly, H264, H265",
        "audio, sendonly, MPEG4-GENERIC"
      ],
      "senders": [
        "96 H264, bytes=841850279, receivers=1",
        "97 MPEG4-GENERIC/16000, bytes=21018850, receivers=1"
      ],
      "send": 873487385
    },
    {
      "type": "RTSP passive consumer",
      "url": "rtsp://127.0.0.1:8554/doorbell_camera",
      "remote_addr": "127.0.0.1:34844",
      "user_agent": "FFmpeg Frigate/0.13.2-6476f8a",
      "sdp": "v=0\r\no=- 1 1 IN IP4 0.0.0.0\r\ns=go2rtc/1.8.4\r\nc=IN IP4 0.0.0.0\r\nt=0 0\r\nm=video 0 RTP/AVP 96\r\na=rtpmap:96 H264/90000\r\na=fmtp:96 packetization-mode=1; sprop-parameter-sets=Z2QAM6wVFKDgFWQ=,aO48sA==; profile-level-id=640033\r\na=control:trackID=0\r\nm=audio 0 RTP/AVP 97\r\na=rtpmap:97 MPEG4-GENERIC/16000\r\na=fmtp:97 profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3; config=1408\r\na=control:trackID=1\r\n",
      "medias": [
        "video, sendonly, H264, H265",
        "audio, sendonly, MPEG4-GENERIC"
      ],
      "senders": [
        "96 H264, bytes=841592285, receivers=1",
        "97 MPEG4-GENERIC/16000, bytes=21007538, receivers=1"
      ],
      "send": 873214991
    },
    {
      "type": "WebRTC/WebSocket async passive consumer",
      "remote_addr": "udp4 prflx 192.168.86.1:60151 related :0",
      "user_agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36",
      "medias": [
        "video, sendonly, VP8, RTX, VP9, H264, AV1, RED, ULPFEC, FLEXFEC-03",
        "audio, sendonly, OPUS/48000/2, RED/48000/2, G722/8000, PCMU/8000, PCMA/8000, CN/8000, TELEPHONE-EVENT/48000, TELEPHONE-EVENT/8000, L16, PCML"
      ],
      "senders": [
        "102 H264, bytes=8510052, receivers=1",
        "111 OPUS/48000/2, bytes=546302, receivers=1"
      ],
      "send": 9178355
    },
    {
      "type": "WebRTC/WebSocket async passive consumer",
      "remote_addr": "udp4 host 192.168.86.213:56918",
      "user_agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36",
      "medias": [
        "video, sendonly, VP8, RTX, VP9, H264, AV1, RED, ULPFEC, FLEXFEC-03",
        "audio, sendonly, OPUS/48000/2, RED/48000/2, G722/8000, PCMU/8000, PCMA/8000, CN/8000, TELEPHONE-EVENT/48000, TELEPHONE-EVENT/8000, L16, PCML"
      ],
      "senders": [
        "102 H264, bytes=2806530, receivers=1",
        "111 OPUS/48000/2, bytes=179456, receivers=1"
      ],
      "send": 3026982
    },
    {
      "type": "WebRTC/WebSocket async passive consumer",
      "remote_addr": "udp4 host 192.168.86.213:50055",
      "user_agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36",
      "medias": [
        "video, sendonly, VP8, RTX, VP9, H264, AV1, RED, ULPFEC, FLEXFEC-03",
        "audio, sendonly, OPUS/48000/2, RED/48000/2, G722/8000, PCMU/8000, PCMA/8000, CN/8000, TELEPHONE-EVENT/48000, TELEPHONE-EVENT/8000, L16, PCML",
        "audio, recvonly, OPUS/48000/2, RED/48000/2, G722/8000, PCMU/8000, PCMA/8000, CN/8000, TELEPHONE-EVENT/48000, TELEPHONE-EVENT/8000"
      ],
      "receivers": [
        "0 PCMU/8000, bytes=36800, senders=1"
      ],
      "senders": [
        "102 H264, bytes=1266593, receivers=1",
        "111 OPUS/48000/2, bytes=73469, receivers=1"
      ],
      "recv": 41400,
      "send": 1358992
    },
    {
      "type": "WebRTC/WebSocket async passive consumer",
      "remote_addr": "udp4 host 192.168.86.213:59093",
      "user_agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36",
      "medias": [
        "video, sendonly, VP8, RTX, VP9, H264, AV1, RED, ULPFEC, FLEXFEC-03",
        "audio, sendonly, OPUS/48000/2, RED/48000/2, G722/8000, PCMU/8000, PCMA/8000, CN/8000, TELEPHONE-EVENT/48000, TELEPHONE-EVENT/8000, L16, PCML",
        "audio, recvonly, OPUS/48000/2, RED/48000/2, G722/8000, PCMU/8000, PCMA/8000, CN/8000, TELEPHONE-EVENT/48000, TELEPHONE-EVENT/8000"
      ],
      "receivers": [
        "0 PCMU/8000, bytes=56320, senders=1"
      ],
      "senders": [
        "102 H264, bytes=1235695, receivers=1",
        "111 OPUS/48000/2, bytes=70358, receivers=1"
      ],
      "recv": 63570,
      "send": 1324445
    }
  ]
}

Answered by NickM-27

Mar 23, 2024

A user said the August version works

View full answer

NickM-27 · 2024-03-23T00:46:08Z

NickM-27
Mar 23, 2024
Collaborator Sponsor

What firmware is your doorbell running

9 replies

soonerfan237 Mar 23, 2024
Author

v3.0.0.3215_2401262240

NickM-27 Mar 23, 2024
Collaborator Sponsor

This firmware broke two way talk via rtsp

soonerfan237 Mar 23, 2024
Author

Which firmware version do I need?

NickM-27 Mar 23, 2024
Collaborator Sponsor

A user said the August version works

Answer selected by soonerfan237

soonerfan237 Mar 23, 2024
Author

It works now! Thank you!

I downgraded to v.3.0.0.2033 using this unofficial archive:
https://github.com/AT0myks/reolink-fw-archive/tree/main

zollak Apr 8, 2024

Hi, thanks for this detailed troubleshooting and the highlighted solution! I had exactly the same issue, with Firmware Version: v3.0.0.3215_2401262241, and the downlgrade solve it (Firmware Version: v3.0.0.2033_23041302).

Thanks again!

wwalcher May 12, 2024

Hey soonerfan237, I am having a problem getting this to work. What I am trying to do is get my Reolink POE Doorbell working as a Media Player in HA so that I can either send an audio file or do Text to Speech to it. I have installed Go2RTC, setup a stream(s) there, created a Media player entry for the stream, but when I try to use it, I get an error message "Failed to call service media_player/play_media. 'webrtc'".

My setting for DoorbellRTSP in Go2TRC:
"producers": [
{
"url": "rtsp://admin:[email protected]:554/h264Preview_01_main"
}
],
"consumers": []
}

My setup in configuration.yaml of the media player
media_player:

platform: webrtc
name: Front Doorbell RTSP
stream: DoorbellRTSP
audio: '-af "volume=10dB,adelay=2s,apad=pad_dur=6" -c:a pcm_alaw -ar:a 8000 -ac:a 1'

I have installed WebRTC from HACS but don't know what to do with it. When I tried to create a customer card with the Go2RTC stream, it didn't work, so I am not sure what I am supposed to do with it.

Can you (or anyone else reading this) provide any direction in getting this to work?

wwalcher May 12, 2024

I did downgrade to the April 2023 version of the firmware on the camera, btw.

toxic0berliner · 2024-04-24T07:49:16Z

toxic0berliner
Apr 24, 2024

Maybe I'm mitaken and I didn't pick the proper version to downgrade, but it seems to me version 3215 does not work for 2way audio as mentionned here but when I downgraded to DB_566128M5MP_W.2676_23090700.Reolink-Video-Doorbell-WiFi.OV05A10.5MP.WIFI8812.REOLINK I lost the "play quick reply message" feature... It's more low-tech than 2 way audio but also more useful to me so for now I'll stick with the latest firmware and forego 2way audio...

If someone has the 2 features working (on wifi version preferably) please do correct me and share what firmware version you have, either the download link or at least the version number so I can ask for it to the reolink support tams ;)

Else I fear I can only wayt for the vendor to fix the bug and release a new firmware ;)

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Camera Support]: Troubleshooting 2-way audio with Reolink Doorbell #10619

{{title}}

Replies: 2 comments 9 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

[Camera Support]: Troubleshooting 2-way audio with Reolink Doorbell #10619

soonerfan237 Mar 22, 2024

Describe the problem you are having

Version

Frigate config file

Relevant log output

FFprobe output from your camera

Frigate stats

Operating system

Install method

Coral version

Network connection

Camera make and model

Any other information that may be helpful

Replies: 2 comments · 9 replies

NickM-27 Mar 23, 2024 Collaborator Sponsor

soonerfan237 Mar 23, 2024 Author

NickM-27 Mar 23, 2024 Collaborator Sponsor

soonerfan237 Mar 23, 2024 Author

NickM-27 Mar 23, 2024 Collaborator Sponsor

soonerfan237 Mar 23, 2024 Author

zollak Apr 8, 2024

wwalcher May 12, 2024

wwalcher May 12, 2024

toxic0berliner Apr 24, 2024

soonerfan237
Mar 22, 2024

Replies: 2 comments 9 replies

NickM-27
Mar 23, 2024
Collaborator Sponsor

soonerfan237 Mar 23, 2024
Author

NickM-27 Mar 23, 2024
Collaborator Sponsor

soonerfan237 Mar 23, 2024
Author

NickM-27 Mar 23, 2024
Collaborator Sponsor

soonerfan237 Mar 23, 2024
Author

toxic0berliner
Apr 24, 2024