不接 SRS,只用 Nginx 做 WebRTC 播放:架构与踩坑
引言:已经用 Nginx 做 RTMP 摄入与分发时,为低延迟播放再引一套媒体服务器,代价是两套系统的配置、两套故障点和一路流中转。我们的做法是写一个 Nginx C 模块,让 Nginx 自己把 RTMP 流转成 WebRTC,四个模块各司其职,媒体面直接跑在 stream 模块里。
本文覆盖模块分工、编译配置,以及五类实战踩坑:UDP 端口与防火墙、音频转码开销、DTLS 握手异步化、静默对端与资源泄漏、发送节奏与突发流量。
1. 背景:为什么不想接 SRS
用 Nginx 做 RTMP 推流接收和 HLS/HTTP-FLV 分发,若产品提出"延迟要降到 500ms 以内"时,摆在面前的选项有三个:
- 部署 SRS:功能强大,但需要单独维护,配置两套系统(Nginx + SRS),流需要在两者之间中转,增加复杂度和故障点。
- 使用 MediaMTX 等:同样需要额外部署。
- 直接修改 Nginx-RTMP 模块:原版 Nginx-RTMP 对 WebRTC 支持有限。
于是我们决定:写一个 Nginx C 模块,让 Nginx 自己把 RTMP 流转成 WebRTC。
2. 整体架构:四个模块各司其职
nginx-rtc-module 通过 --add-module 一次性注册四个 Nginx 模块:
| 模块 | 类型 | 职责 |
|---|---|---|
ngx_rtc_core_module |
core | 共享内存 rtc_zone 注册表,管理 RTC 源与跨 worker 会话骨架 |
ngx_rtmp_rtc_bridge_module |
rtmp | 将 RTMP 直播流桥接为 RTC 源(转封装 RTP) |
ngx_rtc_http_module |
http | 播放信令端点(/rtc/v1/play/)与 WHIP 上行端点,统计接口 |
ngx_rtc_stream_module |
stream | UDP 媒体面:处理 ICE/STUN、DTLS 握手、SRTP/SRTCP 加解密 |
数据流与信令流是两条独立的路径,汇合点都在共享内存里的 RTC 源:
text
数据流:RTMP ingest → RTMP bridge → RTC Source (in shared memory) → UDP media plane → Browser
信令流:Browser → HTTP 播放信令 → ngx_rtc_http_module → 创建/匹配 RTC Source → 返回 SDP
#mermaid-svg-500c9MeVAhiKzWZ6{font-size:16px;fill:#17324D;}@keyframes edge-animation-frame{from{stroke-dashoffset:0;}}@keyframes dash{to{stroke-dashoffset:0;}}#mermaid-svg-500c9MeVAhiKzWZ6 .edge-animation-slow{stroke-dasharray:9,5!important;stroke-dashoffset:900;animation:dash 50s linear infinite;stroke-linecap:round;}#mermaid-svg-500c9MeVAhiKzWZ6 .edge-animation-fast{stroke-dasharray:9,5!important;stroke-dashoffset:900;animation:dash 20s linear infinite;stroke-linecap:round;}#mermaid-svg-500c9MeVAhiKzWZ6 .error-icon{fill:hsl(220.5882352941, 100%, 98.3333333333%);}#mermaid-svg-500c9MeVAhiKzWZ6 .error-text{fill:rgb(8.5000000002, 5.7500000001, 0);stroke:rgb(8.5000000002, 5.7500000001, 0);}#mermaid-svg-500c9MeVAhiKzWZ6 .edge-thickness-normal{stroke-width:1px;}#mermaid-svg-500c9MeVAhiKzWZ6 .edge-thickness-thick{stroke-width:3.5px;}#mermaid-svg-500c9MeVAhiKzWZ6 .edge-pattern-solid{stroke-dasharray:0;}#mermaid-svg-500c9MeVAhiKzWZ6 .edge-thickness-invisible{stroke-width:0;fill:none;}#mermaid-svg-500c9MeVAhiKzWZ6 .edge-pattern-dashed{stroke-dasharray:3;}#mermaid-svg-500c9MeVAhiKzWZ6 .edge-pattern-dotted{stroke-dasharray:2;}#mermaid-svg-500c9MeVAhiKzWZ6 .marker{fill:#5B6B7C;stroke:#5B6B7C;}#mermaid-svg-500c9MeVAhiKzWZ6 .marker.cross{stroke:#5B6B7C;}#mermaid-svg-500c9MeVAhiKzWZ6 svg{font-size:16px;}#mermaid-svg-500c9MeVAhiKzWZ6 p{margin:0;}#mermaid-svg-500c9MeVAhiKzWZ6 .label{color:#17324D;}#mermaid-svg-500c9MeVAhiKzWZ6 .cluster-label text{fill:rgb(8.5000000002, 5.7500000001, 0);}#mermaid-svg-500c9MeVAhiKzWZ6 .cluster-label span{color:rgb(8.5000000002, 5.7500000001, 0);}#mermaid-svg-500c9MeVAhiKzWZ6 .cluster-label span p{background-color:transparent;}#mermaid-svg-500c9MeVAhiKzWZ6 .label text,#mermaid-svg-500c9MeVAhiKzWZ6 span{fill:#17324D;color:#17324D;}#mermaid-svg-500c9MeVAhiKzWZ6 .node rect,#mermaid-svg-500c9MeVAhiKzWZ6 .node circle,#mermaid-svg-500c9MeVAhiKzWZ6 .node ellipse,#mermaid-svg-500c9MeVAhiKzWZ6 .node polygon,#mermaid-svg-500c9MeVAhiKzWZ6 .node path{fill:#fff4dd;stroke:hsl(40.5882352941, 60%, 83.3333333333%);stroke-width:1px;}#mermaid-svg-500c9MeVAhiKzWZ6 .rough-node .label text,#mermaid-svg-500c9MeVAhiKzWZ6 .node .label text,#mermaid-svg-500c9MeVAhiKzWZ6 .image-shape .label,#mermaid-svg-500c9MeVAhiKzWZ6 .icon-shape .label{text-anchor:middle;}#mermaid-svg-500c9MeVAhiKzWZ6 .node .katex path{fill:#000;stroke:#000;stroke-width:1px;}#mermaid-svg-500c9MeVAhiKzWZ6 .rough-node .label,#mermaid-svg-500c9MeVAhiKzWZ6 .node .label,#mermaid-svg-500c9MeVAhiKzWZ6 .image-shape .label,#mermaid-svg-500c9MeVAhiKzWZ6 .icon-shape .label{text-align:center;}#mermaid-svg-500c9MeVAhiKzWZ6 .node.clickable{cursor:pointer;}#mermaid-svg-500c9MeVAhiKzWZ6 .root .anchor path{fill:#5B6B7C!important;stroke-width:0;stroke:#5B6B7C;}#mermaid-svg-500c9MeVAhiKzWZ6 .arrowheadPath{fill:#0b0b0b;}#mermaid-svg-500c9MeVAhiKzWZ6 .edgePath .path{stroke:#5B6B7C;stroke-width:2.0px;}#mermaid-svg-500c9MeVAhiKzWZ6 .flowchart-link{stroke:#5B6B7C;fill:none;}#mermaid-svg-500c9MeVAhiKzWZ6 .edgeLabel{background-color:#FFFFFF;text-align:center;}#mermaid-svg-500c9MeVAhiKzWZ6 .edgeLabel p{background-color:#FFFFFF;}#mermaid-svg-500c9MeVAhiKzWZ6 .edgeLabel rect{opacity:0.5;background-color:#FFFFFF;fill:#FFFFFF;}#mermaid-svg-500c9MeVAhiKzWZ6 .labelBkg{background-color:rgba(255, 255, 255, 0.5);}#mermaid-svg-500c9MeVAhiKzWZ6 .cluster rect{fill:hsl(220.5882352941, 100%, 98.3333333333%);stroke:hsl(220.5882352941, 60%, 88.3333333333%);stroke-width:1px;}#mermaid-svg-500c9MeVAhiKzWZ6 .cluster text{fill:rgb(8.5000000002, 5.7500000001, 0);}#mermaid-svg-500c9MeVAhiKzWZ6 .cluster span{color:rgb(8.5000000002, 5.7500000001, 0);}#mermaid-svg-500c9MeVAhiKzWZ6 div.mermaidTooltip{position:absolute;text-align:center;max-width:200px;padding:2px;font-size:12px;background:hsl(220.5882352941, 100%, 98.3333333333%);border:1px solid hsl(220.5882352941, 60%, 88.3333333333%);border-radius:2px;pointer-events:none;z-index:100;}#mermaid-svg-500c9MeVAhiKzWZ6 .flowchartTitleText{text-anchor:middle;font-size:18px;fill:#17324D;}#mermaid-svg-500c9MeVAhiKzWZ6 rect.text{fill:none;stroke-width:0;}#mermaid-svg-500c9MeVAhiKzWZ6 .icon-shape,#mermaid-svg-500c9MeVAhiKzWZ6 .image-shape{background-color:#FFFFFF;text-align:center;}#mermaid-svg-500c9MeVAhiKzWZ6 .icon-shape p,#mermaid-svg-500c9MeVAhiKzWZ6 .image-shape p{background-color:#FFFFFF;padding:2px;}#mermaid-svg-500c9MeVAhiKzWZ6 .icon-shape .label rect,#mermaid-svg-500c9MeVAhiKzWZ6 .image-shape .label rect{opacity:0.5;background-color:#FFFFFF;fill:#FFFFFF;}#mermaid-svg-500c9MeVAhiKzWZ6 .label-icon{display:inline-block;height:1em;overflow:visible;vertical-align:-0.125em;}#mermaid-svg-500c9MeVAhiKzWZ6 .node .label-icon path{fill:currentColor;stroke:revert;stroke-width:revert;}#mermaid-svg-500c9MeVAhiKzWZ6 :root{--mermaid-font-family:"trebuchet ms",verdana,arial,sans-serif;}#mermaid-svg-500c9MeVAhiKzWZ6 .row>*{fill:#F3F4F6!important;stroke:#9AA4B2!important;color:#17324D!important;}#mermaid-svg-500c9MeVAhiKzWZ6 .row span{fill:#F3F4F6!important;stroke:#9AA4B2!important;color:#17324D!important;}#mermaid-svg-500c9MeVAhiKzWZ6 .row tspan{fill:#17324D!important;}#mermaid-svg-500c9MeVAhiKzWZ6 .user>*{fill:#E8F1FB!important;stroke:#3B82C4!important;color:#17324D!important;}#mermaid-svg-500c9MeVAhiKzWZ6 .user span{fill:#E8F1FB!important;stroke:#3B82C4!important;color:#17324D!important;}#mermaid-svg-500c9MeVAhiKzWZ6 .user tspan{fill:#17324D!important;}#mermaid-svg-500c9MeVAhiKzWZ6 .dec>*{fill:#fef3c7!important;stroke:#D99A2B!important;color:#5A3B00!important;}#mermaid-svg-500c9MeVAhiKzWZ6 .dec span{fill:#fef3c7!important;stroke:#D99A2B!important;color:#5A3B00!important;}#mermaid-svg-500c9MeVAhiKzWZ6 .dec tspan{fill:#5A3B00!important;}#mermaid-svg-500c9MeVAhiKzWZ6 .warn>*{fill:#FDE8E8!important;stroke:#C0392B!important;color:#5A1A14!important;}#mermaid-svg-500c9MeVAhiKzWZ6 .warn span{fill:#FDE8E8!important;stroke:#C0392B!important;color:#5A1A14!important;}#mermaid-svg-500c9MeVAhiKzWZ6 .warn tspan{fill:#5A1A14!important;} RTMP 1935
明文 RTP 写入
令牌桶整形
UDP 8000
SRTP 媒体流
HTTPS 443
注册会话与源
媒体主链
OBS 与 FFmpeg
RTMP 面
bridge 模块
转封装 RTP
核心控制面
core 模块
rtc_zone 共享内存
UDP 媒体面
stream 模块
SRTP 加密发送
播放端
WebRTC Peer
信令链
客户端发起播放
HTTP 信令面
http 模块
播放端点与 SDP
图 1:四个模块的分工与两条数据链。媒体主链从推流走到播放端,信令链从播放请求回到核心控制面;端口与数据流都标在连线上。
#mermaid-svg-ob0t84Ej0F2SQCrk{font-size:16px;fill:#17324D;}@keyframes edge-animation-frame{from{stroke-dashoffset:0;}}@keyframes dash{to{stroke-dashoffset:0;}}#mermaid-svg-ob0t84Ej0F2SQCrk .edge-animation-slow{stroke-dasharray:9,5!important;stroke-dashoffset:900;animation:dash 50s linear infinite;stroke-linecap:round;}#mermaid-svg-ob0t84Ej0F2SQCrk .edge-animation-fast{stroke-dasharray:9,5!important;stroke-dashoffset:900;animation:dash 20s linear infinite;stroke-linecap:round;}#mermaid-svg-ob0t84Ej0F2SQCrk .error-icon{fill:hsl(220.5882352941, 100%, 98.3333333333%);}#mermaid-svg-ob0t84Ej0F2SQCrk .error-text{fill:rgb(8.5000000002, 5.7500000001, 0);stroke:rgb(8.5000000002, 5.7500000001, 0);}#mermaid-svg-ob0t84Ej0F2SQCrk .edge-thickness-normal{stroke-width:1px;}#mermaid-svg-ob0t84Ej0F2SQCrk .edge-thickness-thick{stroke-width:3.5px;}#mermaid-svg-ob0t84Ej0F2SQCrk .edge-pattern-solid{stroke-dasharray:0;}#mermaid-svg-ob0t84Ej0F2SQCrk .edge-thickness-invisible{stroke-width:0;fill:none;}#mermaid-svg-ob0t84Ej0F2SQCrk .edge-pattern-dashed{stroke-dasharray:3;}#mermaid-svg-ob0t84Ej0F2SQCrk .edge-pattern-dotted{stroke-dasharray:2;}#mermaid-svg-ob0t84Ej0F2SQCrk .marker{fill:#5B6B7C;stroke:#5B6B7C;}#mermaid-svg-ob0t84Ej0F2SQCrk .marker.cross{stroke:#5B6B7C;}#mermaid-svg-ob0t84Ej0F2SQCrk svg{font-size:16px;}#mermaid-svg-ob0t84Ej0F2SQCrk p{margin:0;}#mermaid-svg-ob0t84Ej0F2SQCrk .label{color:#17324D;}#mermaid-svg-ob0t84Ej0F2SQCrk .cluster-label text{fill:rgb(8.5000000002, 5.7500000001, 0);}#mermaid-svg-ob0t84Ej0F2SQCrk .cluster-label span{color:rgb(8.5000000002, 5.7500000001, 0);}#mermaid-svg-ob0t84Ej0F2SQCrk .cluster-label span p{background-color:transparent;}#mermaid-svg-ob0t84Ej0F2SQCrk .label text,#mermaid-svg-ob0t84Ej0F2SQCrk span{fill:#17324D;color:#17324D;}#mermaid-svg-ob0t84Ej0F2SQCrk .node rect,#mermaid-svg-ob0t84Ej0F2SQCrk .node circle,#mermaid-svg-ob0t84Ej0F2SQCrk .node ellipse,#mermaid-svg-ob0t84Ej0F2SQCrk .node polygon,#mermaid-svg-ob0t84Ej0F2SQCrk .node path{fill:#fff4dd;stroke:hsl(40.5882352941, 60%, 83.3333333333%);stroke-width:1px;}#mermaid-svg-ob0t84Ej0F2SQCrk .rough-node .label text,#mermaid-svg-ob0t84Ej0F2SQCrk .node .label text,#mermaid-svg-ob0t84Ej0F2SQCrk .image-shape .label,#mermaid-svg-ob0t84Ej0F2SQCrk .icon-shape .label{text-anchor:middle;}#mermaid-svg-ob0t84Ej0F2SQCrk .node .katex path{fill:#000;stroke:#000;stroke-width:1px;}#mermaid-svg-ob0t84Ej0F2SQCrk .rough-node .label,#mermaid-svg-ob0t84Ej0F2SQCrk .node .label,#mermaid-svg-ob0t84Ej0F2SQCrk .image-shape .label,#mermaid-svg-ob0t84Ej0F2SQCrk .icon-shape .label{text-align:center;}#mermaid-svg-ob0t84Ej0F2SQCrk .node.clickable{cursor:pointer;}#mermaid-svg-ob0t84Ej0F2SQCrk .root .anchor path{fill:#5B6B7C!important;stroke-width:0;stroke:#5B6B7C;}#mermaid-svg-ob0t84Ej0F2SQCrk .arrowheadPath{fill:#0b0b0b;}#mermaid-svg-ob0t84Ej0F2SQCrk .edgePath .path{stroke:#5B6B7C;stroke-width:2.0px;}#mermaid-svg-ob0t84Ej0F2SQCrk .flowchart-link{stroke:#5B6B7C;fill:none;}#mermaid-svg-ob0t84Ej0F2SQCrk .edgeLabel{background-color:#FFFFFF;text-align:center;}#mermaid-svg-ob0t84Ej0F2SQCrk .edgeLabel p{background-color:#FFFFFF;}#mermaid-svg-ob0t84Ej0F2SQCrk .edgeLabel rect{opacity:0.5;background-color:#FFFFFF;fill:#FFFFFF;}#mermaid-svg-ob0t84Ej0F2SQCrk .labelBkg{background-color:rgba(255, 255, 255, 0.5);}#mermaid-svg-ob0t84Ej0F2SQCrk .cluster rect{fill:hsl(220.5882352941, 100%, 98.3333333333%);stroke:hsl(220.5882352941, 60%, 88.3333333333%);stroke-width:1px;}#mermaid-svg-ob0t84Ej0F2SQCrk .cluster text{fill:rgb(8.5000000002, 5.7500000001, 0);}#mermaid-svg-ob0t84Ej0F2SQCrk .cluster span{color:rgb(8.5000000002, 5.7500000001, 0);}#mermaid-svg-ob0t84Ej0F2SQCrk div.mermaidTooltip{position:absolute;text-align:center;max-width:200px;padding:2px;font-size:12px;background:hsl(220.5882352941, 100%, 98.3333333333%);border:1px solid hsl(220.5882352941, 60%, 88.3333333333%);border-radius:2px;pointer-events:none;z-index:100;}#mermaid-svg-ob0t84Ej0F2SQCrk .flowchartTitleText{text-anchor:middle;font-size:18px;fill:#17324D;}#mermaid-svg-ob0t84Ej0F2SQCrk rect.text{fill:none;stroke-width:0;}#mermaid-svg-ob0t84Ej0F2SQCrk .icon-shape,#mermaid-svg-ob0t84Ej0F2SQCrk .image-shape{background-color:#FFFFFF;text-align:center;}#mermaid-svg-ob0t84Ej0F2SQCrk .icon-shape p,#mermaid-svg-ob0t84Ej0F2SQCrk .image-shape p{background-color:#FFFFFF;padding:2px;}#mermaid-svg-ob0t84Ej0F2SQCrk .icon-shape .label rect,#mermaid-svg-ob0t84Ej0F2SQCrk .image-shape .label rect{opacity:0.5;background-color:#FFFFFF;fill:#FFFFFF;}#mermaid-svg-ob0t84Ej0F2SQCrk .label-icon{display:inline-block;height:1em;overflow:visible;vertical-align:-0.125em;}#mermaid-svg-ob0t84Ej0F2SQCrk .node .label-icon path{fill:currentColor;stroke:revert;stroke-width:revert;}#mermaid-svg-ob0t84Ej0F2SQCrk :root{--mermaid-font-family:"trebuchet ms",verdana,arial,sans-serif;}#mermaid-svg-ob0t84Ej0F2SQCrk .row>*{fill:#F3F4F6!important;stroke:#9AA4B2!important;color:#17324D!important;}#mermaid-svg-ob0t84Ej0F2SQCrk .row span{fill:#F3F4F6!important;stroke:#9AA4B2!important;color:#17324D!important;}#mermaid-svg-ob0t84Ej0F2SQCrk .row tspan{fill:#17324D!important;}#mermaid-svg-ob0t84Ej0F2SQCrk .user>*{fill:#E8F1FB!important;stroke:#3B82C4!important;color:#17324D!important;}#mermaid-svg-ob0t84Ej0F2SQCrk .user span{fill:#E8F1FB!important;stroke:#3B82C4!important;color:#17324D!important;}#mermaid-svg-ob0t84Ej0F2SQCrk .user tspan{fill:#17324D!important;}#mermaid-svg-ob0t84Ej0F2SQCrk .dec>*{fill:#fef3c7!important;stroke:#D99A2B!important;color:#5A3B00!important;}#mermaid-svg-ob0t84Ej0F2SQCrk .dec span{fill:#fef3c7!important;stroke:#D99A2B!important;color:#5A3B00!important;}#mermaid-svg-ob0t84Ej0F2SQCrk .dec tspan{fill:#5A3B00!important;}#mermaid-svg-ob0t84Ej0F2SQCrk .warn>*{fill:#FDE8E8!important;stroke:#C0392B!important;color:#5A1A14!important;}#mermaid-svg-ob0t84Ej0F2SQCrk .warn span{fill:#FDE8E8!important;stroke:#C0392B!important;color:#5A1A14!important;}#mermaid-svg-ob0t84Ej0F2SQCrk .warn tspan{fill:#5A1A14!important;} 接收链
UDP 报文到达
报文分流
STUN / DTLS / SRTCP / SRTP
会话处理
应答、握手、解密
共享内存
RTC 源与会话骨架
发送链
取出明文 RTP
令牌桶整形
按码率限速
SRTP 加密
按会话密钥
UDP 发出
到浏览器
图 2:媒体面在 Nginx 内的两条链。接收链把四类报文分派到对应处理,发送链从共享内存取包、整形、加密后发出。
3. 编译与配置示例
依赖静态库:libavcodec、libswresample、libavutil、libopus、libsrtp2,通过环境变量指定:
bash
export NGX_RTC_THIRD=/opt/ngx-rtc-third
./configure --prefix=/usr/local/nginx \
--add-module=/path/to/nginx-rtc-module \
--with-http_ssl_module \
--with-stream
make -j$(nproc)
nginx.conf 关键配置:
rtmp {
server {
listen 1935;
application live {
live on;
# 启用 RTC 桥接
rtc_bridge on;
}
}
}
http {
server {
listen 443 ssl;
location /rtc/v1/play/ {
rtc_signaling on;
}
}
}
stream {
server {
listen 8000 udp;
rtc_media on; # 启用 UDP 媒体面
}
}
4. 推流与播放
bash
# 推流(RTMP)
ffmpeg -re -i test.mp4 -c:v libx264 -c:a aac -f flv rtmp://localhost/live/stream1
浏览器播放需要 HTTPS 页面,使用模块自带的播放页或自行集成 WebRTC 播放器。
5. 踩坑实录
5.1 UDP 端口与防火墙
WebRTC 需要 UDP 端口进行媒体传输。我们最初只开放了 TCP 端口,导致 ICE 连通性检查失败。解决:在 stream 块中监听 UDP 端口,并确保防火墙放行。
5.2 音频转码性能
RTMP 常用 AAC,而 WebRTC 通常要求 Opus。我们在桥接模块中集成了 FFmpeg 的 libavcodec、libswresample 与 libopus 进行实时转码。初期发现 CPU 占用高,后来通过三件事把单路转码 CPU 降到可接受范围:
- 限制转码通道数(只转混音后的单声道)。
- 使用 libopus 的浮点优化。
- 在 Nginx worker 进程中合理分配转码任务。
5.3 DTLS 握手在 Nginx 中的异步处理
Nginx 的 stream 模块本身是事件驱动的,但 DTLS 握手(基于 OpenSSL)默认是阻塞的。我们给每个会话建一对内存 BIO:网络侧读到的字节写进输入 BIO,OpenSSL 要发出的字节从输出 BIO 取出后交给 socket 发送,握手全程在内存里推进,不阻塞 worker;重传定时器的期限由 OpenSSL 的超时接口给出,由 Nginx 事件循环到期触发。
session_fsm(会话状态机)只做状态判定、不执行动作。真实状态是 NEW、ICE_BOUND、DTLS_HANDSHAKE、SRTP_READY、CLOSED 五个,关闭、超时与收到上报退出三类事件挂在根状态上,从任何状态都能收敛到关闭。真正持有连接与 DTLS/SRTP 上下文的是 stream 模块,它才是执行者------这样状态机里不存指针,生命周期不会与连接脱钩。
5.4 静默 Peer 与资源泄漏
有些客户端建立连接后不再收发数据(如页面后台、网络中断),服务端会一直占用连接与共享内存骨架。v0.7.0 引入了静默对端闸门:默认静默阈值 10 秒,超过阈值就扣住不再发送的媒体并计数,计数会透出到统计接口。
这个闸门不关闭会话,只扣媒体。会话回收靠两条路径:管理员显式踢除,以及握手中与就绪后各自的空闲超时。v0.7.0 还补上了服务端侧的往返时延测量(按 RFC 3550,用发送报告的到达时刻减去发送时刻再减去驻留时间),结果写入共享内存供统计接口读取。
5.5 Pacing 与突发流量
直接转发 RTP 包可能导致瞬间发送过多,引发网络拥塞。我们用令牌桶在发送路径上内联判定:1 个令牌对应 1 字节,按目标码率随时间补充,桶容量按 100 ms 的突发窗口计算。没有独立的 pacing 定时器,也不排队,桶里没有令牌就直接丢包计数,交给客户端用 NACK/PLI 恢复。
目标码率由丢包统计调整:每 500 ms 或每 20 个包统计一次窗口丢失率,超过 5% 乘性降速,低于 2% 加性升速;接收端上报的带宽估计只作上限,且只降不升。关键帧访问单元整体豁免限速------关键帧一旦被限速,观众等的就是下一个关键帧间隔,体验损失远大于瞬时突发。
#mermaid-svg-K4exVMbuqpYg3oFx{font-size:16px;fill:#17324D;}@keyframes edge-animation-frame{from{stroke-dashoffset:0;}}@keyframes dash{to{stroke-dashoffset:0;}}#mermaid-svg-K4exVMbuqpYg3oFx .edge-animation-slow{stroke-dasharray:9,5!important;stroke-dashoffset:900;animation:dash 50s linear infinite;stroke-linecap:round;}#mermaid-svg-K4exVMbuqpYg3oFx .edge-animation-fast{stroke-dasharray:9,5!important;stroke-dashoffset:900;animation:dash 20s linear infinite;stroke-linecap:round;}#mermaid-svg-K4exVMbuqpYg3oFx .error-icon{fill:hsl(220.5882352941, 100%, 98.3333333333%);}#mermaid-svg-K4exVMbuqpYg3oFx .error-text{fill:rgb(8.5000000002, 5.7500000001, 0);stroke:rgb(8.5000000002, 5.7500000001, 0);}#mermaid-svg-K4exVMbuqpYg3oFx .edge-thickness-normal{stroke-width:1px;}#mermaid-svg-K4exVMbuqpYg3oFx .edge-thickness-thick{stroke-width:3.5px;}#mermaid-svg-K4exVMbuqpYg3oFx .edge-pattern-solid{stroke-dasharray:0;}#mermaid-svg-K4exVMbuqpYg3oFx .edge-thickness-invisible{stroke-width:0;fill:none;}#mermaid-svg-K4exVMbuqpYg3oFx .edge-pattern-dashed{stroke-dasharray:3;}#mermaid-svg-K4exVMbuqpYg3oFx .edge-pattern-dotted{stroke-dasharray:2;}#mermaid-svg-K4exVMbuqpYg3oFx .marker{fill:#5B6B7C;stroke:#5B6B7C;}#mermaid-svg-K4exVMbuqpYg3oFx .marker.cross{stroke:#5B6B7C;}#mermaid-svg-K4exVMbuqpYg3oFx svg{font-size:16px;}#mermaid-svg-K4exVMbuqpYg3oFx p{margin:0;}#mermaid-svg-K4exVMbuqpYg3oFx .label{color:#17324D;}#mermaid-svg-K4exVMbuqpYg3oFx .cluster-label text{fill:rgb(8.5000000002, 5.7500000001, 0);}#mermaid-svg-K4exVMbuqpYg3oFx .cluster-label span{color:rgb(8.5000000002, 5.7500000001, 0);}#mermaid-svg-K4exVMbuqpYg3oFx .cluster-label span p{background-color:transparent;}#mermaid-svg-K4exVMbuqpYg3oFx .label text,#mermaid-svg-K4exVMbuqpYg3oFx span{fill:#17324D;color:#17324D;}#mermaid-svg-K4exVMbuqpYg3oFx .node rect,#mermaid-svg-K4exVMbuqpYg3oFx .node circle,#mermaid-svg-K4exVMbuqpYg3oFx .node ellipse,#mermaid-svg-K4exVMbuqpYg3oFx .node polygon,#mermaid-svg-K4exVMbuqpYg3oFx .node path{fill:#fff4dd;stroke:hsl(40.5882352941, 60%, 83.3333333333%);stroke-width:1px;}#mermaid-svg-K4exVMbuqpYg3oFx .rough-node .label text,#mermaid-svg-K4exVMbuqpYg3oFx .node .label text,#mermaid-svg-K4exVMbuqpYg3oFx .image-shape .label,#mermaid-svg-K4exVMbuqpYg3oFx .icon-shape .label{text-anchor:middle;}#mermaid-svg-K4exVMbuqpYg3oFx .node .katex path{fill:#000;stroke:#000;stroke-width:1px;}#mermaid-svg-K4exVMbuqpYg3oFx .rough-node .label,#mermaid-svg-K4exVMbuqpYg3oFx .node .label,#mermaid-svg-K4exVMbuqpYg3oFx .image-shape .label,#mermaid-svg-K4exVMbuqpYg3oFx .icon-shape .label{text-align:center;}#mermaid-svg-K4exVMbuqpYg3oFx .node.clickable{cursor:pointer;}#mermaid-svg-K4exVMbuqpYg3oFx .root .anchor path{fill:#5B6B7C!important;stroke-width:0;stroke:#5B6B7C;}#mermaid-svg-K4exVMbuqpYg3oFx .arrowheadPath{fill:#0b0b0b;}#mermaid-svg-K4exVMbuqpYg3oFx .edgePath .path{stroke:#5B6B7C;stroke-width:2.0px;}#mermaid-svg-K4exVMbuqpYg3oFx .flowchart-link{stroke:#5B6B7C;fill:none;}#mermaid-svg-K4exVMbuqpYg3oFx .edgeLabel{background-color:#FFFFFF;text-align:center;}#mermaid-svg-K4exVMbuqpYg3oFx .edgeLabel p{background-color:#FFFFFF;}#mermaid-svg-K4exVMbuqpYg3oFx .edgeLabel rect{opacity:0.5;background-color:#FFFFFF;fill:#FFFFFF;}#mermaid-svg-K4exVMbuqpYg3oFx .labelBkg{background-color:rgba(255, 255, 255, 0.5);}#mermaid-svg-K4exVMbuqpYg3oFx .cluster rect{fill:hsl(220.5882352941, 100%, 98.3333333333%);stroke:hsl(220.5882352941, 60%, 88.3333333333%);stroke-width:1px;}#mermaid-svg-K4exVMbuqpYg3oFx .cluster text{fill:rgb(8.5000000002, 5.7500000001, 0);}#mermaid-svg-K4exVMbuqpYg3oFx .cluster span{color:rgb(8.5000000002, 5.7500000001, 0);}#mermaid-svg-K4exVMbuqpYg3oFx div.mermaidTooltip{position:absolute;text-align:center;max-width:200px;padding:2px;font-size:12px;background:hsl(220.5882352941, 100%, 98.3333333333%);border:1px solid hsl(220.5882352941, 60%, 88.3333333333%);border-radius:2px;pointer-events:none;z-index:100;}#mermaid-svg-K4exVMbuqpYg3oFx .flowchartTitleText{text-anchor:middle;font-size:18px;fill:#17324D;}#mermaid-svg-K4exVMbuqpYg3oFx rect.text{fill:none;stroke-width:0;}#mermaid-svg-K4exVMbuqpYg3oFx .icon-shape,#mermaid-svg-K4exVMbuqpYg3oFx .image-shape{background-color:#FFFFFF;text-align:center;}#mermaid-svg-K4exVMbuqpYg3oFx .icon-shape p,#mermaid-svg-K4exVMbuqpYg3oFx .image-shape p{background-color:#FFFFFF;padding:2px;}#mermaid-svg-K4exVMbuqpYg3oFx .icon-shape .label rect,#mermaid-svg-K4exVMbuqpYg3oFx .image-shape .label rect{opacity:0.5;background-color:#FFFFFF;fill:#FFFFFF;}#mermaid-svg-K4exVMbuqpYg3oFx .label-icon{display:inline-block;height:1em;overflow:visible;vertical-align:-0.125em;}#mermaid-svg-K4exVMbuqpYg3oFx .node .label-icon path{fill:currentColor;stroke:revert;stroke-width:revert;}#mermaid-svg-K4exVMbuqpYg3oFx :root{--mermaid-font-family:"trebuchet ms",verdana,arial,sans-serif;}#mermaid-svg-K4exVMbuqpYg3oFx .row>*{fill:#F3F4F6!important;stroke:#9AA4B2!important;color:#17324D!important;}#mermaid-svg-K4exVMbuqpYg3oFx .row span{fill:#F3F4F6!important;stroke:#9AA4B2!important;color:#17324D!important;}#mermaid-svg-K4exVMbuqpYg3oFx .row tspan{fill:#17324D!important;}#mermaid-svg-K4exVMbuqpYg3oFx .user>*{fill:#E8F1FB!important;stroke:#3B82C4!important;color:#17324D!important;}#mermaid-svg-K4exVMbuqpYg3oFx .user span{fill:#E8F1FB!important;stroke:#3B82C4!important;color:#17324D!important;}#mermaid-svg-K4exVMbuqpYg3oFx .user tspan{fill:#17324D!important;}#mermaid-svg-K4exVMbuqpYg3oFx .dec>*{fill:#fef3c7!important;stroke:#D99A2B!important;color:#5A3B00!important;}#mermaid-svg-K4exVMbuqpYg3oFx .dec span{fill:#fef3c7!important;stroke:#D99A2B!important;color:#5A3B00!important;}#mermaid-svg-K4exVMbuqpYg3oFx .dec tspan{fill:#5A3B00!important;}#mermaid-svg-K4exVMbuqpYg3oFx .warn>*{fill:#FDE8E8!important;stroke:#C0392B!important;color:#5A1A14!important;}#mermaid-svg-K4exVMbuqpYg3oFx .warn span{fill:#FDE8E8!important;stroke:#C0392B!important;color:#5A1A14!important;}#mermaid-svg-K4exVMbuqpYg3oFx .warn tspan{fill:#5A1A14!important;} 发布路径
Worker 1
RTMP Bridge
写入明文 RTP
媒体环 1
共享内存内
Stream Module
出队并加密
浏览器 1
发布路径
Worker 2
RTMP Bridge
写入明文 RTP
媒体环 2
共享内存内
Stream Module
出队并加密
浏览器 2
共享内存 rtc_zone
组成
源注册表
按流名散列
会话骨架
RTT 与静默计数
每 worker 一条媒体环
加唤醒描述符
布局版本标记
不匹配则拒绝启动
图 3:多 worker 下的媒体投递。两条发布路径各写各的媒体环,媒体环本身就在共享内存里;第三行列出这块共享内存的组成。访问顺序只允许从池锁到环锁,禁止反向。
6. 性能与稳定性
- 共享内存
rtc_zone允许多个 worker 进程访问同一个 RTC 源,实现推流与播放的横向扩展。 - 纯 C 编写,无 GC 开销,媒体热路径没有协程、没有自建线程与队列,全部跑在 Nginx 单事件循环内(唯一例外是每路音频转码的独立线程)。
- 主机单元测试 183 例(默认组 158 例,另加 SRTP/DTLS/音频/音频线程四组专题 10/5/5/5),覆盖 RTP 封包、SRTP 加解密、STUN 解析与校验、DTLS 真实握手等纯 C 核心。
7. 适用场景
- 已有 Nginx 做 RTMP 摄入,希望快速增加 WebRTC 低延迟播放。
- 不想引入额外媒体服务器,降低运维复杂度。
- 需要嵌入式或边缘节点部署,资源受限环境。
项目开源地址:https://github.com/DeguiLiu/nginx-rtc-module
配套示例仓库(含 Docker、Lua 鉴权、播放页):https://github.com/DeguiLiu/nginx-rtc-example
欢迎 Star、提 Issue 或 PR!