Media3 ExoPlayer无法播放不带.m3u8后缀hls媒资

1.问题发现

播放报错None of the available extractors (没有可用的媒资提取器) , 错误码 ERROR_CODE_PARSING_CONTAINER_UNSUPPORTED (表示解析媒体容器格式错误)

shell 复制代码
None of the available extractors (FlvExtractor, FlacExtractor, WavExtractor, FragmentedMp4Extractor, Mp4Extractor, AmrExtractor, PsExtractor, OggExtractor, TsExtractor, MatroskaExtractor, AdtsExtractor, Ac3Extractor, Ac4Extractor, Mp3Extractor, AviExtractor, JpegExtractor, PngExtractor, WebpExtractor, BmpExtractor, HeifExtractor, AvifExtractor) could read the stream. {contentIsMalformed=false, dataType=1}

2.问题分析

2.1 错误位置

找到报错的源码位置

Java 复制代码
@Override
public void init(
    DataReader dataReader,
    Uri uri,
    Map<String, List<String>> responseHeaders,
    long position,
    long length,
    ExtractorOutput output)
    throws IOException {
  //根据uri和响应头信息,通过工厂接口创建一组媒体提取器(Extractor)实例,用于后续尝试解析媒体流。
  Extractor[] extractors = extractorsFactory.createExtractors(uri, responseHeaders);
  ImmutableList.Builder<SniffFailure> sniffFailures =
      ImmutableList.builderWithExpectedSize(extractors.length);
  if (extractors.length == 1) {
    this.extractor = extractors[0];
  } else {
    for (Extractor extractor : extractors) {
      try {
          //嗅探(通过读取数据流的头部信息来判断格式匹配度)检测当前 Extractor 是否能够识别并处理输入的媒体数据流 
        if (extractor.sniff(extractorInput)) {
          this.extractor = extractor;
          break;
        } else {
          List<SniffFailure> sniffFailureDetails = extractor.getSniffFailureDetails();
          sniffFailures.addAll(sniffFailureDetails);
        }
      } catch (EOFException e) {
        // Do nothing.
      } finally {
        Assertions.checkState(this.extractor != null || extractorInput.getPosition() == position);
        extractorInput.resetPeekPosition();
      }
    }
    //没有找到合适的媒资提取器会抛出异常
    if (extractor == null) {
      //【sss】如果是没有.m3u8后缀的hls媒资,会走到这里
      throw new UnrecognizedInputFormatException(
          "None of the available extractors ("
              + Joiner.on(", ")
                  .join(
                      Lists.transform(
                          ImmutableList.copyOf(extractors),
                          extractor ->
                              extractor.getUnderlyingImplementation().getClass().getSimpleName()))
              + ") could read the stream.",
          Assertions.checkNotNull(uri),
          sniffFailures.build());
    }
  }
  extractor.init(output);
}
2.2 媒资信息

用ffmpeg命令查看媒资基本信息

arduino 复制代码
`ffprobe -v quiet -print_format json -show_format "http://xxx"`

输出结果:

java 复制代码
{
    "format": {
        "filename": "http://xxx",
        "nb_streams": 2,
        "nb_programs": 1,
        "nb_stream_groups": 0,
        "format_name": "hls",
        "format_long_name": "Apple HTTP Live Streaming",
        "start_time": "1.480000",
        "duration": "6438.880000",
        "size": "68",
        "probe_score": 100
    }
}

流媒体特征

  • format_name: hls - 确认这是HLS (HTTP Live Streaming) 格式
  • format_long_name: Apple HTTP Live Streaming - Apple开发的流媒体协议

通常.m3u8是最典型的HLS文件后缀,看下ExoPlayer怎么处理的HLS流

3.源码分析

我们设置媒体地址开始看起

Java 复制代码
player.setMediaItem(MediaItem.fromUri(url));

经过一系列调用

Java 复制代码
@Override
public void setMediaItems(List<MediaItem> mediaItems, boolean resetPosition) {
  verifyApplicationThread();
  setMediaSources(createMediaSources(mediaItems), resetPosition);
}

@UnstableApi
  @Override
  public MediaSource createMediaSource(MediaItem mediaItem) {
    Assertions.checkNotNull(mediaItem.localConfiguration);
    @Nullable String scheme = mediaItem.localConfiguration.uri.getScheme();
    //...
    //【sss】根据媒体项的 uri 和 设置的mimeType 类型推断出内容类型(如 HLS),用于后续选择合适的媒体源工厂进行处理
    @C.ContentType
    int type =
        Util.inferContentTypeForUriAndMimeType(
            mediaItem.localConfiguration.uri, mediaItem.localConfiguration.mimeType);
    if (mediaItem.localConfiguration.imageDurationMs != C.TIME_UNSET) {
      delegateFactoryLoader.setJpegExtractorFlags(JpegExtractor.FLAG_READ_IMAGE);
    }

    MediaSource.Factory mediaSourceFactory;
    try {
      //【sss】选择合适的媒体源工厂进行处理
      mediaSourceFactory = delegateFactoryLoader.getMediaSourceFactory(type);
    } catch (ClassNotFoundException e) {
      throw new IllegalStateException(e);
    }
    //...
  }

通过inferContentTypeForUriAndMimeType函数从Uri和可选MIME类型推断ContentType的功能。

Java 复制代码
public static @ContentType int inferContentTypeForUriAndMimeType(
      Uri uri, @Nullable String mimeType) {
    //默认mimeType为null
    if (mimeType == null) {
      return inferContentType(uri);
    }
    //通过设置的mimeType去匹配
    switch (mimeType) {
      case MimeTypes.APPLICATION_MPD:
        return C.CONTENT_TYPE_DASH;
      case MimeTypes.APPLICATION_M3U8:
        return C.CONTENT_TYPE_HLS;
      case MimeTypes.APPLICATION_SS:
        return C.CONTENT_TYPE_SS;
      case MimeTypes.APPLICATION_RTSP:
        return C.CONTENT_TYPE_RTSP;
      default:
        return C.CONTENT_TYPE_OTHER;
    }
  }

public static @ContentType int inferContentType(Uri uri) {
    @Nullable String scheme = uri.getScheme();
    //rtsp匹配
    if (scheme != null
        && (Ascii.equalsIgnoreCase("rtsp", scheme) || Ascii.equalsIgnoreCase("rtspt", scheme))) {
      return C.CONTENT_TYPE_RTSP;
    }

    @Nullable String lastPathSegment = uri.getLastPathSegment();
    if (lastPathSegment == null) {
      return C.CONTENT_TYPE_OTHER;
    }
    int lastDotIndex = lastPathSegment.lastIndexOf('.');
    if (lastDotIndex >= 0) {
      @C.ContentType
      //取后缀名匹配(.m3u8识别为hls)
      int contentType = inferContentTypeForExtension(lastPathSegment.substring(lastDotIndex + 1));
      if (contentType != C.CONTENT_TYPE_OTHER) {
        // If contentType is TYPE_SS that indicates the extension is .ism or .isml and shows the ISM
        // URI is missing the "/manifest" suffix, which contains the information used to
        // disambiguate between Smooth Streaming, HLS and DASH below - so we can just return TYPE_SS
        // here without further checks.
        return contentType;
      }
    }
	//URI包含查询参数 format=m3u8-aapl 会被识别为hls
    Matcher ismMatcher = ISM_PATH_PATTERN.matcher(checkNotNull(uri.getPath()));
    if (ismMatcher.matches()) {
      @Nullable String extensions = ismMatcher.group(2);
      if (extensions != null) {
        if (extensions.contains(ISM_DASH_FORMAT_EXTENSION)) {
          return C.CONTENT_TYPE_DASH;
        } else if (extensions.contains(ISM_HLS_FORMAT_EXTENSION)) {
          return C.CONTENT_TYPE_HLS;
        }
      }
      return C.CONTENT_TYPE_SS;
    }

    return C.CONTENT_TYPE_OTHER;
  }

综合上所述,ExoPlayer识别HLS流需要下面任意条件(媒资不满足前2条)

  • 后缀为.m3u8
  • URI包含查询参数 format=m3u8-aapl
  • 显示指定mimeType为MimeTypes.APPLICATION_M3U8

HLS流的处理是在exoplayer-hls模块,区别于其它媒体提取器(Extractor),是单独的处理流程

4.问题处理

在错误码为ERROR_CODE_PARSING_CONTAINER_UNSUPPORTED时,设置mimeType为MimeTypes.APPLICATION_M3U8重试一次播放。

Java 复制代码
@Override
public void onPlayerError(PlaybackException error) {
     if (error.errorCode == PlaybackException.ERROR_CODE_PARSING_CONTAINER_UNSUPPORTED && retryCount == 0) {
           retryCount++;
           MediaItem.Builder build = new MediaItem.Builder().setUri(url);
		   build.setMimeType(MimeTypes.APPLICATION_M3U8);
		   MediaItem mediaItem = build.build();
           player.setPlayWhenReady(true);
		   player.setMediaItem(mediaItem);
		   player.prepare();
           return;
     }
     //其它错误场景处理
}
相关推荐
用户38034165882972 天前
Broadcast Extension 里的 Live Activity:一次跨进程妥协
ios·音视频开发
用户38034165882973 天前
macOS 录屏:ScreenCaptureKit 与 iOS 的分野,共用引擎的抽象层该切在哪
ios·音视频开发
用户38034165882975 天前
FFmpeg 在 iOS 上的裁剪、集成与包体控制
ios·音视频开发
花椒技术6 天前
把 AI 视频接进直播:提前生成、按次生成、持续生成怎么选?
agent·音视频开发
老孙讲技术6 天前
把连锁门店轮询抓拍和遮挡叫醒接进督导台-setDeviceSnapEnhanced与setMessageCallback
后端·物联网·音视频开发
用户38034165882979 天前
手写 fMP4 muxer:从 ISO 14496-12 到能播的文件
ios·音视频开发
字节跳动视频云技术团队10 天前
火山引擎 AI MediaKit X 懂车帝,探索汽车内容智能创作新方式
人工智能·音视频开发
老孙讲技术13 天前
【监控开发】把车间未戴帽和烟火报警接进安监值班群:workwearDetect 对图与 setMessageCallback 订 smokeAlarm
后端·物联网·音视频开发
字节跳动视频云技术团队16 天前
豆包视频通话升级,火山引擎多模态传输系统提供技术支撑
人工智能·音视频开发
搬砖记录员17 天前
录屏总黑屏?90% 的人没关这个开关——浏览器硬件加速冲突排查指南
前端·音视频开发