Media3 ExoPlayer无法播放不带.m3u8后缀hls媒资

1.问题发现

播放报错None of the available extractors (没有可用的媒资提取器) , 错误码 ERROR_CODE_PARSING_CONTAINER_UNSUPPORTED (表示解析媒体容器格式错误)

shell 复制代码
None of the available extractors (FlvExtractor, FlacExtractor, WavExtractor, FragmentedMp4Extractor, Mp4Extractor, AmrExtractor, PsExtractor, OggExtractor, TsExtractor, MatroskaExtractor, AdtsExtractor, Ac3Extractor, Ac4Extractor, Mp3Extractor, AviExtractor, JpegExtractor, PngExtractor, WebpExtractor, BmpExtractor, HeifExtractor, AvifExtractor) could read the stream. {contentIsMalformed=false, dataType=1}

2.问题分析

2.1 错误位置

找到报错的源码位置

Java 复制代码
@Override
public void init(
    DataReader dataReader,
    Uri uri,
    Map<String, List<String>> responseHeaders,
    long position,
    long length,
    ExtractorOutput output)
    throws IOException {
  //根据uri和响应头信息,通过工厂接口创建一组媒体提取器(Extractor)实例,用于后续尝试解析媒体流。
  Extractor[] extractors = extractorsFactory.createExtractors(uri, responseHeaders);
  ImmutableList.Builder<SniffFailure> sniffFailures =
      ImmutableList.builderWithExpectedSize(extractors.length);
  if (extractors.length == 1) {
    this.extractor = extractors[0];
  } else {
    for (Extractor extractor : extractors) {
      try {
          //嗅探(通过读取数据流的头部信息来判断格式匹配度)检测当前 Extractor 是否能够识别并处理输入的媒体数据流 
        if (extractor.sniff(extractorInput)) {
          this.extractor = extractor;
          break;
        } else {
          List<SniffFailure> sniffFailureDetails = extractor.getSniffFailureDetails();
          sniffFailures.addAll(sniffFailureDetails);
        }
      } catch (EOFException e) {
        // Do nothing.
      } finally {
        Assertions.checkState(this.extractor != null || extractorInput.getPosition() == position);
        extractorInput.resetPeekPosition();
      }
    }
    //没有找到合适的媒资提取器会抛出异常
    if (extractor == null) {
      //【sss】如果是没有.m3u8后缀的hls媒资,会走到这里
      throw new UnrecognizedInputFormatException(
          "None of the available extractors ("
              + Joiner.on(", ")
                  .join(
                      Lists.transform(
                          ImmutableList.copyOf(extractors),
                          extractor ->
                              extractor.getUnderlyingImplementation().getClass().getSimpleName()))
              + ") could read the stream.",
          Assertions.checkNotNull(uri),
          sniffFailures.build());
    }
  }
  extractor.init(output);
}
2.2 媒资信息

用ffmpeg命令查看媒资基本信息

arduino 复制代码
`ffprobe -v quiet -print_format json -show_format "http://xxx"`

输出结果:

java 复制代码
{
    "format": {
        "filename": "http://xxx",
        "nb_streams": 2,
        "nb_programs": 1,
        "nb_stream_groups": 0,
        "format_name": "hls",
        "format_long_name": "Apple HTTP Live Streaming",
        "start_time": "1.480000",
        "duration": "6438.880000",
        "size": "68",
        "probe_score": 100
    }
}

流媒体特征

  • format_name: hls - 确认这是HLS (HTTP Live Streaming) 格式
  • format_long_name: Apple HTTP Live Streaming - Apple开发的流媒体协议

通常.m3u8是最典型的HLS文件后缀,看下ExoPlayer怎么处理的HLS流

3.源码分析

我们设置媒体地址开始看起

Java 复制代码
player.setMediaItem(MediaItem.fromUri(url));

经过一系列调用

Java 复制代码
@Override
public void setMediaItems(List<MediaItem> mediaItems, boolean resetPosition) {
  verifyApplicationThread();
  setMediaSources(createMediaSources(mediaItems), resetPosition);
}

@UnstableApi
  @Override
  public MediaSource createMediaSource(MediaItem mediaItem) {
    Assertions.checkNotNull(mediaItem.localConfiguration);
    @Nullable String scheme = mediaItem.localConfiguration.uri.getScheme();
    //...
    //【sss】根据媒体项的 uri 和 设置的mimeType 类型推断出内容类型(如 HLS),用于后续选择合适的媒体源工厂进行处理
    @C.ContentType
    int type =
        Util.inferContentTypeForUriAndMimeType(
            mediaItem.localConfiguration.uri, mediaItem.localConfiguration.mimeType);
    if (mediaItem.localConfiguration.imageDurationMs != C.TIME_UNSET) {
      delegateFactoryLoader.setJpegExtractorFlags(JpegExtractor.FLAG_READ_IMAGE);
    }

    MediaSource.Factory mediaSourceFactory;
    try {
      //【sss】选择合适的媒体源工厂进行处理
      mediaSourceFactory = delegateFactoryLoader.getMediaSourceFactory(type);
    } catch (ClassNotFoundException e) {
      throw new IllegalStateException(e);
    }
    //...
  }

通过inferContentTypeForUriAndMimeType函数从Uri和可选MIME类型推断ContentType的功能。

Java 复制代码
public static @ContentType int inferContentTypeForUriAndMimeType(
      Uri uri, @Nullable String mimeType) {
    //默认mimeType为null
    if (mimeType == null) {
      return inferContentType(uri);
    }
    //通过设置的mimeType去匹配
    switch (mimeType) {
      case MimeTypes.APPLICATION_MPD:
        return C.CONTENT_TYPE_DASH;
      case MimeTypes.APPLICATION_M3U8:
        return C.CONTENT_TYPE_HLS;
      case MimeTypes.APPLICATION_SS:
        return C.CONTENT_TYPE_SS;
      case MimeTypes.APPLICATION_RTSP:
        return C.CONTENT_TYPE_RTSP;
      default:
        return C.CONTENT_TYPE_OTHER;
    }
  }

public static @ContentType int inferContentType(Uri uri) {
    @Nullable String scheme = uri.getScheme();
    //rtsp匹配
    if (scheme != null
        && (Ascii.equalsIgnoreCase("rtsp", scheme) || Ascii.equalsIgnoreCase("rtspt", scheme))) {
      return C.CONTENT_TYPE_RTSP;
    }

    @Nullable String lastPathSegment = uri.getLastPathSegment();
    if (lastPathSegment == null) {
      return C.CONTENT_TYPE_OTHER;
    }
    int lastDotIndex = lastPathSegment.lastIndexOf('.');
    if (lastDotIndex >= 0) {
      @C.ContentType
      //取后缀名匹配(.m3u8识别为hls)
      int contentType = inferContentTypeForExtension(lastPathSegment.substring(lastDotIndex + 1));
      if (contentType != C.CONTENT_TYPE_OTHER) {
        // If contentType is TYPE_SS that indicates the extension is .ism or .isml and shows the ISM
        // URI is missing the "/manifest" suffix, which contains the information used to
        // disambiguate between Smooth Streaming, HLS and DASH below - so we can just return TYPE_SS
        // here without further checks.
        return contentType;
      }
    }
	//URI包含查询参数 format=m3u8-aapl 会被识别为hls
    Matcher ismMatcher = ISM_PATH_PATTERN.matcher(checkNotNull(uri.getPath()));
    if (ismMatcher.matches()) {
      @Nullable String extensions = ismMatcher.group(2);
      if (extensions != null) {
        if (extensions.contains(ISM_DASH_FORMAT_EXTENSION)) {
          return C.CONTENT_TYPE_DASH;
        } else if (extensions.contains(ISM_HLS_FORMAT_EXTENSION)) {
          return C.CONTENT_TYPE_HLS;
        }
      }
      return C.CONTENT_TYPE_SS;
    }

    return C.CONTENT_TYPE_OTHER;
  }

综合上所述,ExoPlayer识别HLS流需要下面任意条件(媒资不满足前2条)

  • 后缀为.m3u8
  • URI包含查询参数 format=m3u8-aapl
  • 显示指定mimeType为MimeTypes.APPLICATION_M3U8

HLS流的处理是在exoplayer-hls模块,区别于其它媒体提取器(Extractor),是单独的处理流程

4.问题处理

在错误码为ERROR_CODE_PARSING_CONTAINER_UNSUPPORTED时,设置mimeType为MimeTypes.APPLICATION_M3U8重试一次播放。

Java 复制代码
@Override
public void onPlayerError(PlaybackException error) {
     if (error.errorCode == PlaybackException.ERROR_CODE_PARSING_CONTAINER_UNSUPPORTED && retryCount == 0) {
           retryCount++;
           MediaItem.Builder build = new MediaItem.Builder().setUri(url);
		   build.setMimeType(MimeTypes.APPLICATION_M3U8);
		   MediaItem mediaItem = build.build();
           player.setPlayWhenReady(true);
		   player.setMediaItem(mediaItem);
		   player.prepare();
           return;
     }
     //其它错误场景处理
}
相关推荐
小小杨树2 天前
【C++】学习:双缓冲视频流水线深解析
c++·性能优化·音视频开发
老孙讲技术5 天前
老板说「网页上嵌个监控就行」?黑屏三小时后我才搞懂:播放器要的不是 accessToken
物联网·音视频开发·小程序·云开发
老孙讲技术5 天前
监控刷了 200 条动检,漏掉一次紧急按钮:养老 SaaS 的事件桥接与 P0/P1 分级
物联网·音视频开发·小程序·云开发
音视频牛哥6 天前
从移动终端到行业视频前端:SmartGBD 如何让 Android 与 HarmonyOS NEXT 接入 GB28181
音视频开发·视频编码·直播
qingmiaozhuan8 天前
电脑录屏黑屏?只有声音没画面?从原理到排查一篇搞定
ffmpeg·电脑·音视频开发·录屏技术·电脑录屏
用户0510122572969 天前
RTP和RTCP协议原理
音视频开发
京东云开发者12 天前
【全栈实践】第一个 AI Agent 项目:从零搭建 AI 音频创作助手【最终版】
前端·vue.js·音视频开发
glumes13 天前
从《牛来》到 DCP:一部电影是怎么走进电影院的?
ffmpeg·音视频开发
京东云开发者13 天前
【全栈实践】第一个 AI Agent 项目:从零搭建 AI 音频创作助手(高级篇)
前端·agent·音视频开发
wangruofeng14 天前
20822 star 的开源录屏软件弃 Tauri 换 Electron:表层是换壳,里子是 46 个 Rust 模块
github·音视频开发