RAW-Adapter: Adapting Pre-trained Visual Model to Camera RAW Images

Cui Z, Harada T. RAW-adapter: Adapting pre-trained visual model to camera RAW imagesC//European Conference on Computer Vision. Cham: Springer Nature Switzerland, 2024: 37-56.


Background

  • RAW images:
  • directly acquired by the camera sensor--encompasses abundant information.
  • sRGB images:
  • derived from RAW data through image signal processor (ISP)--ease of acquisition and efficient storage.

Existing methods

  • Fig. 1(a) ISP process
  • Fig. 1(b) manually designed ISP--based on visual experience
  • Fig. 1(c) optimize ISP jointly with downstream networks
  • Fig. 1(d) RAW-Adapter

Introduction


Method

  • RAW-Adapter--adapting sRGB pre-trained models to camera RAW images
  • input-level adapters: query adaptive learning (QAL) and implicit neural representations (INR) optimize ISP key parameters
  • model-level adapters: prior input stage information enriches model understanding

Method--input-level adapters

  • Gain & Denoise
  • White Balance & CCM Matrix
  • Color Manipulation Process

Method--model-level adapters

  • employ the prior information from ISP process as model-level adapters to guide subsequent models' perception

Evaluation

  • datasets: PASCAL RAW 1 and LOD 2

1 Omid-Zohoor A, Ta D, Murmann B. PASCALRAW: raw image database for object detectionJ. Stanford Digital Repository, 2014, 2(3): 4.

2 Hong Y, Wei K, Chen L, et al. Crafting Object Detection in Very Low LightC//BMVC. 2021, 1(2): 3.


相关推荐
yiangL_35 分钟前
Python 学习笔记:递归、turtle绘图、字符串与函数
笔记·python·学习
lula8882 小时前
PVC-U、PVC-C、PVC-O 差一个字母,差的是三种增强路线
python
数字工作台3 小时前
给 LangGraph 加一道可审计记忆:替换默认 Checkpointer,实现防篡改 + 崩溃不丢数据
python·agent
DKPT3 小时前
Python 的 Web 框架:选型选错的人,都踩了同一个坑
python
2401_868534784 小时前
逻辑网络设计
网络·python
2601_967979124 小时前
python如何组织文件?python文件操作全介绍!
python·文件操作·压缩文件·遍历文件夹·shutil模块
青少儿编程课堂4 小时前
蓝桥杯·全国青少年信息素养大赛·电子学会Python/C++考级:扫描线与线段树求矩形面积并解析
c++·python·算法·bfs·信息学竞赛
羲云网络4 小时前
GPT Image 2.6 商品图交付:用文件指纹排查错图、覆盖与版本串线
图像处理·人工智能·python·技术教程·文件校验
wuyk5555 小时前
Spider-第14讲-表单提交与CSRF
前端·爬虫·python·elasticsearch·csrf
汤姆宝库5 小时前
RoPE旋转位置编码的实现与长上下文外推
python·深度学习·机器学习