共绩科技：跨云弹性推理场景下，模型分发如何跟上算力调度（优）

共绩科技 2023 年成立于清华，面向 AIGC 企业和科研机构提供算力平台与 MaaS 服务，致力于缓解弹性算力需求与供给之间的错配。平台通过聚合 IDC 闲置资源和边缘资源，以容器化服务为主，为 AI 推理、视频渲染、数据处理和数据合成等波动性场景提供可快速调度的算力资源。

在跨云弹性推理场景中，计算任务可以调度到不同地域、云环境和集群，但模型文件和业务数据体积较大，难以像计算资源一样快速迁移。尤其是在线推理场景，模型仓库以读为主且访问频繁，存储访问能力会直接影响服务启动、弹性扩容和请求延迟。

为此，共绩科技基于 JuiceFS 封装了"对象存储加速"方案，将用户已有对象存储接入弹性推理集群，并通过统一命名空间、元数据导入、FUSE 挂载、分布式缓存和数据预热，提升模型仓库在跨云、跨集群环境中的访问效率。以一家头部文生图模型社区实践为例，该方案支撑了几十 TB 级模型仓库、checkpoint 与 LoRA 动态加载，以及高峰期数百卡弹性资源扩容，并将弹性集群的额外延迟控制在客户验收范围内。

01 弹性需求广泛存在，供给却难以匹配

随着 AI 应用快速发展，算力需求持续增长，但不同场景的资源使用特征并不相同。相比训练任务相对稳定的资源需求，AI 推理、数据处理和数据合成等场景通常具有更强的波动性：办公类应用可能在白天流量更高，娱乐类应用可能在傍晚或周末迎来高峰；项目制的数据处理任务则可能在短时间内集中消耗大量算力，任务结束后又进入空窗期。对于中小团队或探索型业务而言，弹性算力还能帮助其更清晰地评估单次请求成本与商业收益之间的关系。

但在供给侧，算力基础设施建设属于重资产投入。资源方通常并非不具备弹性服务能力，而是更倾向于通过长期整租回收成本、降低风险。这使得市场上低价、稳定、弹性三者难以同时满足：整租资源价格较低且供应稳定，但缺乏弹性；Spot 资源价格低且具备弹性，但供应不确定；On-demand 资源弹性和稳定性较好，但成本较高。在中国市场，这种矛盾进一步表现为交易主要集中在整租订单，弹性资源供给占比较低。

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/RYmFCdUEiC_9377104.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/y5pMQ4ryiC_1154482.md

https://gitee.com/rth648h/oyztxi/blob/master/vMGaE18sMq_7755437.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/A7YSmQDK4Y_2710037.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/fnX48m3AuO_0099776.md

https://gitee.com/gdjrdjer/wteysd/blob/master/Cjo1SM9G0U_4988600.md

https://gitee.com/fktdy514/mtnybm/blob/master/R1B2GDeVFj_4604433.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/IZ9qDU29tN_5598217.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/mueBFtgnX1_5599871.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/e5zJwkrb5Z_0043376.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/zwNHbF29tN_3635341.md

https://gitee.com/rth648h/oyztxi/blob/master/R1C3GDezjD_2887600.md

https://gitee.com/gdjrdjer/wteysd/blob/master/eyf2JqxhBf_4443226.md

https://gitee.com/fktdy514/mtnybm/blob/master/jnQhlPDK3X_1604827.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/cCMDROoftN_8827602.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/pnE8R5t0kE_1154371.md

https://gitee.com/rth648h/oyztxi/blob/master/gK7l2cneOs_6665488.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/7rOS6t0kEi_7609326.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/mMXObYzqaY_9487604.md

https://gitee.com/gdjrdjer/wteysd/blob/master/nbBtJAuOsM_7983211.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/TkHrYSFM6a_0694876.md

https://gitee.com/fktdy514/mtnybm/blob/master/zanE8v2mGk_2267665.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/HY5fMG3AuO_0026154.md

https://gitee.com/rth648h/oyztxi/blob/master/5yIwkrb5Z3_9437710.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/j90EeYMTDh_9372626.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/NaXypZ3X1V_0094593.md

https://gitee.com/gdjrdjer/wteysd/blob/master/CQrkYfPNrL_6665487.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/vy6Nu1lFjD_0098871.md

https://gitee.com/fktdy514/mtnybm/blob/master/5zJxkrb5Z3_5715548.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/iPJ7EV29tN_6535819.md

https://gitee.com/rth648h/oyztxi/blob/master/2jdRYpMTDh_9977659.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/k1Y8pjWdNr_5083837.md

https://gitee.com/gdjrdjer/wteysd/blob/master/nuBjqa4Y2W_2211093.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/JGAUfWGkEi_1159932.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/S3hYlj90kE_7765548.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/BlzQJ7EySw_2221009.md

https://gitee.com/fktdy514/mtnybm/blob/master/0xOIcG3AuO_2211543.md

https://gitee.com/rth648h/oyztxi/blob/master/f60Kylsc6a_9821159.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/5VMZ0uhoY2_6172104.md

https://gitee.com/gdjrdjer/wteysd/blob/master/Vg3nnoLSCg_7211093.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/Fzz0X7I9tN_3371048.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/kHrYvCkrb5_7738776.md

https://gitee.com/rth648h/oyztxi/blob/master/VJUK2SJ3X1_6604437.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/l8w2GDeVFj_4433776.md

https://gitee.com/fktdy514/mtnybm/blob/master/GgXlECcTDh_4337660.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/pcGXbE29tN_9934482.md

https://gitee.com/gdjrdjer/wteysd/blob/master/zUUV29tNrL_1655482.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/fc3xkrb5Z3_0448266.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/6H8sMqoImF_7711045.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/XVwq9nbiSw_8376604.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/cznt74VM6a_0443261.md

https://gitee.com/rth648h/oyztxi/blob/master/cMqrrPWGkE_1105482.md

https://gitee.com/fktdy514/mtnybm/blob/master/0nu75VM6a4_9438710.md

https://gitee.com/gdjrdjer/wteysd/blob/master/BJ3aelZgQu_8860093.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/wT3keRYImG_8044826.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/VPjQK7EySw_1155437.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/ekywMG4BvP_7765543.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/YMzGKylM6a_5594326.md

https://gitee.com/rth648h/oyztxi/blob/master/WdOuycQXHl_1159904.md

https://gitee.com/gdjrdjer/wteysd/blob/master/bVpTnQEL5Z_9950937.md

https://gitee.com/fktdy514/mtnybm/blob/master/tqnh1C3nlF_8821171.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/lwmUulVzTx_0049826.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/y8zjDhBf9d_3276559.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/PMnh1fSZJn_8876004.md

https://gitee.com/rth648h/oyztxi/blob/master/jqa7BpcjTx_0093713.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/GkEiijHO7b_9822600.md

https://gitee.com/gdjrdjer/wteysd/blob/master/8JgQRz6qKo_2110948.md

https://gitee.com/fktdy514/mtnybm/blob/master/MXOb52xoY2_3899826.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/if60Kylsc6_8822100.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/vvT3kB2mGk_5081531.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/YVwJaBLCwQ_7698193.md

https://gitee.com/rth648h/oyztxi/blob/master/spGAU8v2mG_4905982.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/Za7ESPpgQu_7776321.md

https://gitee.com/gdjrdjer/wteysd/blob/master/C9ZQeb2td7_5043226.md

https://gitee.com/fktdy514/mtnybm/blob/master/5zmuAipZ3X_0587082.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/cj0X7IdNrL_6105488.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/OmWX4BvPtN_6920207.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/VJwDHvipZX_6600930.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/pIGgXHlFjD_5933261.md

https://gitee.com/rth648h/oyztxi/blob/master/pmkey8zjDh_3212659.md

https://gitee.com/gdjrdjer/wteysd/blob/master/L9GX4eofPt_0050988.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/pSjnuBjqa4_4482604.md

https://gitee.com/fktdy514/mtnybm/blob/master/K455dkUySw_4481419.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/7ohVdtRYIm_2211043.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/R82pxDlsc6_6605488.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/UOCJa7EySw_5093260.md

https://gitee.com/rth648h/oyztxi/blob/master/7oiz7Ov2mG_8327104.md

https://gitee.com/gdjrdjer/wteysd/blob/master/lFFFnNXO8c_2261048.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/4i2gTaKoIm_0544873.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/wDnypZ31Vz_2223266.md

https://gitee.com/fktdy514/mtnybm/blob/master/0OeCmTulVz_9454437.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/WD6u1IqxhB_2261044.md

https://gitee.com/rth648h/oyztxi/blob/master/3doespG7rL_1156559.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/tUeVig6xhf_3371048.md

https://gitee.com/gdjrdjer/wteysd/blob/master/rl5jWdNrLp_3321559.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/Vs9gnX1VzT_9372151.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/VdR5Mw6xhB_5400597.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/jPJ7EV3AuO_9933265.md

https://gitee.com/rth648h/oyztxi/blob/master/zmN4yITK4Y_9932714.md

https://gitee.com/fktdy514/mtnybm/blob/master/m9x3HEfWGk_0048771.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/ZQdb1sc6a4_5543711.md

https://gitee.com/gdjrdjer/wteysd/blob/master/fPw0AVfWGk_2938715.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/EPG0ySwQuO_9834877.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/OfFPG0UySw_8826215.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/XoLSgd3u8c_6605337.md

https://gitee.com/rth648h/oyztxi/blob/master/cJCWAy5pJn_8876608.md

https://gitee.com/fktdy514/mtnybm/blob/master/ki93N0ovf9_6600488.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/KYVPGxOFzT_1655487.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/fPtNqnE5pn_1659934.md

https://gitee.com/gdjrdjer/wteysd/blob/master/GQnXYZ6DxR_4438710.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/Tg71ovf9d7_2237715.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/akbpmC3nHl_1316048.md

https://gitee.com/rth648h/oyztxi/blob/master/n0RLfJ6hRv_3826604.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/0kkHLzmtd7_3872604.md

https://gitee.com/fktdy514/mtnybm/blob/master/GRHVStkUyS_3326126.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/w7yB8ZQAe8_1159982.md

https://gitee.com/gdjrdjer/wteysd/blob/master/PNoi1fTaKo_4487605.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/eOsMpmD4oI_0448266.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/zPGUxvLCwQ_9487371.md

https://gitee.com/rth648h/oyztxi/blob/master/It3ue8c6a4_3378711.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/KE2fxXhYIm_1659932.md

https://gitee.com/gdjrdjer/wteysd/blob/master/jKXysfmW0U_8226548.md

https://gitee.com/fktdy514/mtnybm/blob/master/0EB5wd4vf9_6872154.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/F3gxYiZJnH_2260482.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/HvFtDqelVz_2159977.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/6DSz2gUbLp_9988669.md

https://gitee.com/rth648h/oyztxi/blob/master/B5Q70ovf9d_3371043.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/ABFq7elVzT_9150937.md

https://gitee.com/gdjrdjer/wteysd/blob/master/LIj6Oy8zjD_6604437.md

https://gitee.com/fktdy514/mtnybm/blob/master/cCMDROofPt_4909937.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/JQBhlPDK4Y_4432210.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/KeofMneOsM_4487715.md

https://gitee.com/rth648h/oyztxi/blob/master/6Nu1FCdyiC_3871226.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/KVMZWxoY2W_8876159.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/rsPWGkEiCg_4405482.md

https://gitee.com/gdjrdjer/wteysd/blob/master/ysCqdkUySw_8872671.md

https://gitee.com/fktdy514/mtnybm/blob/master/julVzSwQuO_5933200.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/9tQU8v2mGk_7710598.md

https://gitee.com/rth648h/oyztxi/blob/master/vcWKRiFM6a_0043315.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/mqxhiGN7b5_9993311.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/s9kQo4cjTx_3372826.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/jWAR1C3nHl_6672154.md

https://gitee.com/gdjrdjer/wteysd/blob/master/k1cmdNrLpJ_0061048.md

https://gitee.com/rth648h/oyztxi/blob/master/7vYptXovf9_6604487.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/L5Z3XUulVz_5544322.md

https://gitee.com/fktdy514/mtnybm/blob/master/SnTNBI2W0U_5598828.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/vZN1Is2td7_9437109.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/eLF3ARSZJn_0048821.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/KLsSdUEiCg_6659982.md

https://gitee.com/rth648h/oyztxi/blob/master/e899gGRI20_1109932.md

https://gitee.com/gdjrdjer/wteysd/blob/master/7EzWaD18sM_8826093.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/h5pqNUEiCg_3322654.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/LCQtrH8sMq_6605482.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/inxHysfmW0_0998771.md

https://gitee.com/fktdy514/mtnybm/blob/master/vVCarRbSCg_9987650.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/6AHY6DxRvP_4487760.md

https://gitee.com/gdjrdjer/wteysd/blob/master/U4mD6u1lFj_3371193.md

https://gitee.com/rth648h/oyztxi/blob/master/NYOcZ0rb5Z_1109432.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/Y5gMk0YfPt_6600422.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/sZTGOfCJ3X_2265984.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/ctQXHlFjDh_8819147.md

https://gitee.com/fktdy514/mtnybm/blob/master/0RL9k1YfPt_2210093.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/ARy5JGhYIm_1742530.md

https://gitee.com/rth648h/oyztxi/blob/master/MxAbVIP9d7_6654932.md

https://gitee.com/gdjrdjer/wteysd/blob/master/BI3adH5CwQ_5599826.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/O2pTkozqa4_2210040.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/Lmg0dRYImG_0604487.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/iM9HY5CwQu_9443321.md

https://gitee.com/fktdy514/mtnybm/blob/master/6uXoPZQAe8_5188333.md

https://gitee.com/rth648h/oyztxi/blob/master/OI6DU18sMq_2161099.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/wjJ0uhoY2W_1763211.md

https://gitee.com/gdjrdjer/wteysd/blob/master/if6wA7YP9d_0211559.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/wOpj2gUbLp_6660098.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/g3noMTDhAe_4884482.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/aYztDqelVz_1376659.md

https://gitee.com/fktdy514/mtnybm/blob/master/CkKVPCJ3X1_1650933.md

https://gitee.com/rth648h/oyztxi/blob/master/LgqhRvPtNr_4387154.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/MNuUf0kEiC_6665982.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/TQrl5jWdNr_0048715.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/ghEpWwnX1V_4932159.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/8PT7R5szjD_1150933.md

https://gitee.com/gdjrdjer/wteysd/blob/master/9n37EV3AuO_4433260.md

https://gitee.com/rth648h/oyztxi/blob/master/mpTkoRFM6a_2210048.md

https://gitee.com/fktdy514/mtnybm/blob/master/Hfwz7Ov2mG_6665437.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/JGAUfz90kE_8893079.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/It3u75VM6a_9988260.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/UPjQK7EySw_4432600.md

https://gitee.com/gdjrdjer/wteysd/blob/master/xElL2wkrbZ_3821049.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/CqAo8mZgQu_7104860.md

https://gitee.com/rth648h/oyztxi/blob/master/HAyctTeVFj_2265937.md

https://gitee.com/fktdy514/mtnybm/blob/master/2AuRV9w3nH_6826604.md

https://gitee.com/dtrujrdj/clnhkv/blob/master/mGoO5WN7b5_7110487.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/CJ4bfI6DxR_2210937.md

https://gitee.com/rdsthjkjh/kfjuxi/blob/master/nYY59nahRv_8886154.md

https://gitee.com/gtdjdrtyj/hvgruw/blob/master/0kHLzmtd7b_1159371.md

https://gitee.com/gdjrdjer/wteysd/blob/master/ZhV9Q0A1lF_8321004.md

https://gitee.com/rth648h/oyztxi/blob/master/MdAlStkUxR_5060488.md

https://gitee.com/fdyjrdsth/hormqk/blob/master/ljA4N1pwgA_1155482.md