机器学习平台整理

开源系列

cube开源一站式云原生机器学习平台:https://blog.csdn.net/luanpeng825485697/article/details/123619334

github:https://github.com/tencentmusic/cube-studio

kubeflow参考

官网:https://www.kubeflow.org/docs/started/

参考:https://www.jianshu.com/p/192f22a0b857

AirFlow/NiFi/MLFlow/KubeFlow进展:https://blog.csdn.net/chenhuipin1173/article/details/100913909

最好的任务编排工具:Airflow vs Luigi vs Argo vs MLFlow

总结

一句话总结就是:kubeflow是一个为 Kubernetes 构建的可组合,便携式,可扩展的机器学习技术栈。

支持的训练架构-https://www.kubeflow.org/docs/components/training/

英文对比:

https://aicurious.io/posts/airflow-mlflow-or-kubeflow-for-mlops/

https://devsamurai.vn/blog/ml-platform-kuberflow-mlflow-argo-airflow/

通用型选airflow

机器学习偏向大规模选kubeflow

机器学习偏向小规模选mlflow

bash 复制代码
5. How to choose between Airflow+Mlflow, and Kubeflow?

To sum up, I have some recommendations from my personal perspective:

    If your system needs to deal with multiple types of workflow, not just machine learning, Airflow may support you better. It is a mature workflow orchestration frameworks with support for a lot of operators besides machine learning.
    If you want a system with predesigned patterns for machine learning, and run at large scale on Kubenetes clusters, you may want to consider Kubeflow. Many ML specific components in Kubeflow can save your time implementing from scratch in Airflow.
    If you want to deploy MLOps in a small scale system (for example, a workstation, or a laptop), picking Airflow+MLflow stack can eliminate the need of setting up and running a Kubenetes system, and save more resources for the main tasks.

This blog post has briefly shown the differences between three popular MLOps frameworks (Airflow, MLflow and Kubeflow). Hope that it helps you in making decision between 2 stacks (Airflow + MLflow and Kubeflow). If you want to talk more about these frameworks or recommend others, please comment beflow. Thank you very much!
相关推荐
IT_陈寒1 分钟前
SpringBoot 项目启动慢?5 个提速技巧让你的应用快如闪电 ⚡️
前端·人工智能·后端
币之互联万物2 分钟前
好用的推理训练引擎:博云AIOS如何重塑企业AI算力底座
大数据·人工智能
视***间4 分钟前
算力下沉,智赋全域——解析当前AI边缘计算形势及视程空间的使命与征程
人工智能·边缘计算·ai算力·视程空间·终端算力
IT_陈寒4 分钟前
SpringBoot自动配置的坑,我把头发都快薅没了
前端·人工智能·后端
supericeice5 分钟前
建筑行业大模型落地提速,知识图谱方案为何受到关注
人工智能·知识图谱
小橙子学AI5 分钟前
OpenClaw 定时任务与提醒:打造你的 AI 自动化工作流
运维·人工智能·自动化
360智汇云6 分钟前
360智汇云标注平台介绍及项目落地经验
人工智能
chimooing6 分钟前
OpenClaw 技术详解:自托管 AI 网关架构与实战应用
人工智能·架构
纠结哥_Shrek8 分钟前
AI视频生成提示词工程完全指南
人工智能·音视频
从零开始学习人工智能9 分钟前
从PDF到智能问答:RAG-Anything多模态银行文档处理实战解析
大数据·人工智能·pdf