ray-k8s部署

https://docs.ray.io/en/latest/cluster/kubernetes/getting-started/raycluster-quick-start.html#kuberay-raycluster-quickstart

Deploy a KubeRay operator

bash 复制代码
helm repo add kuberay https://ray-project.github.io/kuberay-helm/
helm repo update
# Install both CRDs and KubeRay operator v1.6.0.
helm install kuberay-operator kuberay/kuberay-operator --version 1.6.0
bash 复制代码
kubectl get pods

Deploy a RayCluster custom resource

bash 复制代码
image:
  repository: rayproject/ray
  tag: "2.55.1-py311-aarch64"
  pullPolicy: IfNotPresent
head:
  rayStartParams:
    dashboard-host: "0.0.0.0"
    object-store-memory: "200000000"
  resources:
    requests:
      cpu: "500m"
      memory: "1536Mi"
    limits:
      cpu: "2"
      memory: "3072Mi"
worker:
  replicas: 1
  minReplicas: 0
  maxReplicas: 1
  rayStartParams:
    object-store-memory: "200000000"
  resources:
    requests:
      cpu: "500m"
      memory: "1024Mi"
    limits:
      cpu: "2"
      memory: "2048Mi"
bash 复制代码
helm install raycluster kuberay/ray-cluster --version 1.6.0
helm install raycluster kuberay/ray-cluster --version 1.6.0 -f raycluster-k3d-small-values.yaml

# Once the RayCluster CR has been created, you can view it by running:
kubectl get rayclusters

# View the pods in the RayCluster named "raycluster-kuberay"
kubectl get pods --selector=ray.io/cluster=raycluster-kuberay

端口转发

bash 复制代码
kubectl port-forward -n prefect svc/raycluster-kuberay-head-svc 8265:8265 10001:10001 --address 0.0.0.0
相关推荐
久久学姐11 分钟前
基础转码学 AI:Java+Python 双语言入门,3 个月可落地实战项目
java·python·ai·转码·实战项目
ZHOU_WUYI27 分钟前
4. light wam 模型loss计算过程
开发语言·人工智能·python
nwsuaf_huasir37 分钟前
【无标题】
python
Python私教2 小时前
Codex 写出的代码能跑却算错钱:我用 3 个测试拆穿一次 AI 编程幻觉
python·单元测试·ai编程
Python私教2 小时前
我只写了一个 add 工具,终于把 MCP 的 Host、Client、Server 跑明白了
python·ai编程·mcp
小大宇3 小时前
python milvus 案例
开发语言·python·milvus
BerryS3N4 小时前
Java 后端转型大模型:Demo 能跑不等于能上线
java·人工智能·python·java后端·spring ai·langchain4j·大模型转型
制造数据与AI践行者老蒋4 小时前
智联工坊实战:从“金鱼记忆”到“记住了”:给制造Agent装上记忆芯片的完整指南
人工智能·python·langchain·制造
某林2124 小时前
ros从底层硬件到 Web 端部署
python·机器人·硬件架构·ros2
码云骑士4 小时前
82-微调模型评估-自动化评测-人工评测-A-B测试实战
运维·python·自动化