技术栈

离线调度

linweidong
10 个月前
大数据·分布式·spark·etl·海豚调度器·离线调度
spark运行报错:Container killed by YARN for exceeding memory limits用spark跑数据量大的离线调度任务报错:Reason: Container killed by YARN for exceeding memory limits. 19.0 GB of 19 GB physical memory used. Consider boosting spark.yarn.executor.memoryOverhead or disabling yarn.nodemanager.vmem-check-enabled because of YARN-4714.
一切如来心秘密
1 年前
离线调度
DolphinScheduler on k8s 云原生部署实践DolphinScheduler 是由 Analysys 开源的分布式、易于扩展的可视化工作流任务调度平台,解决了需要企业级问题: