记录《现有docker中安装spark3.4.1》

基础docker环境中存储hadoop3--方便后续查看

参考:

实践:

复制代码
export JAVA_HOME=/opt/apache/jdk1.8.0_333
export SPARK_MASTER_IP=192.168.0.220
export SPARK_WORKER_MEMORY=4g
export SPARK_WORKER_CORES=2
export SPARK_EXECUTOR_MEMORY=4g
export HADOOP_HOME=/opt/apache/hadoop-3.2.2/
export HADOOP_CONF_DIR=/opt/apache/hadoop-3.2.2/etc/hadoop
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/opt/apache/jdk1.8.0_333/jre/lib/amd64

#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements.  See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License.  You may obtain a copy of the License at
#
#    http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#

# A Spark Worker will be started on each of the machines listed below.
hadoop220
hadoop221
hadoop222
相关推荐
BioRunYiXue6 分钟前
双荧光素酶报告基因实验
java·运维·服务器·数据库·人工智能·数据挖掘·eclipse
天天进步201513 分钟前
CentOS 实战:如何查看和分析信号量 (Semaphore) 的值
linux·运维·centos
wjykp24 分钟前
2.linux基础命令
linux·运维·服务器
Hard but lovely25 分钟前
linux: gdb调试器
linux·运维·服务器
李嘉真34 分钟前
使用Ventoy制作U盘WindowsToGo系统,让电脑从U盘启动和使用多种系统
运维·windows
Percep_gan1 小时前
Linux中安装rabbitmq,很详细
linux·运维·rabbitmq
vortex51 小时前
Linux .forward 文件详解
linux·运维·前端
Genevieve_xiao1 小时前
【dl】【WSL2】如何获得“Winux”?Windows 上的 Linux 子系统 —— 比虚拟机更好的选择
linux·运维·windows
Fly ☆1 小时前
arecord[linux下的录音工具]命令的用法
linux·运维·服务器·嵌入式硬件
java_logo1 小时前
CALIBRE-WEB Docker 容器化部署指南
前端·docker·容器·电子书·calibre·calibre-web·docker部署calibre