Facebook
From Smelly Macaw, 2 Years ago, written in Plain Text.
This paste is a reply to Re: Re: Re: Untitled from Sharp Elephant - view diff
Embed
Download Paste or View Raw
Hits: 179
  1. Arc
  2. https://www.thomasmaurer.ch/2022/12/install-and-run-kubernetes-on-windows-server/
  3.  
  4.  
  5. # Use a base image with Apache Spark
  6. FROM apache/spark:latest
  7.  
  8. # Set the working directory
  9. WORKDIR /app
  10.  
  11. # Copy the Anaconda environment file to the image
  12. COPY environment.yml /app
  13.  
  14. # Install packages in the Anaconda environment
  15. RUN apt-get update && apt-get install -y wget bzip2
  16.     && wget https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh
  17.     && bash Miniconda3-latest-Linux-x86_64.sh -b -p /miniconda
  18.     && rm Miniconda3-latest-Linux-x86_64.sh
  19.     && /miniconda/bin/conda env create -f environment.yml
  20.     && /miniconda/bin/conda clean -ya
  21.  
  22. # Set the environment variable for Anaconda
  23. ENV PATH /miniconda/bin:$PATH
  24.  
  25. # Copy the Python file into the image (if applicable)
  26. COPY your_python_file.py /app
  27.  
  28.  
  29.  
  30.  
  31.  
  32. name: spark-env
  33. dependencies:
  34.   - python=3.7
  35.   - pyspark
  36.  
  37.