Skip to content
Advertisement

environment variables PYSPARK_PYTHON and PYSPARK_DRIVER_PYTHON

I have installed pyspark recently. It was installed correctly. When I am using following simple program in python, I am getting an error.

JavaScript

while running the last line I am getting error whose key line seems to be

JavaScript

I have the following variables in .bashrc

JavaScript

I am using Python 3.

Advertisement

Answer

By the way, if you use PyCharm, you could add PYSPARK_PYTHON and PYSPARK_DRIVER_PYTHON to run/debug configurations per image below enter image description here

User contributions licensed under: CC BY-SA
7 People found this is helpful
Advertisement