/auk

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Spark-shell command options/flags #37

Closed
ruebot opened this Issue Feb 27, 2018 · 0 comments

Comments

Assignees

@ruebot ruebot

Labels
None yet
Projects
None yet
Milestone
No milestone
1 participant
@ruebot
@ruebot
Copy link
Member

ruebot commented Feb 27, 2018

Most of these spark-shell options/flags should probably be environment variables.

  • --driver-memory 5G
  • --conf spark.network.timeout=10000000
  • --packages "io.archivesunleashed:aut:0.12.1"

@ruebot ruebot self-assigned this Feb 28, 2018

@ruebot ruebot closed this in 2ad4035 Feb 28, 2018

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment