Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.
Sign upIt appears Spark is running multiple times... #40
Comments
ruebot
self-assigned this
Mar 1, 2018
This comment has been minimized.
This comment has been minimized.
I think it is running as many times as their are warcs in a collection. facepalm |
ruebot
closed this
in
f5773b1
Mar 1, 2018
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
ruebot commentedMar 1, 2018
It appears Spark is running multiple times when the
CollectionsSparkJob
is fired off.