Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update Spark job to run auk jobs via spark-submit in parallel. #393

Merged
merged 5 commits into from Apr 28, 2020
Merged

Conversation

@ruebot
Copy link
Member

ruebot commented Apr 28, 2020

  • Update Rubocop config
  • Remove AUK Notebooks link
  • Update application config example
  • Tweak analyzed date helper to use filtered text to get date (last item
    that is ran in the pipeline)
  • Change name of "Full Text" derivative to "Web Page Text" since full
    text is misleading
  • Multiply data analyzed total by 3 since that's what we're doing in
    reality

@ianmilligan1 @SamFritz lots of changes here. Don't worry about testing it. I just want to make sure you're ok with the name changes for "Full-text", and the additional text changes. Once you're good with it, let me know and I'll merge, and get over to production.

- Update Rubocop config
- Remove AUK Notebooks link
- Update application config example
- Tweak analyzed date helper to use filtered text to get date (last item
that is ran in the pipeline)
- Change name of "Full Text" derivative to "Web Page Text" since full
text is misleading
- Multiply data analyzed total by 3 since that's what we're doing in
reality
@ruebot ruebot requested review from ianmilligan1 and SamFritz Apr 28, 2020
@codecov
Copy link

codecov bot commented Apr 28, 2020

Codecov Report

Merging #393 into master will not change coverage.
The diff coverage is 50.00%.

Impacted file tree graph

@@           Coverage Diff           @@
##           master     #393   +/-   ##
=======================================
  Coverage   89.40%   89.40%           
=======================================
  Files          35       35           
  Lines         623      623           
=======================================
  Hits          557      557           
  Misses         66       66           
Impacted Files Coverage Δ
app/helpers/wasapi_files_helper.rb 87.50% <0.00%> (ø)
app/helpers/dashboards_helper.rb 89.61% <100.00%> (ø)
test/helpers/dashboards_helper_test.rb 100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9498e52...2d51436. Read the comment docs.

Copy link
Member

ianmilligan1 left a comment

Looks good to me. One minor text suggestion, but I'm also worried my suggestion is slightly too wordy.

app/views/collections/show.html.erb Outdated Show resolved Hide resolved
Copy link
Member

SamFritz left a comment

@ruebot name changes and the additional text changes look good to me.

Only suggestion is to make the ; into : for the tool tip text.

@ruebot ruebot merged commit c82d776 into master Apr 28, 2020
1 check failed
1 check failed
continuous-integration/travis-ci/pr The Travis CI build failed
Details
@ruebot ruebot deleted the interim-auk branch Apr 28, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked issues

Successfully merging this pull request may close these issues.

None yet

3 participants
You can’t perform that action at this time.