Skip to content
Please note that GitHub no longer supports your web browser.

We recommend upgrading to the latest Google Chrome or Firefox.

Learn more
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add and update tests, resolve textFiles bug. #388

Merged
merged 1 commit into from Dec 17, 2019
Merged

Add and update tests, resolve textFiles bug. #388

merged 1 commit into from Dec 17, 2019

Conversation

@ruebot
Copy link
Member

ruebot commented Dec 16, 2019

GitHub issue(s):

What does this Pull Request do?

How should this be tested?

  • TravisCI
  • See also reproducing bug for #390
@codecov

This comment has been minimized.

Copy link

codecov bot commented Dec 16, 2019

Codecov Report

Merging #388 into master will increase coverage by 0.9%.
The diff coverage is 33.33%.

@@            Coverage Diff            @@
##           master     #388     +/-   ##
=========================================
+ Coverage   75.97%   76.87%   +0.9%     
=========================================
  Files          41       40      -1     
  Lines        1469     1466      -3     
  Branches      274      274             
=========================================
+ Hits         1116     1127     +11     
+ Misses        236      217     -19     
- Partials      117      122      +5
- Add ExtractDateDF test
- Fix conditional logic of textFiles filter to resolve #390
- Add test for conditional logic fix for #390
- Remove cruft ExtractUrls, left over from Twitter analysis removal
(see:
https://github.com/lintool/warcbase/blob/cab311ed8b0bceb666865fa76dd3bc5a86402e13/warcbase-core/src/test/scala/org/warcbase/spark/matchbox/ExtractUrlsTest.scala)
- Tweak null/nothing on a few tests
@ruebot ruebot force-pushed the test branch from 1d91eb7 to 1799228 Dec 17, 2019
@ruebot ruebot requested a review from ianmilligan1 Dec 17, 2019
@ruebot ruebot marked this pull request as ready for review Dec 17, 2019
@ruebot ruebot changed the title Draft DF udf test updates. Add and update tests, resolve textFiles bug. Dec 17, 2019
Copy link
Member

ianmilligan1 left a comment

LGTM - tested using the script in #390

@ianmilligan1 ianmilligan1 merged commit 9e32284 into master Dec 17, 2019
2 of 3 checks passed
2 of 3 checks passed
codecov/patch 33.33% of diff hit (target 75.97%)
Details
codecov/project 76.87% (+0.9%) compared to 079cd24
Details
continuous-integration/travis-ci/pr The Travis CI build passed
Details
@ianmilligan1 ianmilligan1 deleted the test branch Dec 17, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
2 participants
You can’t perform that action at this time.