archivesunleashed/aut

Commits on Jun 26, 2020

Commit changes

ruebot committed Jun 26, 2020

Verified

This commit was signed with a verified signature.

ruebot Nick Ruest

GPG key ID: 417FAF1A0E1080CD Learn about signing commits

4a3a224
Commit changes

ruebot committed Jun 26, 2020

Verified

This commit was signed with a verified signature.

ruebot Nick Ruest

GPG key ID: 417FAF1A0E1080CD Learn about signing commits

5aa8a7f
cleanup

ruebot committed Jun 26, 2020

Verified

This commit was signed with a verified signature.

ruebot Nick Ruest

GPG key ID: 417FAF1A0E1080CD Learn about signing commits

4f89c30
Add Python formatter GitHub Action.

ruebot committed Jun 26, 2020
```
- Setup Python formatter that runs isort and black.
- Rename scala formatter, so all three are consistent now.
- Resolves #488
```
Verified

This commit was signed with a verified signature.

ruebot Nick Ruest

GPG key ID: 417FAF1A0E1080CD Learn about signing commits

012d04a

Commits on Jun 25, 2020

Add Google Java Formatter as an action, and apply it. (#485 )

ruebot committed Jun 25, 2020

Loading status checks…
```
- Apply Google Java Formatter to all Java files.
- Add GitHub Action for the formatter
- Resolves #484
- Update TravisCI to use Bionic
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

2fe5a93
Add scalafmt GitHub action and apply it to scala code. (#487 )

ruebot committed Jun 25, 2020

Loading status checks…
```
- Add scalafmt GitHub action
- Apply scalafmt to Scala codebase
- Resolves #486
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

b95bc9a

Commits on Jun 18, 2020

Update documentation link.

ruebot committed Jun 18, 2020

Loading status checks…

Verified

This commit was signed with a verified signature.

ruebot Nick Ruest

GPG key ID: 417FAF1A0E1080CD Learn about signing commits

0a7a90f
Spark 3.0.0 + Java 11 support. (#375 )

ruebot committed Jun 18, 2020

Loading status checks…
```
- Update to Spark 3.0.0
- Update to Java 11
- Update README
- Remove Java8 support
- Resolves #375
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

59b1d4e

Commits on Jun 17, 2020

Add Python implementation of SaveBytes. (#482 )

ruebot committed Jun 17, 2020

Loading status checks…
```
- Resolves #478
- Tweak formatting in DataFrameLoader
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

cbff479

Commits on Jun 15, 2020

Bump xercesImpl from 2.11.0 to 2.12.0 (#481 )

dependabot committed Jun 15, 2020

Loading status checks…
```
Bumps xercesImpl from 2.11.0 to 2.12.0.

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

d8cca11

Commits on Jun 8, 2020

[Skip Travis] Trim README down given aut.docs.archivesunleashed.org (#…

ruebot committed Jun 8, 2020
```
…480)
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

39fc370

Commits on Jun 3, 2020

[maven-release-plugin] prepare for next development iteration

ruebot committed Jun 3, 2020

Loading status checks…

Verified

This commit was signed with a verified signature.

ruebot Nick Ruest

GPG key ID: 417FAF1A0E1080CD Learn about signing commits

37821fe
[maven-release-plugin] prepare release aut-0.80.0

ruebot committed Jun 3, 2020

Verified

This commit was signed with a verified signature.

ruebot Nick Ruest

GPG key ID: 417FAF1A0E1080CD Learn about signing commits

2442336

Commits on Jun 1, 2020

Remove RDD suffixes on file, class, and object names. (#479 )

ruebot committed Jun 1, 2020

- Remove all the RDD suffixes added previously
- Rename image_graph to imagegraph (Python)
- Rename GetExtensionMime to GetExtensionMIME (Scala)
- Remove textFiles (Scala)
- Remove text_files (Python)
- Remove TextFilesInformationExtractor
- Rename files all affected files as needed
- Update tests as needed

1ac97ef

Commits on May 29, 2020

PEP8 Python app method names. (#477 )

ruebot committed May 29, 2020

Loading status checks…
```
- Resolve 468
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

8037745
Move Python UDF methods out of their own class. (#475 )

ruebot committed May 29, 2020

Loading status checks…
```
- Resolve #467
- README button colour tweak for UserDocs
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

76c8247

Commits on May 28, 2020

Add DataFrame udf tests. (#474 )

ruebot committed May 28, 2020

Loading status checks…
```
- Resolves #473
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

4cd90dc

Commits on May 27, 2020

Remove tabDelimit. (#472 )

ruebot committed May 27, 2020

Loading status checks…
```
- Resolves #471
- Resolves #59
- Remove TupleFormatter (tabDelimit functionality)
- Remove shapeless from pom
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

9815ea4
Remove NER functionality. (#470 )

ruebot committed May 27, 2020

Loading status checks…
```
- Resolves #48
- Resolves #52
- Resolves #53
- Resolves #469
- Remove all NER associated functionality
- Tweak pom.xml to handle the removal
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

060622c
Add ExtractPopularImages, WriteGEXF, and WriteGraphML to Python. (#466 )

ruebot committed May 27, 2020

Loading status checks…
```
- Resolves #409
- Add Python implementations of
  - ExtractPopularImages
  - WriteGraphML
  - WriteGEXF
- Clean up formatting in app.py, and udfs
- Cleanup doc comments on the Scala side
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

4322eb9

Commits on May 24, 2020

Remove ExtractImageDetailsDF; resolves #464 . (#465 )

ruebot committed May 24, 2020

Loading status checks…

Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

cfcbc48

Commits on May 19, 2020

Implement Scala Matchbox UDFs in Python. (#463 )

ruebot committed May 19, 2020

- Resolves #408
- Alphabetizes DataFrameloader functions
- Alphabetizes UDFs functions
- Move DataFrameLoader to df packages
- Move UDFs out of df into their own package
- Rename UDFs (no more DF tagged to the end).
- Update tests as necessary
- Partially addresses #410, #409
- Supersedes #412.

69007e2

Commits on May 10, 2020

Import clean-up for df package. (#462 )

ruebot committed May 10, 2020

Loading status checks…

Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

1d01571

Commits on May 4, 2020

[maven-release-plugin] prepare for next development iteration

ruebot committed May 4, 2020

Loading status checks…

Verified

This commit was signed with a verified signature.

ruebot Nick Ruest

GPG key ID: 417FAF1A0E1080CD Learn about signing commits

4183a35
[maven-release-plugin] prepare release aut-0.70.0

ruebot committed May 4, 2020

Verified

This commit was signed with a verified signature.

ruebot Nick Ruest

GPG key ID: 417FAF1A0E1080CD Learn about signing commits

df43ac6
[skip travis] README updates (#460 )

ruebot committed May 4, 2020
```
- `$` should only be used if output is also shown (mdl)
- Add UserDoc badge, and yank buried documentation section
- Additional formatting and typo fixes
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

3ec5bba
Set spark-submit app name to be "aut - extractorName". (#459 )

ruebot committed May 4, 2020

Loading status checks…
```
- Resolves #458
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

ce6dc79

Commits on Apr 27, 2020

Add RemovePrefixWWWDF to DomainFrequencyExtractor. (#457 )

ruebot committed Apr 27, 2020

Loading status checks…
```
- Resolves #456
- Update test
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

0f3d732

Commits on Apr 23, 2020

[skip travis] Updating Java install instructions, resolves #445 (#455 )

ianmilligan1 committed Apr 23, 2020

Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

9b1aae9

Commits on Apr 22, 2020

Add option to save to Parquet for app. (#454 )

ruebot committed Apr 22, 2020

Loading status checks…
```
- Resolves #448
- Update test
- Add CSV headers to coalesce CSV output
- Update README
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

aece1e3
Update PlainTextExtractor to output a single column; text. (#453 )

ruebot committed Apr 22, 2020

Loading status checks…
```
- Resolves #452
- PlainTextExtractor runs ExtractBoilerplate on `content`
- Update test
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

e91d01f

Commits on Apr 21, 2020

Add a number of additional app extractors. (#451 )

ruebot committed Apr 21, 2020

- Resolves #447
- Add AudioInformationExtractor, ImageInformationExtractor,
PDFInformationExtractor, PresentationProgramInformationExtractor,
SpreadsheetInformationExtractor, TextFilesInformationExtractor,
VideoInformationExtractor, WebGraphExtractor,
WordProcessorInformationExtractor
- Add tests for the new extractors
- Update CommandLineApp to use new extractors
- Add domain, and language column WebPagesExtractor
- Change "TEXT" to "csv"
- Lower case "GEXF" and "GRAPHML"

f1eb43b

Commits on Apr 20, 2020

Remove RDD option in app; DataFrame only now. (#450 )

ruebot committed Apr 20, 2020

Loading status checks…
```
- Resolves #449
- Updates and renames tests were applicable
- Update README to reflect updates
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

17ac324

Commits on Apr 15, 2020

[skip-travis] Add spark-submit option to README; resolves #444 . (#446 )

ruebot committed Apr 15, 2020

Loading status checks…

Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

d5a0433
[maven-release-plugin] prepare for next development iteration

ruebot committed Apr 15, 2020

Loading status checks…

Verified

This commit was signed with a verified signature.

ruebot Nick Ruest

GPG key ID: 417FAF1A0E1080CD Learn about signing commits

35291bf

Older

archivesunleashed / aut