archivesunleashed/aut

Commits on Jun 18, 2020

Spark 3.0.0 + Java 11 support. (#375 )

ruebot committed Jun 18, 2020

Loading status checks…
```
- Update to Spark 3.0.0
- Update to Java 11
- Update README
- Remove Java8 support
- Resolves #375
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

59b1d4e

Commits on Jun 17, 2020

Add Python implementation of SaveBytes. (#482 )

ruebot committed Jun 17, 2020

Loading status checks…
```
- Resolves #478
- Tweak formatting in DataFrameLoader
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

cbff479

Commits on Jun 15, 2020

Bump xercesImpl from 2.11.0 to 2.12.0 (#481 )

dependabot committed Jun 15, 2020

Loading status checks…
```
Bumps xercesImpl from 2.11.0 to 2.12.0.

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

d8cca11

Commits on Jun 8, 2020

[Skip Travis] Trim README down given aut.docs.archivesunleashed.org (#…

ruebot committed Jun 8, 2020
```
…480)
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

39fc370

Commits on Jun 3, 2020

[maven-release-plugin] prepare for next development iteration

ruebot committed Jun 3, 2020

Loading status checks…

Verified

This commit was signed with a verified signature.

ruebot Nick Ruest

GPG key ID: 417FAF1A0E1080CD Learn about signing commits

37821fe
[maven-release-plugin] prepare release aut-0.80.0

ruebot committed Jun 3, 2020

Verified

This commit was signed with a verified signature.

ruebot Nick Ruest

GPG key ID: 417FAF1A0E1080CD Learn about signing commits

2442336

Commits on Jun 1, 2020

Remove RDD suffixes on file, class, and object names. (#479 )

ruebot committed Jun 1, 2020

- Remove all the RDD suffixes added previously
- Rename image_graph to imagegraph (Python)
- Rename GetExtensionMime to GetExtensionMIME (Scala)
- Remove textFiles (Scala)
- Remove text_files (Python)
- Remove TextFilesInformationExtractor
- Rename files all affected files as needed
- Update tests as needed

1ac97ef

Commits on May 29, 2020

PEP8 Python app method names. (#477 )

ruebot committed May 29, 2020

Loading status checks…
```
- Resolve 468
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

8037745
Move Python UDF methods out of their own class. (#475 )

ruebot committed May 29, 2020

Loading status checks…
```
- Resolve #467
- README button colour tweak for UserDocs
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

76c8247

Commits on May 28, 2020

Add DataFrame udf tests. (#474 )

ruebot committed May 28, 2020

Loading status checks…
```
- Resolves #473
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

4cd90dc

Commits on May 27, 2020

Remove tabDelimit. (#472 )

ruebot committed May 27, 2020

Loading status checks…
```
- Resolves #471
- Resolves #59
- Remove TupleFormatter (tabDelimit functionality)
- Remove shapeless from pom
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

9815ea4
Remove NER functionality. (#470 )

ruebot committed May 27, 2020

Loading status checks…
```
- Resolves #48
- Resolves #52
- Resolves #53
- Resolves #469
- Remove all NER associated functionality
- Tweak pom.xml to handle the removal
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

060622c
Add ExtractPopularImages, WriteGEXF, and WriteGraphML to Python. (#466 )

ruebot committed May 27, 2020

Loading status checks…
```
- Resolves #409
- Add Python implementations of
  - ExtractPopularImages
  - WriteGraphML
  - WriteGEXF
- Clean up formatting in app.py, and udfs
- Cleanup doc comments on the Scala side
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

4322eb9

Commits on May 24, 2020

Remove ExtractImageDetailsDF; resolves #464 . (#465 )

ruebot committed May 24, 2020

Loading status checks…

Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

cfcbc48

Commits on May 19, 2020

Implement Scala Matchbox UDFs in Python. (#463 )

ruebot committed May 19, 2020

- Resolves #408
- Alphabetizes DataFrameloader functions
- Alphabetizes UDFs functions
- Move DataFrameLoader to df packages
- Move UDFs out of df into their own package
- Rename UDFs (no more DF tagged to the end).
- Update tests as necessary
- Partially addresses #410, #409
- Supersedes #412.

69007e2

Commits on May 10, 2020

Import clean-up for df package. (#462 )

ruebot committed May 10, 2020

Loading status checks…

Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

1d01571

Commits on May 4, 2020

[maven-release-plugin] prepare for next development iteration

ruebot committed May 4, 2020

Loading status checks…

Verified

This commit was signed with a verified signature.

ruebot Nick Ruest

GPG key ID: 417FAF1A0E1080CD Learn about signing commits

4183a35
[maven-release-plugin] prepare release aut-0.70.0

ruebot committed May 4, 2020

Verified

This commit was signed with a verified signature.

ruebot Nick Ruest

GPG key ID: 417FAF1A0E1080CD Learn about signing commits

df43ac6
[skip travis] README updates (#460 )

ruebot committed May 4, 2020
```
- `$` should only be used if output is also shown (mdl)
- Add UserDoc badge, and yank buried documentation section
- Additional formatting and typo fixes
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

3ec5bba
Set spark-submit app name to be "aut - extractorName". (#459 )

ruebot committed May 4, 2020

Loading status checks…
```
- Resolves #458
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

ce6dc79

Commits on Apr 27, 2020

Add RemovePrefixWWWDF to DomainFrequencyExtractor. (#457 )

ruebot committed Apr 27, 2020

Loading status checks…
```
- Resolves #456
- Update test
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

0f3d732

Commits on Apr 23, 2020

[skip travis] Updating Java install instructions, resolves #445 (#455 )

ianmilligan1 committed Apr 23, 2020

Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

9b1aae9

Commits on Apr 22, 2020

Add option to save to Parquet for app. (#454 )

ruebot committed Apr 22, 2020

Loading status checks…
```
- Resolves #448
- Update test
- Add CSV headers to coalesce CSV output
- Update README
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

aece1e3
Update PlainTextExtractor to output a single column; text. (#453 )

ruebot committed Apr 22, 2020

Loading status checks…
```
- Resolves #452
- PlainTextExtractor runs ExtractBoilerplate on `content`
- Update test
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

e91d01f

Commits on Apr 21, 2020

Add a number of additional app extractors. (#451 )

ruebot committed Apr 21, 2020

- Resolves #447
- Add AudioInformationExtractor, ImageInformationExtractor,
PDFInformationExtractor, PresentationProgramInformationExtractor,
SpreadsheetInformationExtractor, TextFilesInformationExtractor,
VideoInformationExtractor, WebGraphExtractor,
WordProcessorInformationExtractor
- Add tests for the new extractors
- Update CommandLineApp to use new extractors
- Add domain, and language column WebPagesExtractor
- Change "TEXT" to "csv"
- Lower case "GEXF" and "GRAPHML"

f1eb43b

Commits on Apr 20, 2020

Remove RDD option in app; DataFrame only now. (#450 )

ruebot committed Apr 20, 2020

Loading status checks…
```
- Resolves #449
- Updates and renames tests were applicable
- Update README to reflect updates
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

17ac324

Commits on Apr 15, 2020

[skip-travis] Add spark-submit option to README; resolves #444 . (#446 )

ruebot committed Apr 15, 2020

Loading status checks…

Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

d5a0433
[maven-release-plugin] prepare for next development iteration

ruebot committed Apr 15, 2020

Loading status checks…

Verified

This commit was signed with a verified signature.

ruebot Nick Ruest

GPG key ID: 417FAF1A0E1080CD Learn about signing commits

35291bf
[maven-release-plugin] prepare release aut-0.60.0

ruebot committed Apr 15, 2020

Verified

This commit was signed with a verified signature.

ruebot Nick Ruest

GPG key ID: 417FAF1A0E1080CD Learn about signing commits

d0f9761

Commits on Apr 14, 2020

Remove WriteGraph; resolves #439 . (#441 )

ruebot committed Apr 14, 2020

Loading status checks…
```
* Cleanup WriteGraphML doc comments.
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

c1f9b31

Commits on Apr 13, 2020

Remove GraphX support; resolves #442 . (#443 )

ruebot committed Apr 13, 2020

Loading status checks…
```
- Remove graphx dependencies from pom
- Remove ExtractGraphX and related tests
- Remove WriteGraphXML and related tests
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

f357e0c

Commits on Apr 11, 2020

Add graphml output to CommandLineApp and DomainGraphExtractor. (#438 )

ruebot committed Apr 11, 2020

Loading status checks…
```
* Resolves #435
* Adds GRAPHML option to CommandLineApp
* Adds DataFrame method to DomainGraphExtractor
* Updates CommandLineApp, and WriteGraphML tests
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

943cf92

Commits on Apr 8, 2020

Align RDD and DF output for DomainGraphExtractor. (#437 )

ruebot committed Apr 8, 2020

Loading status checks…
```
- Resolves #436
- Remove WWW prefix for RDD was double escaping
- Update DF so it matches RDD output (it wasn't even close before
🤦)
- Update tests so they're basically testing the same thing
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

96899f4

Commits on Apr 7, 2020

Update log4j configuration to resolve #433 . (#434 )

ruebot committed Apr 7, 2020

Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

b957e5d
Add imagegraph, and webgraph to command line app. (#432 )

ruebot committed Apr 7, 2020

Loading status checks…
```
- Resolves #431
- Adds webpages, and imagegraph to command line app
- Adds tests for new functionality
- Clean-up doc comments
- Convert files with dos line endings to unix line endings
- Update CommandLineApp tests
```
Verified

This commit was created on GitHub.com and signed with a verified signature using GitHub’s key.

GPG key ID: 4AEE18F83AFDEB23 Learn about signing commits

771ea82

Older

archivesunleashed / aut