GitHub issue(s): #156

What does this Pull Request do?

• Adds log message (level "INFO") indicating when an ARC or WARC file that has been read has been closed.

How should this be tested?

In Spark shell:

scala> sc.setLogLevel("INFO")

scala> :paste
// Entering paste mode (ctrl-D to finish)

import io.archivesunleashed._
import io.archivesunleashed.matchbox._

val r = RecordLoader.loadArchives("/PATH/TO/test-classes/arc/*.arc.gz", sc)
.keepValidPages()
.map(r => ExtractDomain(r.getUrl))
.countItems()
.take(10)

The logs should contain something similar to this:

2019-01-30 11:10:04 INFO  NewHadoopRDD:54 - Input split: file:/home/jrwiebe/aut/target/test-classes/arc/badexample.arc.gz:0+1221
2019-01-30 11:10:04 INFO  NewHadoopRDD:54 - Input split: file:/home/jrwiebe/aut/target/test-classes/arc/example.arc.gz:0+2012526
WARNING Record STARTING at 0 has 1761 trailing byte(s): file:/home/jrwiebe/aut/target/test-classes/arc/badexample.arc.gz: {subject-uri=filedesc://IAH-20080430204825-00000-blackbook.arc, ip-address=0.0.0.0, origin=InternetArchive, length=1300, absolute-offset=0, creation-date=20080430204825, content-type=text/plain, version=1.1}
2019-01-30 11:10:05 INFO  ArchiveRecordInputFormat:240 - Closed archive file file:/home/jrwiebe/aut/target/test-classes/arc/badexample.arc.gz

Additional Notes:

Interested parties

@dportabella