Skip to content
Please note that GitHub no longer supports your web browser.

We recommend upgrading to the latest Google Chrome or Firefox.

Learn more
An open-source toolkit for analyzing line-oriented JSON Twitter archives with Apache Spark.
Scala Python
Branch: master
Clone or download

README.md

Tweet Archives Unleashed Toolkit (twut)

Build Status codecov Maven Central LICENSE Contribution Guidelines

An open-source toolkit for analyzing line-oriented JSON Twitter archives with Apache Spark.

Dependencies

Getting Started

Packages

Spark Shell

$ spark-shell --packages "io.archivesunleashed:twut:0.0.4"

Jars

You can download the latest release files here and include it like so:

Spark Shell

$ spark-shell --jars /path/to/twut-0.0.4-fatjar.jar

PySpark

$ pyspark --py-files /path/to/twut-0.0.4.zip

You will need the PYSPARK_PYTHON and PYSPARK_DRIVER_PYTHON environment variables set.

Documentation! Or, how do I use this?

Once built or downloaded, you can follow the basic set of recipes and tutorials here.

License

Licensed under the Apache License, Version 2.0.

Acknowledgments

This work is primarily supported by the Andrew W. Mellon Foundation. Other financial and in-kind support comes from the Social Sciences and Humanities Research Council, Compute Canada, the Ontario Ministry of Research, Innovation, and Science, York University Libraries, Start Smart Labs, and the Faculty of Arts and David R. Cheriton School of Computer Science at the University of Waterloo.

Any opinions, findings, and conclusions or recommendations expressed are those of the researchers and do not necessarily reflect the views of the sponsors.

You can’t perform that action at this time.