/wikidata-sparql-history

No description, website, or topics provided.
  1. Java 99.0%
  2. Other 1.0%
Branch: master
Find file
Clone or download

Clone with HTTPS

Use Git or checkout with SVN using the web URL.

Open in Desktop Download ZIP

Launching GitHub Desktop...

If nothing happens, download GitHub Desktop and try again.

Launching GitHub Desktop...

If nothing happens, download GitHub Desktop and try again.

Launching Xcode...

If nothing happens, download Xcode and try again.

Launching Visual Studio...

If nothing happens, download the GitHub extension for Visual Studio and try again.

Tpt
Tpt Fixes content negotiation
Latest commit 3dc4cf9 Feb 6, 2019
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
src Fixes content negotiation Feb 6, 2019
.travis.yml Adds travis build Jan 9, 2019
LICENSE.md Adds license Jan 9, 2019
README.md Updates the README Jan 23, 2019
download_wd_history.sh Adds a readme Jan 9, 2019
pom.xml Upgrades dependencies Jan 21, 2019

README.md

SPARQL endpoint for Wikidata history

This repository provides a SPARQL endpoint for Wikidata history, allowing to do queries like "count the number of humans in Wikidata in 2015" or "how many contributors have added values for the sex or gender property".

A documentation page is available on Wikidata.org.

Build Status

Developer documentation

To setup a working endpoint do:

  • Compile the Java program mvn package
  • Download the Wikidata history dumps to a directory mkdir dumps && cd dumps && bash ../download_wd_history.sh. Warning: it requies around 600GB of disk.
  • Preprocess the dump to get all revision metadata and triples annotated with their insertions and deletions (takes a few days and all your CPU cores): java -server -jar target/sparql-endpoint-0.1-SNAPSHOT.jar -preprocess
  • Build database indexes: java -server -jar target/sparql-endpoint-0.1-SNAPSHOT.jar -load.
  • Start the web server java -server -classpath target/sparql-endpoint-0.1-SNAPSHOT.jar org.wikidata.history.web.Main

License

Copyright (C) 2019 Thomas Pellissier Tanon.

This program is free software: you can redistribute it and/or modify it under the terms of the GNU Affero General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU Affero General Public License for more details.