Knowledge Graph Futures

1. Knowledge Graph Futures Paul Groth | @pgroth | pgroth.com | indelab.org ESWC 2020 Panel on Knowledge Graphs

2. Source: Natasha Noy, Yuqing Gao, Anshu Jain, Anant Narayanan, Alan Patterson, and Jamie Taylor. 2019. Industry-scale Knowledge Graphs: Lessons and Challenges. Queue 17, 2, pages 20 (April 2019), 28 pages. DOI: https://doi.org/10.1145/3329781.3332266

3. The KG Assumption Source: Stephen H. Bach et al. 2019. Snorkel DryBell: A Case Study in Deploying Weak Supervision at Industrial Scale. In Proceedings of the 2019 International Conference on Management of Data (SIGMOD '19). ACM, New York, NY, USA, 362-375. DOI: https://doi.org/10.1145/3299869.3314036

4. Simplicity & Openness

5. ML + KGs

6. Grappling with softness Proceedings of the 12th Conference on Language Resources and Evaluation (LREC 2020), pages 2129–2137 Marseille, 11–16 May 2020 c European Language Resources Association (ELRA), licensed under CC-BY-NC 2129 Towards Entity Spaces Marieke van Erp⇤ , Paul Groth† ⇤ KNAW Humanities Cluster - DHLab, Amsterdam, NL † University of Amsterdam, Amsterdam, NL marieke.van.erp@dh.huc.knaw.nl, p.groth@uva.nl Abstract Entities are a central element of knowledge bases and are important input to many knowledge-centric tasks including text analysis. For example, they allow us to find documents relevant to a specific entity irrespective of the underlying syntactic expression within a document. However, the entities that are commonly represented in knowledge bases are often a simplification of what is truly being referred to in text. For example, in a knowledge base, we may have an entity for Germany as a country but not for the more fuzzy concept of Germany that covers notions of German Population, German Drivers, and the German Government. Inspired by recent advances in contextual word embeddings, we introduce the concept of entity spaces - specific representations of a set of associated entities with near-identity. Thus, these entity spaces provide a handle to an amorphous grouping of entities. We developed a proof-of-concept for English showing how, through the introduction of entity spaces in the form of disambiguation pages, the recall of entity linking can be improved. Keywords: entity, identity, knowledge representation, entity linking 1. Introduction Entities are a central element for knowledge bases and text analysis tasks (Balog, 2018). However, the way in which entities are represented in knowledge bases and how subsequent tools use these representations are a simplification of the complexity of many entities. For example, the entity Germany in Wikidata as represented by wikidata:Q183 focuses on its properties as a location and geopolitical entity due to its membership as an in- stance of sovereign state, country, federal state, repub- lic, social state, legal state, and administrative territorial entity. Similarly, in DBpedia (version 2016-10), Ger- many is represented as entity of type populated place and some subtypes such as yago:WikicatFederalCountries and yago:WikicatMemberStatesOfTheEuropeanUnion.1 However, when the term Germany is used in text, it can take on many meanings that all have ‘something to do’ with Germany as it is represented in knowledge bases, but are all not quite the same: (1) Germany imported 47,600 sheep from Britain last year, nearly half of total imports. (2) German July car registrations up 14.2 pct yr / yr. (3) Australia last won the Davis Cup in 1986, but they were beaten finalists against Germany three years ago under Fraser’s guidance. In Example (1), Germany refers partly to the location, but a location usually cannot take on an active role, such that the entity ‘importing’ the sheep is most likely a referent to the German meat industry. Germany in Example (2), refers to the German population buying and registering more cars than a year before. Finally, in Example (3), Germany refers to the German Davis Cup team from 1993 (the news article is from 1996). In the AIDA-YAGO dataset, this entity is tagged as dbp:Germany Davis Cup team but this presents 1 Germany also has rdf:type dbo:Person but we assume this is a glitch. us with another layer of identities, namely that every year, or every couple of years, the German Davis cup team con- sists of different players. In 1993, the German Davis cup team consisted of Michael Stich and Marc-Kevin Goellner, in 1996 of David Prinosil and Hendrik Dreekmann and at the time of writing this article in 2019 of Alexander Zverev and Philipp Kohlschreiber. Both MAG (Moussallem et al., 2017) and DBpedia spotlight (Daiber et al., 2013a) annotate Australia and Germany in Example (3) as dbp:Australia and dbp:Germany respectively. While both the annotations and automatic linkages are close to the identity of the entity in resolving these referents to dbp:Germany, we argue this is an underspecification and highlights a larger problem with identity representation in knowledge bases. Collapsing of identities has been a frequent topic within Semantic Web discourse. However, most discussions have focused on issues with owl:sameAs links (McCusker and McGuinness, 2010; Raad et al., 2018). However, the problem of simplified entity representations (e.g. the collapsing of identities) also occurs before the creation of such owl:sameAs links. Specifically, with the fact that most knowledge bases represent a single or limited number of an entity’s facets. In this paper, we analyse the extent of the problem by connecting Semantic Web representations of identity to linguistic representations of entities, namely coreference and near-identity. To overcome this identity problem, we argue for the introduction of explicit representations of near-identity within knowledge bases. We term these explicit representations - entity spaces. We illustrate how the introduction of entity spaces can boost the perfor- mance of state-of-the-art entity linking pipelines. Our contributions are: 1) the definition of entity spaces; 2) a prototype showing the use of entity spaces over multiple entity linking pipelines; and 3) experiments on 13 English entity linking datasets showing the impact of a more toler- ant approach to entity linking made possible through entity spaces. Our code and experimental results are available via https: //github.com/MvanErp/entity-spaces.

7. Content Universal schema Surface form relations Structured relations Factorization model Matrix Construction Open Information Extraction Entity Resolution Matrix Factorization Knowledge graph Curation Predicted relations Matrix Completion Taxonomy Triple Extraction Concept Resolution 14M SD articles 475 M triples 3.3 million relations 49 M relations ~15k -> 1M entries Paul Groth, Sujit Pal, Darin McBeath, Brad Allen, Ron Daniel “Applying Universal Schemas for Domain Specific Ontology Expansion” 5th Workshop on Automated Knowledge Base Construction (AKBC) 2016 KG = Complicated Pipelines

8. Humans & Machines

9. knowledgescientist.org

10. Knowledge Engineering Revisited • Knowledge graphs are built ad-hoc • 100s of components (extractors, scrapers, quality, scoring, user feedback, ….) • Unique for each organization • Existing knowledge engineering theory does not apply: • Assumes small scale • Assumes slow change • People-centric • Expressive representations • an updated theory and methods for knowledge engineering designed for the demands of modern knowledge graphs

11. Conclusion • The change in frame to knowledge graphs has opened up thinking • Research challenge #1 - the ramiﬁcations of language models • Research challenge #2 - knowledge engineering theory revisited Paul Groth | @pgroth | pgroth.com | indelab.org Thanks to Daniel Daza, Thiviyan Thanapalsingam, Marieke van Erp and Frank van Harmelen We’re hiring!