DBpedia

DBpedia
Developer(s)
Initial release 23 January 2007 (2007-01-23)
Stable release DBpedia 3.11 a/k/a DBpedia 2015-04 a/k/a DBpedia 2015 A / September 2015
Written in
Operating system Virtuoso Universal Server
Type
License GNU General Public License
Alexa rank Steady 65,311 (November 2013)
Website dbpedia.org

DBpedia (from "DB" for "database") is a project aiming to extract structured content from the information created as part of the Wikipedia project. This structured information is then made available on the World Wide Web.[1] DBpedia allows users to semantically query relationships and properties associated with Wikipedia resources, including links to other related datasets.[2] DBpedia has been described by Tim Berners-Lee as one of the more famous parts of the decentralized Linked Data effort.[3]

Background

The project was started by people at the Free University of Berlin and Leipzig University, in collaboration with OpenLink Software,[4] and the first publicly available dataset was published in 2007. It is made available under free licences, allowing others to reuse the dataset.

Wikipedia articles consist mostly of free text, but also include structured information embedded in the articles, such as "infobox" tables (the pull-out panels that appear in the top right of the default view of many Wikipedia articles, or at the start of the mobile versions), categorisation information, images, geo-coordinates and links to external Web pages. This structured information is extracted and put in a uniform dataset which can be queried.

Dataset

In September 2014, version 2014 was released.[5] Compared to previous versions, one of the main changes was the way abstract texts got extracted. By running a local mirror of Wikipedia and retrieving the rendered abstracts from it, the extracted texts got considerably cleaner. Furthermore, a new data set containing contents extracted from Wikimedia Commons was introduced. The whole DBpedia data set describes 4.58 million entities, out of which 4.22 million are classified in a consistent ontology, including 1,445,000 persons, 735,000 places, 123,000 music albums, 87,000 films, 19,000 video games, 241,000 organizations, 251,000 species and 6,000 diseases.[6] The data set features labels and abstracts for these entities in up to 125 different languages; 25.2 million links to images and 29.8 million links to external web pages. In addition, it contains around 50 million links into other RDF datasets, 80.9 million links to Wikipedia categories, and 41.2 million YAGO2 categories.[6] The DBpedia project uses the Resource Description Framework (RDF) to represent the extracted information and consists of 3 billion RDF triples, 580 million extracted from the English edition of Wikipedia and 2.46 billion from other language editions.[6]

From this data set, information spread across multiple pages can be extracted, for example book authorship can be put together from pages about the work, or the author.

One of the challenges in extracting information from Wikipedia is that the same concepts can be expressed using different parameters in infobox and other templates, such as |birthplace= and |placeofbirth=. Because of this, queries about where people were born would have to search for both of these properties in order to get more complete results. As a result, the DBpedia Mapping Language has been developed to help in mapping these properties to an ontology while reducing the number of synonyms. Due to the large diversity of infoboxes and properties in use on Wikipedia, the process of developing and improving these mappings has been opened to public contributions.[7]

Examples

DBpedia extracts factual information from Wikipedia pages, allowing users to find answers to questions where the information is spread across many different Wikipedia articles. Data is accessed using an SQL-like query language for RDF called SPARQL. For example, imagine you were interested in the Japanese shōjo manga series Tokyo Mew Mew, and wanted to find the genres of other works written by its illustrator. DBpedia combines information from Wikipedia's entries on Tokyo Mew Mew, Mia Ikumi and on works such as Super Doll Licca-chan and Koi Cupid. Since DBpedia normalises information into a single database, the following query can be asked without needing to know exactly which entry carries each fragment of information, and will list related genres:

PREFIX dbprop: <http://dbpedia.org/property/>
PREFIX db: <http://dbpedia.org/resource/>
SELECT ?who, ?WORK, ?genre WHERE { 
 db:Tokyo_Mew_Mew dbprop:author ?who .
 ?WORK  dbprop:author ?who .
 OPTIONAL { ?WORK dbprop:genre ?genre } .
}

Use cases

DBpedia has a broad scope of entities covering different areas of human knowledge. This makes it a natural hub for connecting datasets, where external datasets could link to its concepts.[8] The DBpedia dataset is interlinked on the RDF level with various other Open Data datasets on the Web. This enables applications to enrich DBpedia data with data from these datasets. As of September 2013, there are more than 45 million interlinks between DBpedia and external datasets including: Freebase, OpenCyc, UMBEL, GeoNames, MusicBrainz, CIA World Fact Book, DBLP, Project Gutenberg, DBtune Jamendo, Eurostat, UniProt, Bio2RDF, and US Census data.[9][10] The Thomson Reuters initiative OpenCalais, the Linked Open Data project of the New York Times, the Zemanta API and DBpedia Spotlight also include links to DBpedia.[11][12][13] The BBC uses DBpedia to help organize its content.[14][15] Faviki uses DBpedia for semantic tagging.[16]

Amazon provides a DBpedia Public Data Set that can be integrated into Amazon Web Services applications.[17]

DBpedia Spotlight

In June 2010 researchers from the Web Based Systems Group at the Free University of Berlin started a project named DBpedia Spotlight, a tool for annotating mentions of DBpedia resources in text. This provides a solution for linking unstructured information sources to the Linked Open Data cloud through DBpedia. DBpedia Spotlight performs named entity extraction, including entity detection and name resolution (in other words, disambiguation). It can also be used for named entity recognition, amongst other information extraction tasks. DBpedia Spotlight aims to be customizable for many use cases. Instead of focusing on a few entity types, the project strives to support the annotation of all 3.5M entities and concepts from more than 320 classes in DBpedia.

DBpedia Spotlight is publicly available as a web service for testing purposes or a Java/Scala API licensed via Apache License. The DBpedia Spotlight distribution also includes a jQuery plugin that allows developers to annotate pages anywhere on the Web by adding one line to their page.[18] Clients are also available in Java or PHP.[19] The tool handles various languages through its demo page[20] and web services. Internationalization is supported for any language that has a Wikipedia.[21]

See also

References

  1. ↑ Bizer, Christian; Lehmann, Jens; Kobilarov, Georgi; Auer, Soren; Becker, Christian; Cyganiak, Richard; Hellmann, Sebastian (September 2009). "DBpedia - A crystallization point for the Web of Data" (PDF). Web Semantics: Science, Services and Agents on the World Wide Web 7 (3): 154–165. doi:10.1016/j.websem.2009.07.002. ISSN 1570-8268.
  2. ↑ "Komplett verlinkt - Linked Data" (in German). 3sat. 2009-06-19. Retrieved 2009-11-10.
  3. ↑ "Sir Tim Berners-Lee Talks with Talis about the Semantic Web". Talis. 7 February 2008.
  4. ↑ "Credits". DBpedia. Retrieved 2014-09-09.
  5. ↑ "Changelog". DBpedia. September 2014. Retrieved 9 September 2014.
  6. 1 2 3 "DBpedia Version 2014 released". DBpedia. Retrieved 9 September 2014.
  7. ↑ "DBpedia Mappings". mappings.dbpedia.org. Retrieved 2010-04-03.
  8. ↑ E. Curry, A. Freitas, and S. O’Riáin, "The Role of Community-Driven Data Curation for Enterprises," in Linking Enterprise Data, D. Wood, Ed. Boston, MA: Springer US, 2010, pp. 25-47.
  9. ↑ "Statistics on links between Data sets", SWEO Community Project: Linking Open Data on the Semantic Web (W3C), retrieved 2009-11-24
  10. ↑ "Statistics on Data sets", SWEO Community Project: Linking Open Data on the Semantic Web (W3C), retrieved 2009-11-24
  11. ↑ Sandhaus, Evan; Larson, Rob (2009-10-29). "First 5,000 Tags Released to the Linked Data Cloud". open.blogs.nytimes.com. Retrieved 2009-11-10.
  12. ↑ "Life in the Linked Data Cloud". www.opencalais.com. Retrieved 2009-11-10. Wikipedia has a Linked Data twin called DBpedia. DBpedia has the same structured information as Wikipedia – but translated into a machine-readable format.
  13. ↑ "Zemanta talks Linked Data with SDK and commercial API". blogs.zdnet.com. Retrieved 2009-11-10. Zemanta fully supports the Linking Open Data initiative. It is the first API that returns disambiguated entities linked to dbPedia, Freebase, MusicBrainz, and Semantic Crunchbase.
  14. ↑ "European Semantic Web Conference 2009 - Georgi Kobilarov, Tom Scott, Yves Raimond, Silver Oliver, Chris Sizemore, Michael Smethurst, Christian Bizer and Robert Lee. Media meets Semantic Web - How the BBC uses DBpedia and Linked Data to make Connections". www.eswc2009.org. Retrieved 2009-11-10.
  15. ↑ "BBC Learning - Open Lab - Reference". bbc.co.uk. Retrieved 2009-11-10. Dbpedia is a database version of Wikipedia. It is used in a lot of projects for a wide range of different reasons. At the BBC we are using it for tagging content.
  16. ↑ "Semantic Tagging with Faviki". www.readwriteweb.com.
  17. ↑ "Amazon Web Services Developer Community : DBpedia". developer.amazonwebservices.com. Retrieved 2009-11-10.
  18. ↑ Mendes, Pablo. "DBpedia Spotlight jQuery Plugin". jQuery Plugins. Retrieved 15 September 2011.
  19. ↑ DiCiuccio, Rob. "PHP Client for DBpedia Spotlight". GitHub.
  20. ↑ "Demo of DBpedia Spotlight". Retrieved 8 September 2013.
  21. ↑ "Internationalization of DBpedia Spotlight". Retrieved 8 September 2013.

External links

Wikimedia Commons has media related to DBpedia.
This article is issued from Wikipedia - version of the Thursday, February 04, 2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.