Dataset

DUKweb (Diachronic UK web)

Public Deposited

Creator
  • Basile, Pierpaolo  ( ORCID )
  • Tsakalidis, Adam  ( ISNI )
2020

Abstract
  • We present DUKweb, a set of large-scale resources useful for the diachronic analysis of contemporary English. The dataset is derived from JISC UK Web Domain Dataset (1996-2013), which collects resources from the Internet Archive that were hosted on domains ending in ‘.uk’. The dataset includes co-occurrences matrices for each year and two types of word vectors by year, Temporal Random Indexing vectors and word2vec embeddings.

Items:

Thumbnail File Name Date Uploaded Visibility File Size Actions
2000.csv.zip 2020-10-19 Public 110 MB
2001.csv.zip 2020-10-19 Public 190 MB
2002.csv.zip 2020-10-19 Public 260 MB
2003.csv.zip 2020-10-19 Public 410 MB
2004.csv.zip 2020-10-19 Public 590 MB
2005.csv.zip 2020-10-19 Public 560 MB
2006.csv.zip 2020-10-19 Public 470 MB
2007.csv.zip 2020-10-19 Public 520 MB
2008.csv.zip 2020-10-19 Public 550 MB
2009.csv.zip 2020-10-19 Public 310 MB
2010.csv.zip 2020-10-19 Public 550 MB
2011.csv.zip 2020-10-19 Public 610 MB
2012.csv.zip 2020-10-19 Public 750 MB
2013.csv.zip 2020-10-19 Public 270 MB
manifest-md5.txt 2020-10-19 Public 686 Bytes
D-1996_merge_occ.gz 2020-10-19 Public 650 MB
D-1997_merge_occ.gz 2020-10-19 Public 2.7 GB
D-1998_merge_occ.gz 2020-10-19 Public 2.4 GB
D-1999_merge_occ.gz 2020-10-19 Public 3.6 GB
D-2000_merge_occ.gz 2020-10-19 Public 5.8 GB
D-2001_merge_occ.gz 2020-10-19 Public 9.2 GB
D-2002_merge_occ.gz 2020-10-19 Public 11 GB
D-2003_merge_occ.gz 2020-10-19 Public 14 GB
D-2004_merge_occ.gz 2020-10-19 Public 18 GB
D-2005_merge_occ.gz 2020-10-19 Public 17 GB
D-2006_merge_occ.gz 2020-10-19 Public 17 GB
D-2007_merge_occ.gz 2020-10-19 Public 18 GB
D-2008_merge_occ.gz 2020-10-19 Public 20 GB
D-2009_merge_occ.gz 2020-10-19 Public 14 GB
D-2010_merge_occ.gz 2020-10-19 Public 17 GB
D-2011_merge_occ.gz 2020-10-19 Public 19 GB
D-2012_merge_occ.gz 2020-10-19 Public 21 GB
D-1996-merge.vectors 2020-10-19 Public 1.5 GB
D-1996-merge.vectors.txt.gz 2020-10-19 Public 280 MB
D-1997-merge.vectors 2020-10-19 Public 2.2 GB
D-1997-merge.vectors.txt.gz 2020-10-19 Public 900 MB
D-1998-merge.vectors 2020-10-19 Public 2.2 GB
D-1998-merge.vectors.txt.gz 2020-10-19 Public 820 MB
D-1999-merge.vectors 2020-10-19 Public 2.4 GB
D-1999-merge.vectors.txt.gz 2020-10-19 Public 1.1 GB
D-2000-merge.vectors 2020-10-19 Public 2.6 GB
D-2000-merge.vectors.txt.gz 2020-10-19 Public 1.5 GB
D-2001-merge.vectors 2020-10-19 Public 2.7 GB
D-2001-merge.vectors.txt.gz 2020-10-19 Public 1.9 GB
D-2002-merge.vectors 2020-10-19 Public 2.8 GB
D-2002-merge.vectors.txt.gz 2020-10-19 Public 2.1 GB
D-2003-merge.vectors 2020-10-19 Public 3 GB
D-2003-merge.vectors.txt.gz 2020-10-19 Public 2.4 GB
D-2004-merge.vectors 2020-10-19 Public 3.1 GB
D-2004-merge.vectors.txt.gz 2020-10-19 Public 2.7 GB
D-2005-merge.vectors 2020-10-19 Public 3.1 GB
D-2005-merge.vectors.txt.gz 2020-10-19 Public 2.7 GB
D-2006-merge.vectors 2020-10-19 Public 3.2 GB
D-2006-merge.vectors.txt.gz 2020-10-19 Public 2.7 GB
D-2007-merge.vectors 2020-10-19 Public 3.2 GB
D-2007-merge.vectors.txt.gz 2020-10-19 Public 2.8 GB
D-2008-merge.vectors 2020-10-19 Public 3.3 GB
D-2008-merge.vectors.txt.gz 2020-10-19 Public 2.9 GB
D-2009-merge.vectors 2020-10-19 Public 3.3 GB
D-2009-merge.vectors.txt.gz 2020-10-19 Public 2.6 GB
D-2010-merge.vectors 2020-10-19 Public 3.3 GB
D-2010-merge.vectors.txt.gz 2020-10-19 Public 2.8 GB
D-2011-merge.vectors 2020-10-19 Public 3.4 GB
D-2011-merge.vectors.txt.gz 2020-10-19 Public 2.9 GB
D-2012-merge.vectors 2020-10-19 Public 3.4 GB
D-2012-merge.vectors.txt.gz 2020-10-19 Public 3 GB
D-2013-merge.vectors 2020-10-19 Public 3.1 GB
D-2013-merge.vectors.txt.gz 2020-10-19 Public 1.9 GB
vectors.elemental 2020-10-19 Public 3.6 GB
timseries_33c95488-2f68-4186-a0ea-9622d462a454.zip 2021-02-08 Public 310 MB
D-2013_merge_occ_738d9109-a836-4e70-aadd-fe6256b81c25.gz 2021-02-08 Public 8.9 GB

Metadata

Resource Type
  • Dataset
Creator
  • Basile, Pierpaolo  ( ORCID )
  • Tsakalidis, Adam  ( ISNI )
Contributor
  • Bazzi, Marya  ( Contributor ISNI )
  • Cucuringu, Mihai  ( Contributor ORCID )
  • McGillivray, Barbara  ( Contributor ORCID   ISNI )
  • UK Web Archive  ( Collaborative Institution ISNI )
Date published
  • 2020-10-08
Institution
  • British Library
Project name
  • Discovering polarity change in word meanings
Funder
  • Name: Engineering and Physical Sciences Research Council 
  • Awards: EP/N510129/1
  • Name: The Alan Turing Institute 
  • Awards: SF099
Publisher
  • British Library
Place of publication
  • London, UK
Official URL
Related URL
Licence
  • CC BY 4.0 Attribution
DOI
  • doi.org/10.23636/1209

Relationships

In Collection: