UK Web Archive: Data

UK Web Archive: Data

This folder contains a variety of data sets. Some examples include data sets that were manually created, derived from manually created metadata records, derived data from indexed archived websites.
Collection Details
Keywords

Settings

Now showing 1 - 2 of 2
  • Thumbnail Image
    Some of the metrics are blocked by your 
    consent settings
    Item type:Dataset,
    JISC UK Web Domain Dataset Host Link Graph. 1996 - 2010. TSV.
    UKWA Open Data
    The dataset comprises ~2.5 billion 200 OK responses from the 1996 - 2010 tranche of the JISC UK Web Domain Dataset which have been scanned for hyperlinks. For each link, UKWA extracts the host that the link targets, and uses this to build up a picture of which hosts have linked to which other hosts, over time. In partnership with the Internet Archive and JISC, UKWA had obtained access to the subset of the Internet Archive’s web collection that relates to the UK. The JISC UK Web Domain Dataset (1996 - 2013) contains all of the resources from the Internet Archive that were hosted on domains ending in ‘.uk’, or that are required in order to render those UK pages. For more information: http://data.webarchive.org.uk/opendata/ukwa.ds.2/host-linkage/
      10
  • Thumbnail Image
    Some of the metrics are blocked by your 
    consent settings
    Item type:Dataset,
    JISC UK Web Domain Dataset Crawled URL Index. 1996 - 2013. CDX.
    UKWA Open Data
    The dataset comprises original compound index (CDX) files that have been re-assembled into 18 separate CDX files for each year of crawling activity represented (1996 - 2013). Please note that the individual CDX files are not sorted. In order to enable access to web archives, UKWA uses CDX files to act as indexes so that it is possible to look up which ARC or WARC files contain which URLs and responses. In partnership with the Internet Archive and JISC, UKWA had obtained access to the subset of the Internet Archive’s web collection that relates to the UK. The JISC UK Web Domain Dataset (1996 - 2013) contains all of the resources from the Internet Archive that were hosted on domains ending in ‘.uk’, or that are required in order to render those UK pages. For more information: http://data.webarchive.org.uk/opendata/ukwa.ds.2/cdx/
      24