Index Catalog // British Library

Research Repository

Start Over

Filtering by: Institution British Library Research Repository Keyword crawled URL index Collection British Library Datasets

Dataset

JISC UK Web Domain Dataset Crawled URL Index. 1996 - 2013. CDX.

The dataset comprises original compound index (CDX) files that have been re-assembled into 18 separate CDX files for each year of crawling activity represented (1996 - 2013). Please note that the individual CDX files are not sorted. In order to enable access to web archives, UKWA uses CDX files to...

UKWA Open Data
archive, 1996-2013, crawled URL index, web domain dataset, JISC UK, and UKWA Open Data