Flickr WARC to TFRecords

A script for extracting images and corresponding metadata from the ArchiveTeam Flickr Dump and writing to TFRecords

Compile instructions

RUSTFLAGS="-C target-cpu=native" cargo build --release
cp target/release/flickr_warc .

# flickr_warc <input file> <output file>
flickr_warc flickr_20190324074003_89733133.megawarc.warc.gz flickr_20190324074003_89733133.tfrecords

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
src		src
.gitignore		.gitignore
Cargo.lock		Cargo.lock
Cargo.toml		Cargo.toml
check_tfrecord.py		check_tfrecord.py
readme.md		readme.md