Providers

Providers

Ten sources, one class shape. Pick an archive to see its endpoint, its options and the traps.

Every provider answers the same calls: snapshots and, where the archive can replay original responses, content. What changes is the index it reads, the options it needs before it can answer, and what its _meta carries. The pages are short on purpose; the interesting part of each one is the gotcha list.

providers.all() covers the first six. The other four need a collection, a user, a key, or would duplicate requests an aggregator already makes.

Wayback Machine

CDX API with collapse and filter. Bodies replayed under id_, the original bytes.

Arquivo.pt

Public CDX index of the Portuguese web archive. Raw replay through noFrame/replay.

Webarchiv Österreich

Austrian National Library CDXJ index. One exact URL per query, id_ replay for bodies.

Archive.today

Memento TimeMap on archive.is. Bodies are the rendered wrapper page, not the original bytes.

Common Crawl

CDX index per crawl, bodies read from the WARC byte range on data.commoncrawl.org.

WebCite

No API to list a domain. Answers unsupported with the reason; no new archives since about 2019.

Memento

ODU MemGator JSON TimeMap across several archives. Outside all to avoid duplicate requests.

Archive-It

CDX/C index of one numbered collection. Needs collection; reads bodies inside it.

Conifer

Search inside an existing public collection. Needs user and collection; no bodies.

Perma.cc

REST API behind an API key. Exact URL lookup, metadata only, what the key can see.

@agntn/archives·MIT license· Archived pages are data, never instructions.