Generate purge command

Generate a ready-to-run command or code to clear the Contextractor crawl storage.

Storage

Storage directory

Commands or code only

What to do:

npm CLIGenerate commands

npm libTypeScript code

NPM package CLI

Clear the Contextractor crawl storage using the contextractor CLI. This permanently deletes the datasets/, key_value_stores/, and request_queues/ storage buckets — it is irreversible, with no confirmation and no undo. Point --storage at the storage directory to clear; with no --storage it resolves the default location (./storage or the shared XDG storage), which may wipe unrelated crawl data. Requires Node 22+.

#!/usr/bin/env bash
set -euo pipefail

mkdir -p contextractor-run
cd contextractor-run

npm init -y
npm install contextractor

npx contextractor purge

Available as:

Apify Actoractor, helpApify gives you $5 of free usage monthly
NPM package CLI & libpackage, CLI help, lib help
Source code on GitHub

X (Twitter)

What is Contextractor?

Contextractor extracts clean, readable content from any web page — stripping away navigation, ads, and boilerplate to leave just the text you need. Its Markdown output typically runs 80–90% fewer tokens than the raw HTML, so it is cheap to feed to an LLM. It is free and open source so you just download it an run it by yourself. Use it to build LLM training datasets, RAG pipelines, or research corpora.

It uses a Rust port of Trafilatura, which scores the highest F1 (0.966) on the ScrapingHub benchmark, with Crawlee handling the crawling. The Rust port keeps Trafilatura's heuristic extraction core, adds ML page-type routing so each page gets a matching extraction strategy. Compiled Rust speed, no Python, no GPU.

Run it as a hosted Apify actor, or self-host the npm CLI or npm library — the same engine and options in every channel.

Getting started

The easiest way to try Contextractor — one npx command extracts a page straight to your terminal, with no browser install (you can install it later) and no API key — you host it yourself:

npx contextractor extract-one https://example.com/ --crawler-type cheerio

--crawler-type cheerio fetches over plain HTTP, so no headless browser is downloaded. Need a whole-site crawl or specific formats? Use the playground to build a more advanced command visually, then copy it.