Web Scrape API

Scrape and extract readable content from any URL using headless Chromium. Returns markdown, text, or HTML. Powered by Crawlee + Playwright.

POST https://pylon-web-scrape-api.fly.dev/scrape

Parameters

ParameterTypeRequiredDescription
urlstringYesURL to scrape
formatstringNoOutput format: markdown (default), text, or html
waitFornumberNoExtra ms to wait after page load (default 0, max 10000)

Response

{
  "url": "https://example.com",
  "format": "markdown",
  "content": "# Example Domain\n\nThis domain is for use in illustrative examples...",
  "contentLength": 1234,
  "scrapedAt": "2026-02-18T..."
}

Pricing

$0.01 USDC per scrape

Code Examples

curl -X POST https://pylon-web-scrape-api.fly.dev/scrape \
  -H "Content-Type: application/json" \
  -d '{"url": "https://example.com", "format": "markdown"}'