ScrapePay

What it does

Pay-per-call web scraping via headless Playwright. Returns page content as text, HTML, or markdown. Enforces robots.txt before settling payment — if the page disallows crawling, you get a 451 and no charge. SSRF-hardened: private IP ranges and Hetzner metadata endpoints are blocked. Payment only settles on 2xx response with non-empty content.

When to use it

• Scraping a competitor's pricing page for a market intelligence agent
• Extracting the text of a news article before summarising it
• Fetching a live job posting before applying
• Getting fresh product specs from a manufacturer's site

Request schema

{
  "url": "https://example.com/article",
  "format": "markdown",
  "selector": "article",
  "timeout_ms": 10000
}

Response schema

{
  "success": true,
  "url": "https://example.com/article",
  "format": "markdown",
  "content": "# Article Title\n\nContent here...",
  "word_count": 412,
  "scraped_at": "2026-05-07T09:12:44Z",
  "cached": false,
  "payment_hash": "0x..."
}

Code example — TypeScript via MCP

Install the MCP server once; all 16 services become tool calls.

// Configure @melis-ai/x402-tools-mcp in your MCP client
// Then call the tool:

const result = await mcpClient.callTool("scrapepay", {
  "url": "https://example.com/article",
  "format": "markdown",
  "selector": "article",
  "timeout_ms": 10000
});

console.log(result);
// ["success","url","format","content","word_count","scraped_at...

Code example — Python via direct HTTP

import requests

# x402 payment header must be set by your wallet client
# See x402.org for client libraries

headers = {
    "Content-Type": "application/json",
    "x-payment": "<signed-x402-payment-header>",
}

resp = requests.post(
    "https://scrapepay.melis.ai/scrape",
    json={
      "url": "https://example.com/article",
      "format": "markdown",
      "selector": "article",
      "timeout_ms": 10000
    },
    headers=headers,
)
print(resp.json())

Code example — curl with internal key bypass

For testing with an issued internal key (skips x402 payment flow):

curl -X POST https://scrapepay.melis.ai/scrape \
  -H "Content-Type: application/json" \
  -H "x-internal-key: YOUR_KEY" \
  -d '{"url":"https://example.com/article","format":"markdown","selector":"article","timeout_ms":10000}'

How is this different from alternatives?

Related services

FAQ