Scrape

POST /scrape runs a synchronous scrape on a URL and returns content in the requested formats. Messora’s native anti-bot engine handles protections automatically.

Endpoint

POST /scrape

Authentication

X-API-Key header required. See Authentication.

Parameters

string

required

Public URL to scrape. Internal URLs (RFC1918, loopback, cloud metadata) are rejected by the SSRF guard.

string[]

default:"[\"markdown\"]"

Desired output formats. Accepted values: markdown, json, raw.

object

JSON schema for structured extraction. Required when formats includes json.

string

Context prompt to guide structured extraction (used with json_schema).

boolean

default:"false"

If true, render JavaScript before extraction (headless browser).

boolean

default:"false"

If true, extract only the main page content, removing navigation, footers, and sidebars.

integer

default:"60"

Maximum wait time in seconds (1–180).

integer

Extra wait in milliseconds after load (useful with render_js).

integer

default:"1"

Maximum pages to extract in a single call (1–50). Multiplies the cost: markdown/raw charge 1 credit per page, so max_pages: 50 costs up to 50 credits. Ignored when formats includes json (flat 10 credits).

string[]

Attribution tags for usage records (up to 10 tags).

The full parameter list — including fact_check, max_age_ms, max_depth, follow_subdomains, include_frames and parse_pdf — is generated from the schema on the POST /scrape reference page.

Cost

Format	Credits
`markdown` or `raw`	1 credit × `max_pages` (default: 1)
`json` (structured extraction)	10 credits per request

Failures (blocked_antibot, timeout, extraction_failed) do not consume credits.

Example

curl -X POST https://api.messora.dev/scrape \
  -H "Content-Type: application/json" \
  -H "X-API-Key: YOUR_API_KEY" \
  -d '{
    "url": "https://messora.dev",
    "formats": ["markdown"],
    "only_main_content": true
  }'

import requests

response = requests.post(
    "https://api.messora.dev/scrape",
    headers={
        "Content-Type": "application/json",
        "X-API-Key": "YOUR_API_KEY",
    },
    json={
        "url": "https://messora.dev",
        "formats": ["markdown"],
        "only_main_content": True,
    },
)

data = response.json()
print(data["markdown"])

const response = await fetch("https://api.messora.dev/scrape", {
  method: "POST",
  headers: {
    "Content-Type": "application/json",
    "X-API-Key": "YOUR_API_KEY",
  },
  body: JSON.stringify({
    url: "https://messora.dev",
    formats: ["markdown"],
    only_main_content: true,
  }),
});

const data = await response.json();
console.log(data.markdown);

Successful response

{
  "success": true,
  "scrape_status": "success",
  "markdown": "# Messora\n\nThis domain is for use in illustrative examples...",
  "credits_used": 1,
  "remaining_credits": 99
}

Structured extraction (JSON)

To extract structured data, include json in formats and provide a json_schema:

curl -X POST https://api.messora.dev/scrape \
  -H "Content-Type: application/json" \
  -H "X-API-Key: YOUR_API_KEY" \
  -d '{
    "url": "https://messora.dev/product",
    "formats": ["json"],
    "json_schema": {
      "type": "object",
      "properties": {
        "title": {"type": "string"},
        "price": {"type": "number"},
        "available": {"type": "boolean"}
      },
      "required": ["title", "price"]
    }
  }'

Structured extraction costs 10 credits per request. A failed run (blocked_antibot, timeout, extraction_failed) refunds all 10.

Response status

`scrape_status`	Meaning	Credits charged
`success`	Content extracted successfully	Yes
`blocked_antibot`	Target blocked the extraction	No
`timeout`	Time limit exceeded	No
`extraction_failed`	Content extraction failed	No

Errors

HTTP Status	Description
`401`	Missing `X-API-Key`
`403`	Invalid or revoked API key
`422`	Internal URL (SSRF), invalid parameters, or missing `json_schema` with `json` format
`429`	Rate limit exceeded (10 req/min)

Getting started

Integrations

Playground

Scrape

Scrape

Endpoint

Authentication

Parameters

Cost

Example

Successful response

Structured extraction (JSON)

Response status

Errors

​Scrape

​Endpoint

​Authentication

​Parameters

​Cost

​Example

​Successful response

​Structured extraction (JSON)

​Response status

​Errors

Scrape

Endpoint

Authentication

Parameters

Cost

Example

Successful response

Structured extraction (JSON)

Response status

Errors