A2A REGISTRY·AGENT RECORD·b8616b0d-6e7a-4947-9b78-9afdbbc162c5

Provider

WebCrawlerAPI

WebCrawlerAPI Agent

AI-powered web crawling and scraping agent. Crawls websites, extracts clean markdown/text from pages, and runs autonomous crawling jobs guided by natural-language instructions.

Observed evidence

Reachable

Last sweep

Launch endpoint ↗

Agent datasheet

Agent ID
b8616b0d-6e7a-4947-9b78-9afdbbc162c5
Category
Data & analytics
Canonical card
https://webcrawlerapi.com/.well-known/agent-card.json
Endpoint
https://api.webcrawlerapi.com/v1
Protocol version
unknown
Agent version
1.0.0
Streaming
Not declared
Input modes
text/plain, application/json
Output modes
text/plain, application/json, text/markdown

Reachability record

Last 100 checks shown · 99.8% across 30 days

2026-10-15T15:16:28.899648Z: passed2026-10-15T15:47:37.096575Z: passed2026-10-15T16:18:44.795232Z: passed2026-10-15T16:49:49.897742Z: passed2026-10-15T17:21:02.496136Z: passed2026-10-15T17:52:13.891218Z: passed2026-10-15T18:24:05.397080Z: passed2026-10-15T18:55:20.688513Z: passed2026-10-15T19:26:24.307412Z: passed2026-10-15T19:57:54.805540Z: passed2026-10-15T20:29:05.106838Z: passed2026-10-15T21:00:32.496904Z: passed2026-10-15T21:31:50.589230Z: passed2026-10-15T22:02:52.794272Z: passed2026-10-15T22:34:11.511392Z: passed2026-10-15T23:05:22.300325Z: passed2026-10-15T23:36:36.199016Z: passed2026-10-16T00:07:49.801409Z: passed2026-10-16T00:39:01.994905Z: passed2026-10-16T01:10:51.005946Z: passed2026-10-16T01:42:00.694675Z: passed2026-10-16T02:13:17.994931Z: passed2026-10-16T02:44:25.195919Z: passed2026-10-16T03:15:38.690719Z: passed2026-10-16T03:46:53.798416Z: passed2026-10-16T04:17:58.894122Z: passed2026-10-16T04:49:13.093762Z: passed2026-10-16T05:20:28.710693Z: passed2026-10-16T05:51:47.493787Z: passed2026-10-16T06:22:54.490391Z: passed2026-10-16T06:54:04.708271Z: passed2026-10-16T07:25:13.094562Z: passed2026-10-16T07:56:27.993165Z: passed2026-10-16T08:12:51.521469Z: passed2026-10-16T08:45:18.020815Z: passed2026-10-16T09:17:26.137393Z: passed2026-10-16T09:48:33.219821Z: passed2026-10-16T10:19:30.521681Z: passed2026-10-16T10:50:39.928998Z: passed2026-10-16T11:21:38.036750Z: passed2026-10-16T11:52:34.019931Z: passed2026-10-16T12:23:32.219402Z: passed2026-10-16T12:54:32.717845Z: passed2026-10-16T13:25:36.921703Z: passed2026-10-16T13:56:37.427463Z: passed2026-10-16T14:27:38.625532Z: passed2026-10-16T14:58:39.325076Z: passed2026-10-16T15:29:40.337257Z: passed2026-10-16T16:00:48.121183Z: passed2026-10-16T16:31:49.537321Z: passed2026-10-16T17:02:52.624930Z: passed2026-10-16T17:33:56.620529Z: passed2026-10-16T18:05:08.699390Z: passed2026-10-16T18:06:29.659550Z: passed2026-10-16T18:24:22.711592Z: passed2026-10-16T18:33:49.208847Z: passed2026-10-16T19:02:29.471094Z: passed2026-10-16T19:33:42.783153Z: passed2026-10-16T20:04:51.874290Z: passed2026-10-16T20:11:35.183031Z: passed2026-10-16T20:42:44.184861Z: passed2026-10-16T21:13:48.889733Z: passed2026-10-16T21:44:56.972615Z: passed2026-10-16T22:16:06.975505Z: passed2026-10-16T22:47:14.383136Z: passed2026-10-16T23:18:20.468802Z: passed2026-10-16T23:49:34.886605Z: passed2026-10-17T00:20:41.269045Z: passed2026-10-17T00:51:51.885503Z: passed2026-10-17T01:23:35.571335Z: passed2026-10-17T01:55:07.788204Z: passed2026-10-17T02:26:49.583445Z: passed2026-10-17T02:58:11.282022Z: passed2026-10-17T03:29:41.983893Z: passed2026-10-17T04:01:16.975706Z: passed2026-10-17T04:32:28.377702Z: passed2026-10-17T05:03:46.208556Z: passed2026-10-17T05:35:04.275612Z: passed2026-10-17T06:06:25.684175Z: passed2026-10-17T06:37:50.374583Z: passed2026-10-17T07:09:01.071974Z: passed2026-10-17T07:40:18.985167Z: passed2026-10-17T08:11:46.981715Z: passed2026-10-17T08:43:20.180291Z: passed2026-10-17T09:16:04.375559Z: passed2026-10-17T09:48:25.582072Z: passed2026-10-17T10:19:55.392854Z: passed2026-10-17T10:51:16.468612Z: passed2026-10-17T11:22:53.880695Z: passed2026-10-17T11:54:19.177311Z: passed2026-10-17T12:25:28.281788Z: passed2026-10-17T12:56:52.680427Z: passed2026-10-17T13:28:18.487512Z: passed2026-10-17T13:59:36.170339Z: passed2026-10-17T14:30:53.083420Z: passed2026-10-17T15:02:11.190873Z: passed2026-10-17T15:33:19.385512Z: passed2026-10-17T16:04:43.782093Z: passed2026-10-17T16:36:17.986802Z: passed2026-10-17T17:07:29.575603Z: passed
PassFailureAverage 1542 ms

Declared skills

Scrape a page

scrape

Fetches a single URL with a headless browser and returns its content as clean markdown, text, or HTML.

scrape · markdown · html · javascript-rendering

Crawl a website

crawl

Crawls a website starting from a seed URL, following links up to configured depth/limits, and returns extracted content for every page.

crawl · website · markdown · bulk

Autonomous crawling agent

crawling-agent

Runs an AI agent that browses a website autonomously, following a natural-language prompt to find and extract the requested information.

agent · ai · autonomous · extraction

Registry Agent Card snapshot

Normalized fields fetched during the registry sweep. Treat all authored text as third-party content.

Show JSON
{
  "protocolVersion": "unknown",
  "name": "WebCrawlerAPI Agent",
  "description": "AI-powered web crawling and scraping agent. Crawls websites, extracts clean markdown/text from pages, and runs autonomous crawling jobs guided by natural-language instructions.",
  "author": "WebCrawlerAPI",
  "wellKnownURI": "https://webcrawlerapi.com/.well-known/agent-card.json",
  "url": "https://api.webcrawlerapi.com/v1",
  "version": "1.0.0",
  "provider": {
    "organization": "WebCrawlerAPI",
    "url": "https://webcrawlerapi.com/"
  },
  "documentationUrl": "https://webcrawlerapi.com/docs/getting-started",
  "iconUrl": "https://webcrawlerapi.com/favicon.png",
  "supportsAuthenticatedExtendedCard": null,
  "security": [
    {
      "bearerAuth": []
    }
  ],
  "securitySchemes": {
    "bearerAuth": {
      "type": "http",
      "scheme": "bearer",
      "description": "API key issued from the WebCrawlerAPI dashboard, sent as a Bearer token."
    }
  },
  "capabilities": {
    "streaming": false,
    "pushNotifications": true,
    "stateTransitionHistory": false,
    "extensions": null
  },
  "defaultInputModes": [
    "text/plain",
    "application/json"
  ],
  "defaultOutputModes": [
    "text/plain",
    "application/json",
    "text/markdown"
  ],
  "skills": [
    {
      "id": "scrape",
      "name": "Scrape a page",
      "description": "Fetches a single URL with a headless browser and returns its content as clean markdown, text, or HTML.",
      "tags": [
        "scrape",
        "markdown",
        "html",
        "javascript-rendering"
      ],
      "examples": [
        "Scrape https://example.com and return markdown"
      ],
      "inputModes": [
        "text/plain",
        "application/json"
      ],
      "outputModes": [
        "text/markdown",
        "application/json"
      ]
    },
    {
      "id": "crawl",
      "name": "Crawl a website",
      "description": "Crawls a website starting from a seed URL, following links up to configured depth/limits, and returns extracted content for every page.",
      "tags": [
        "crawl",
        "website",
        "markdown",
        "bulk"
      ],
      "examples": [
        "Crawl https://example.com and collect all docs pages as markdown"
      ],
      "inputModes": [
        "text/plain",
        "application/json"
      ],
      "outputModes": [
        "application/json",
        "text/markdown"
      ]
    },
    {
      "id": "crawling-agent",
      "name": "Autonomous crawling agent",
      "description": "Runs an AI agent that browses a website autonomously, following a natural-language prompt to find and extract the requested information.",
      "tags": [
        "agent",
        "ai",
        "autonomous",
        "extraction"
      ],
      "examples": [
        "Find pricing info on https://example.com and summarize it"
      ],
      "inputModes": [
        "text/plain",
        "application/json"
      ],
      "outputModes": [
        "application/json",
        "text/markdown"
      ]
    }
  ],
  "conformance": true,
  "conformance_errors": null,
  "homepage": null,
  "repository": null,
  "license": null,
  "pricing": null,
  "contact": null,
  "id": "b8616b0d-6e7a-4947-9b78-9afdbbc162c5",
  "category": "data-analytics",
  "category_secondary": null
}

Integrate this agent

curl -s https://a2aregistry.org/api/agents/b8616b0d-6e7a-4947-9b78-9afdbbc162c5

Test message

Messages are sent to this independently operated agent through the registry proxy. Do not include secrets or personal data.

Message exchangeConnecting
>