SocialCrawl

Skills & MCP Server

Connect any MCP client or agent skill to the SocialCrawl API, hosted or local

SocialCrawl ships two packages that put the API inside an AI agent: an MCP server for any MCP-compatible client, and an Agent Skill for agents that read skill files. Both call the same API, return the same envelope, and bill the same credits, so pick whichever your client supports.

Hosted MCP endpoint: https://mcp.socialcrawl.dev/mcp. Your key travels as a request header, never as a query string.

Prerequisites

  • An API key from socialcrawl.dev, under Dashboard → API Keys. New accounts start with 100 free credits and no card.
  • Hosted server: an MCP client that can send an Authorization header.
  • Local server: Node.js with npx available on your machine.
  • Agent Skill: an agent that reads skill files (Claude Code, Cursor, Windsurf, Codex, Gemini CLI, and 40+ others).

Server URL

Copy this into any client that accepts a remote MCP endpoint:

https://mcp.socialcrawl.dev/mcp

It speaks the Streamable HTTP transport. Send your key as Authorization: Bearer sc_your_key_here, or as x-api-key. A request with no key still reaches the three discovery tools, which read bundled data and cost nothing.

How to connect

Create an API key

Sign in at socialcrawl.dev and open Dashboard → API Keys. Keys look like sc_... and are shown once, so store yours before you leave the page. See Authentication.

Register the server with your client

Every client below reaches the same seven tools. The hosted server needs nothing installed; the local server runs socialcrawl-mcp through npx on your machine.

Hosted, one line:

claude mcp add --transport http socialcrawl https://mcp.socialcrawl.dev/mcp \
  --header "Authorization: Bearer sc_your_key_here"

Local, if you would rather run the package yourself:

claude mcp add --scope user socialcrawl -e SOCIALCRAWL_API_KEY=sc_your_key_here -- npx -y socialcrawl-mcp

Flags go before the -- separator; everything after it is the command Claude Code runs.

Edit ~/Library/Application Support/Claude/claude_desktop_config.json on macOS, or %APPDATA%\Claude\claude_desktop_config.json on Windows.

Hosted:

{
  "mcpServers": {
    "socialcrawl": {
      "type": "http",
      "url": "https://mcp.socialcrawl.dev/mcp",
      "headers": {
        "Authorization": "Bearer sc_your_key_here"
      }
    }
  }
}

Local:

{
  "mcpServers": {
    "socialcrawl": {
      "command": "npx",
      "args": ["-y", "socialcrawl-mcp"],
      "env": {
        "SOCIALCRAWL_API_KEY": "sc_your_key_here"
      }
    }
  }
}

Edit .cursor/mcp.json in your project (or the global equivalent). Cursor uses the same mcpServers shape as Claude Desktop.

{
  "mcpServers": {
    "socialcrawl": {
      "type": "http",
      "url": "https://mcp.socialcrawl.dev/mcp",
      "headers": {
        "Authorization": "Bearer sc_your_key_here"
      }
    }
  }
}

For the local package, swap the three type/url/headers keys for "command": "npx", "args": ["-y", "socialcrawl-mcp"], and "env": { "SOCIALCRAWL_API_KEY": "sc_your_key_here" }.

Edit .vscode/mcp.json. VS Code uses the servers key and an explicit transport type.

{
  "servers": {
    "socialcrawl": {
      "type": "stdio",
      "command": "npx",
      "args": ["-y", "socialcrawl-mcp"],
      "env": {
        "SOCIALCRAWL_API_KEY": "sc_your_key_here"
      }
    }
  }
}

Windsurf reads the same mcpServers block as Claude Desktop:

{
  "mcpServers": {
    "socialcrawl": {
      "command": "npx",
      "args": ["-y", "socialcrawl-mcp"],
      "env": {
        "SOCIALCRAWL_API_KEY": "sc_your_key_here"
      }
    }
  }
}

Any client with stdio transport works with the same three values: command npx, args ["-y", "socialcrawl-mcp"], and SOCIALCRAWL_API_KEY in the environment.

Any client that supports a remote Streamable HTTP server needs the URL plus a header:

https://mcp.socialcrawl.dev/mcp
Authorization: Bearer sc_your_key_here

A client that cannot attach a custom header still connects, but only the three no-key discovery tools will work.

Restart and verify

Restart the client so it reads the new configuration, then ask the agent to list SocialCrawl platforms. That runs socialcrawl_list_platforms, which costs nothing and proves the connection before you spend a credit.

To check the hosted server itself:

curl https://mcp.socialcrawl.dev/healthz

Available tools

The MCP server exposes seven tools.

ToolDescriptionNeeds API key?
socialcrawl_list_platformsEvery bundled platform with its endpoint count and capabilitiesNo
socialcrawl_list_endpointsAll endpoints for a platform, with required parameters and credit costsNo
socialcrawl_get_docsBundled documentation by topic or platform slugNo
socialcrawl_requestAny SocialCrawl API call, GET or POST with a body for the batch endpointsYes
socialcrawl_check_balanceCredit balance and recent deductions via GET /v1/credits/balance (0 credits)Yes
socialcrawl_monitorsCreate and manage scheduled Monitors: create, list, get, runs, timeseries, pause, resume, deleteYes
socialcrawl_webWeb scraping, search, crawl, batch and agent jobs, change monitors, and browser sessionsYes

Three of the seven query local bundled data and need no key, so an agent can list platforms, inspect an endpoint's parameters, and read the pricing table for free. The four that hit the network (socialcrawl_request, socialcrawl_check_balance, socialcrawl_monitors, socialcrawl_web) need a key.

socialcrawl_request covers every platform except web, which has its own action-based tool because it mixes GET, POST, PATCH, and DELETE and runs asynchronous jobs.

Local validation before every call

Before it sends anything, socialcrawl_request checks locally that the platform exists, the endpoint exists, and all required parameters are present. A bad call comes back as a fix-it message instead of a wasted credit.

Agent Skill

The socialcrawl skill works with Claude Code, Cursor, Windsurf, Codex, Gemini CLI, and 40+ other agents. It lets your agent fetch current public data (subject to documented endpoint caches), generate code snippets, and answer API questions in natural language.

Install it from skills.sh:

npx skills add socialcrawl/skills

Add -g to install globally instead of per project. To install from Git, copy the socialcrawl subdirectory rather than the whole repository, because agents discover a skill at <skills-dir>/<name>/SKILL.md:

git clone --depth 1 https://github.com/socialcrawl/skills /tmp/socialcrawl-skills
mkdir -p .claude/skills
cp -r /tmp/socialcrawl-skills/skills/socialcrawl .claude/skills/socialcrawl

Then export your key so it persists across sessions (add the line to ~/.bashrc, ~/.zshrc, or your shell's equivalent):

export SOCIALCRAWL_API_KEY="YOUR_API_KEY"

The skill resolves your key from three sources in order: $SOCIALCRAWL_API_KEY, then ~/.config/socialcrawl/api_key, then a prompt. If it has to prompt, it saves the answer to ~/.config/socialcrawl/api_key so you paste it once. The literal placeholder YOUR_API_KEY is treated as unset.

Invoke it directly with /socialcrawl, or just ask in natural language: "Get the TikTok profile for @charlidamelio", or "Search YouTube for machine learning videos". The skill picks the platform and endpoint, makes the call, and returns structured JSON.

Skills or MCP?

Agent SkillMCP server
Install viaskills.sh, Gitnpm, MCP Registry, hosted URL
ProtocolSkill files read by the agentMCP stdio or Streamable HTTP
Client supportClaude Code, Cursor, Windsurf, Codex, Gemini CLI, 40+Any MCP-compatible client
Discovery toolsNo (the skill handles routing)Yes (3 local-only tools)
Local validationNoYes (saves credits)
Offline docsYes (reference files)Yes (bundled data)
MonitorsYes (reference file, calls the REST API)Yes (socialcrawl_monitors tool)
Web and browserYes (reference file, calls the REST API)Yes (dedicated socialcrawl_web tool)

What does it cost?

Credits are billed exactly as the REST API bills them: most endpoints are 1 credit, heavier ones 5 or 10, and composite or bundle endpoints carry their own price (search/everywhere is a flat 20). Cache hits cost 0. The three discovery tools are local, so they cost 0 too. See Endpoint pricing for the exact figure per endpoint and Credits for how the ledger works.

Troubleshooting

Next steps