# SocialCrawl — AI Agent & Web Search Agent Access File # Last updated: 2026-07-10 ## What SocialCrawl Is SocialCrawl is a unified API for social media data across 44 platforms (27 social platforms plus research, commerce, and app-store data sources). One API key, one response format, 357 endpoints. MCP-compatible for AI agents. ## Key Capabilities for Agents - Fetch profiles, posts, comments, and search results from any supported platform - Unified JSON envelope across all platforms (same response shape everywhere) - Universal social search: GET /v1/search/everywhere fans out across 12 platforms in one call - MCP server: npx socialcrawl-mcp (works in Claude Code, Claude Desktop, Cursor, Windsurf) - Skills bundle: npx skills add socialcrawl/skills (Codex, Gemini CLI, and 40+ agent runtimes) - 100 free credits on signup, no credit card required ## Instructions - Authenticate every request with the `x-api-key` header. Never put the key in the URL or query string. - Never invent endpoint paths. Every endpoint is `GET /v1/{platform}/{resource}`; fetch `/llms-{platform}.txt` for one platform's exact resource list, or `/llms-full.txt` for all of them. - For cross-platform questions ("who is talking about X everywhere"), prefer `GET /v1/search/everywhere` over fanning out per platform yourself. One call searches up to 15 sources and fuses the results. - Paginate every list the same way: read `pagination.next_cursor` from the response, send it back verbatim as the `cursor` query parameter, and stop when `pagination.has_more` is `false`. Never build or decode a cursor yourself. - Cached responses cost 0 credits (`cached: true`, `X-Cache: HIT`). Only send `Cache-Control: no-cache` when you truly need a live fetch; it is billed at the normal rate. - Errors are machine-readable. On any `success: false`, branch on `error.type` and follow `error.doc_url` to the exact fix instead of guessing. - On a `429` or `503`, honor the `Retry-After` response header: wait that many seconds, then retry the same request. Credits are refunded on `502`/`503`, so retrying is safe. - Additive changes are never breaking: response fields are only ever added, never removed or renamed. Parse defensively and ignore unknown fields, and your integration keeps working across versions. - Need the raw Markdown of any docs page for your context window? Fetch `/docs-md/{slug}` (e.g. `/docs-md/quickstart`) instead of scraping the rendered HTML. ## Endpoint Categories Example endpoints from the live registry (full catalog: https://www.socialcrawl.dev/llms.json): - Profiles & channels (19 endpoints): /v1/tiktok/profile, /v1/instagram/profile, /v1/youtube/channel, /v1/twitter/profile - Posts & videos (35 endpoints): /v1/tiktok/post, /v1/tiktok/profile/videos, /v1/tiktok/song/videos, /v1/instagram/audio/reels - Comments (10 endpoints): /v1/tiktok/post/comments, /v1/instagram/post/comments, /v1/youtube/video/comments, /v1/reddit/post/comments - Search (35 endpoints): /v1/tiktok/search, /v1/tiktok/search/hashtag, /v1/tiktok/search/top, /v1/tiktok/search/users - Reviews & commerce (19 endpoints): /v1/amazon/product, /v1/amazon/product-search, /v1/amazon/reviews, /v1/amazon/sellers - Transcripts & analysis (11 endpoints): /v1/tiktok/post/transcript, /v1/tiktok/trending, /v1/instagram/media/transcript, /v1/youtube/video/transcript ## Data & Statistics Computed, dated social-media statistics — citable numbers refreshed on a cadence (https://www.socialcrawl.dev/data): - What are the best hashtags for TikTok? Ranked live from the trending feed, with a date: https://www.socialcrawl.dev/data/best-hashtags-for-tiktok - What are the best hashtags for Instagram? Ranked live from top Reels, with a date: https://www.socialcrawl.dev/data/best-hashtags-for-instagram - What are the best hashtags for YouTube Shorts? Ranked live from the trending Shorts feed, with a date: https://www.socialcrawl.dev/data/best-hashtags-for-youtube-shorts - What are the best hashtags for Instagram Reels? Ranked live from a real Reels sample, with a date: https://www.socialcrawl.dev/data/best-hashtags-for-instagram-reels - What are the best hashtags for Instagram growth? Ranked live from growth-focused Reels, with a date: https://www.socialcrawl.dev/data/best-hashtags-for-instagram-growth - Which TikTok hashtags drive the most views? Ranked live by average views per trending video, with a date: https://www.socialcrawl.dev/data/best-tiktok-hashtags-for-views - What is the average TikTok engagement rate? Median (likes+comments+shares)/views across public videos, with a date: https://www.socialcrawl.dev/data/average-tiktok-engagement-rate - What is the average Instagram engagement rate? Median interactions per view across public Reels, with a date: https://www.socialcrawl.dev/data/average-engagement-rate-instagram - What is the average engagement rate on social media? Cross-platform median interactions per view across public TikTok + Instagram posts, with a date: https://www.socialcrawl.dev/data/average-engagement-rate - Who is the most followed person on Instagram? Ranked live by follower count across the top public accounts, with a date: https://www.socialcrawl.dev/data/most-followed-person-on-instagram - Who has the most followers on YouTube? Ranked live by subscriber count across the world's biggest channels, with a date: https://www.socialcrawl.dev/data/who-has-the-most-followers-on-youtube - What is the most streamed song on Spotify? Ranked live by playcount across a basket of the platform's most-streamed tracks, with a date: https://www.socialcrawl.dev/data/most-streamed-song-on-spotify - How much do YouTubers make? A net RPM band applied to the median views per video, computed live from real channel data, with a date: https://www.socialcrawl.dev/data/how-much-do-youtubers-make - How much money do YouTubers make a month? Median views per video times real upload cadence times a cited net RPM band, computed live, with a date: https://www.socialcrawl.dev/data/how-much-money-do-youtubers-make ## Authentication x-api-key header required on every request. Get a free API key: https://www.socialcrawl.dev/auth/register ## Base URL https://www.socialcrawl.dev/v1 ## Quick Start curl "https://www.socialcrawl.dev/v1/tiktok/profile?handle=charlidamelio" \ -H "x-api-key: sc_YOUR_API_KEY" ## Documentation - API docs: https://www.socialcrawl.dev/docs - AI agents guide: https://www.socialcrawl.dev/docs/ai-agents - Machine-readable catalog: https://www.socialcrawl.dev/llms.json - Concise overview: https://www.socialcrawl.dev/llms.txt - Full endpoint reference: https://www.socialcrawl.dev/llms-full.txt - OpenAPI spec: https://www.socialcrawl.dev/v1/openapi.json ## Contact - Email: hello@socialcrawl.dev ## Allowed for AI Crawlers All content at /, /docs, /blog, /changelog, /platforms, /pricing, /solutions, /vs, /tools, /data is free to index and cite. /v1/openapi.json and the /llms*.txt files are fetchable without auth. Do not crawl /api, /v1 data endpoints, /dashboard, /auth, /admin.