Universal Search Scraper API
GET /v1/search/everywhere is one call that searches 12 social platforms at once — Reddit, X, YouTube, TikTok, Instagram, Hacker News, GitHub, and more. An LLM plans the fan-out, results are fused, reranked, and clustered, and you receive them as JSON or streamed over SSE. Flat 20 credits per call, on the same x-api-key as SocialCrawl's other 41 platforms.
TL;DR
The Universal Search API by SocialCrawl returns Universal Search data as structured JSON — 2 endpoints behind one x-api-key, from 10 credits per call. It shares one unified schema with 41 other platforms, so the same client code works everywhere.
Where to find SocialCrawl
Try the Universal Search API in your browser
Type a real handle, run a real request, see the JSON SocialCrawl returns. No signup, no key — same response shape you get in production.
Try the Universal Search Everywhere API
See real data before writing a single line
What data does the Universal Search API return?
Every endpoint returns structured JSON with a unified schema. Computed fields like engagement rate and content category come standard.
Last updated June 2026
How do you scrape social media data in seconds?
The fastest social media scraping API for developers. Scrape profiles, posts, comments, and analytics from 42 platforms covering 10B+ monthly active users.
One schema, every platform
Query 42 platforms with identical response structures. Write your integration once.
Computed fields, not just scraped
Every response includes engagement_rate, estimated_reach, content_category, and language — ready to use.
See your data before you code
Visual Data Explorer — paste any URL, get rich result cards, sortable tables, CSV export.
import requests
response = requests.get(
'https://www.socialcrawl.dev/v1/tiktok/profile',
params={'handle': 'charlidamelio'},
headers={'x-api-key': 'sc_YOUR_API_KEY'}
)
data = response.json(){
"success": true,
"platform": "tiktok",
"data": {
"author": {
"username": "charlidamelio",
"followers": 152400000
},
"engagement": {
"likes": 12400000000,
"engagement_rate": 0.087
},
"metadata": {
"language": "en",
"content_category": "lifestyle"
}
}
}How does SocialCrawl handle 42 different platforms?
Social media scraping is hard. Schema normalization, authentication, rate limits, pagination — we handle it all before your data arrives.
Write once, query them all.
42 platforms return 42 different JSON shapes. We normalize every response into one consistent structure.
Metrics ready before you ask.
Engagement rate, estimated reach, content category, language — calculated on every response automatically.
One cursor, every platform.
Every platform paginates differently. We give you one consistent cursor-based system.
Live data, never cached.
Every request hits the actual platform. No stale data, no cache lag.
Auth, proxies, and rate limits — handled.
Platform authentication, IP rotation, rate limit management — abstracted away. Just send a GET request.
How does SocialCrawl compare to Per-platform integrations (DIY) for Universal Search data?
Same Universal Search data, two very different paths. Auth, rate limits, schema, and cost — side by side.
| Feature | SocialCrawl | Per-platform integrations (DIY) |
|---|---|---|
| Platforms per call | 12 platforms (up to 15 sources in hashtag mode) with one GET | One integration per platform — a dozen separate clients to write and run |
| Authentication | Single x-api-key for the whole fan-out | Separate keys, quotas, and approval queues for each platform |
| Result fusion | Weighted reciprocal rank fusion plus LLM reranking and clustering built in | Merging, dedup, and ranking logic is yours to design |
| Streaming | JSON or typed SSE chunks as each platform settles | A streaming layer has to be built on top of every client yourself |
| Pricing | Flat 20 credits per call, auto-refunded when zero results land | A dozen separate bills and rate-limit ceilings to track |
| Maintenance | Every connector stays alive behind one stable contract | Each platform change breaks one of your dozen integrations |
Platforms per call
Authentication
Result fusion
Streaming
Pricing
Maintenance
How much does Universal Search scraping cost?
SocialCrawl uses credit-based pricing: you pay per API call, and most Universal Search endpoints cost just a few credits. Every account starts with 100 free credits — no subscriptions, no compute units, no credit card required.
See pricingIs Universal Search scraping legal?
SocialCrawl returns publicly available Universal Search data. Courts have generally upheld scraping public data — most notably in hiQ v. LinkedIn — but compliance depends on your use case and jurisdiction. You are responsible for following applicable laws and platform terms.
Have a question? We got answers
Find answers to frequently asked questions about SocialCrawl's API, pricing, and capabilities.
Contact usAsk AI about SocialCrawl
Ready to start scraping Universal Search data?
Get your API key and access all 2 Universal Search endpoints in under 60 seconds.
Start for free