Universal Search
One query, many sources — fanned out in parallel, ranked, deduped, and enriched with real comments
Universal Search
One query fans out across many sources in parallel, and you get back a single ranked, deduplicated result set enriched with what real people said.
Base URL: /v1/search/...
How do I get started with Universal Search?
1. Make the call
curl "https://www.socialcrawl.dev/v1/search/everywhere?query=best+noise+cancelling+headphones" \
-H "x-api-key: sc_your_api_key_here"2. Stream it if the query is broad
Send Accept: text/event-stream and each candidate arrives as it settles (including a comments_enriched chunk per result) instead of waiting for the whole fan-out. Send Accept: application/json for one envelope.
3. Read computed fields
When an endpoint supports a computed field and the required source inputs are present, the unified response includes that optional field. Depending on the endpoint, optional fields can include engagement_rate, language, content_category, and estimated_reach. See Computed fields for formulas, clamping rules, and null semantics.
What search endpoints can I access?
3 endpoints available.
| Endpoint | Path | Credit Tier |
|---|---|---|
| Universal social search across 14 platforms | /v1/search/everywhere | standard (20cr) |
| Fused forum search across Reddit, Hacker News, and Naver 지식iN/카페 — with top comments inline on hero threads by default. | /v1/search/forums | standard (10cr) |
| Planned multi-country news search: one query, localized and fanned out across Google News editions in a single call. | /v1/search/news | standard (2-14cr)metered |
/v1/search/everywhere fans out across 14 platforms in parallel (up to 17 sources, since TikTok, Instagram, and YouTube each add a hashtag-search sibling in hashtag mode), ranks the merged set with an LLM judge, clusters near-duplicates, and enriches each result with the top comments from its source (Reddit upvoted replies, Hacker News thread comments, YouTube / TikTok / Instagram top-liked, GitHub issue discussion). Real-people sentiment, not just titles. Flat 20 credits per call. See the full endpoint reference.
/v1/search/forums narrows the same idea to discussion sources (Reddit, Hacker News, Naver) when you want opinion threads rather than the whole web.
/v1/search/news plans one query into search angles, localizes them into the language of each requested country's Google News edition, and fans out the legs in parallel, returning one deduplicated article list with honest per-leg query_source provenance. Metered 2-14 credits. See the full endpoint reference.
What should I know about search data?
- All endpoints use
GETwith query parameters. - Authentication via the
x-api-keyheader. - Responses follow the unified SocialCrawl schema.
- Every result carries its source lineage, so you always know which platform a candidate came from.