100 크레딧 무료, 카드 등록 없이
Universal Search Everywhere API
질의 하나를 Reddit, X, YouTube, TikTok, Instagram 등에서 동시에 돌려 순위와 군집을 매긴 결과 하나로 반환합니다. 상위 댓글과 게시물별 입장, 관련도도 함께 붙습니다.
GET /v1/search/everywhereUniversal Search Everywhere API는 언제 쓰나요
플랫폼마다 검색 엔드포인트를 직접 부르는 대신 한 주제의 반응을 한 번에 볼 때 사용하세요.
API 레퍼런스 영문 원문
One query, searched on every platform at once, returns one ranked list with clusters and top comments. It searches up to 23 sources across 18 platforms: Reddit (reddit), X posts (twitter), a written summary of X posts (twitter-ai-search), YouTube (youtube), TikTok (tiktok), Instagram (instagram), Hacker News (hackernews), Polymarket (polymarket), GitHub (github), Threads (threads), Pinterest (pinterest), a cited web answer (perplexity), web search results (web), LinkedIn (linkedin), Rumble (rumble), Naver (naver), Facebook (facebook), Bluesky (bluesky), news articles (news) and Quora (quora), plus TikTok hashtags (tiktok-hashtag), Instagram hashtags (instagram-hashtag) and YouTube hashtags (youtube-hashtag) in hashtag mode. naver (Naver blog, cafe and KnowledgeiN) joins when the query contains Hangul, and on any query when you name it in sources; Naver rows carry the corpus in metadata.corpus. facebook runs only when you ask for it: include=facebook adds it to the default sources, and sources=facebook runs only the sources you name; it returns about 5 public posts, newest first inside your date window. The hashtag lanes run only in hashtag mode: an explicit #tag or a single word. A source you name in sources is always searched. What ranks and what filters: lookback_days is a ranking signal that sets the freshness curve, so an older row can still rank when nothing recent matches; since, until, from_date and to_date are hard bounds that drop rows outside the window (rows with no date are kept and counted in data.since); relevance=filter drops the rows judged off topic; limit (1 to 100, default 40) trims the answer. For an agent, send format=compact, limit=20 and deadline_s=25 (20 rows in about 10 to 20 KB, where the default classic answer is hundreds of KB), price it first with dry_run=1, and read more rows free at GET /v1/search/everywhere/runs/{run_id}?cursor=...&format=compact (data.next.results_url streams them all). since_watermark returns only rows you have not seen. Every result carries computed.relevance and computed.stance, and data.judgments says whether each judgment ran. Top comments ride the results on the six lanes that have them (Reddit, Hacker News, YouTube, TikTok, Instagram and GitHub) at items[i].source_items[0].metadata.top_comments[]: up to 15 on each of the top 10 results and 5 after, each { score, excerpt, truncated, author, url, date }. X posts (twitter, also x) are ranked rows. The X summary (twitter-ai-search, which takes 15 to 45 seconds) runs only with include=synthesis and arrives in data.synthesis.x beside the cited web answer (data.synthesis.web), never as ranked rows. On the JSON path the X summary is included only when it is ready with the rest of the answer, and otherwise sources_failed says so; the stream waits for it. Every source is a call to its own public endpoint, with that endpoint's fallbacks, inside the flat price: a source whose endpoint keeps failing is skipped (sources_failed says skipped: breaker_open), and data.platforms reports each platform's status, rows, latency and outcome code. Each source has 12 seconds (25 seconds when you search one platform, 20 seconds for facebook, 12 seconds for twitter beside other sources), and a full search usually takes 20 to 30 seconds: allow a 120-second client timeout. Answers are cached for 120 seconds, and a cache hit is free. Each row's date_confidence and date_source say how far to trust published_at. Streams over SSE with Accept: text/event-stream (the terminal done chunk carries the page blocks of the JSON answer except platforms and synthesis; on the stream the web answer and the X summary arrive as items chunks), or answers JSON with Accept: application/json. 20 credits per search, and each entry of keywords is its own search: an answer with no row anywhere costs 0 credits, and when fewer than half the planned sources answer, half is refunded. A parameter this endpoint does not know is ignored with a data._warnings line. A field of a release that is not built yet is a free 400 with details.reason not_released. Every search made with an API key is stored as a run for 7 days and read free at data.next.
75개 플랫폼을 병렬로 검색합니다
·
TikTok·
Instagram·
YouTube·
Facebook·
X·
LinkedIn·
Reddit·
Threads·
Pinterest·
Twitch·
Truth Social·
Snapchat·
Kick·
Bluesky·
Kwai·
Rumble·
Spotify·
Apple Music·TikTok Shop·
Amazon Shop·
Google Shopping·
Trustpilot·
TripAdvisor·
Yelp·
Linktree·
Komi·
Pillar·
lnk.bio·Facebook Ads·Google Ads·LinkedIn Ads·Google Search·Google News·
Finance·
Polymarket·
Tavily·
Hacker News·
GitHub·
Perplexity·
Naver·
Utility·Universal Search
TikTok·Instagram·YouTube·Facebook·X·LinkedIn·Reddit·Threads·Pinterest·Twitch·Truth Social·Snapchat·Kick·Bluesky·Kwai·Rumble·Spotify·Apple Music·TikTok Shop·Amazon Shop·Google Shopping·Trustpilot·TripAdvisor·Yelp·Linktree·Komi·Pillar·lnk.bio·Facebook Ads·Google Ads·LinkedIn Ads·Google Search·Google News·Finance·Polymarket·Tavily·Hacker News·GitHub·Perplexity·Naver·Utility·Universal Search·TikTok·Instagram·YouTube·Facebook·X·LinkedIn·Reddit·Threads·Pinterest·Twitch·Truth Social·Snapchat·Kick·Bluesky·Kwai·Rumble·Spotify·Apple Music·TikTok Shop·Amazon Shop·Google Shopping·Trustpilot·TripAdvisor·Yelp·Linktree·Komi·Pillar·lnk.bio·Facebook Ads·Google Ads·LinkedIn Ads·Google Search·Google News·Finance·Polymarket·Tavily·Hacker News·GitHub·Perplexity·Naver·Utility·Universal Search
TikTok·Instagram·YouTube·Facebook·X·LinkedIn·Reddit·Threads·Pinterest·Twitch·Truth Social·Snapchat·Kick·Bluesky·Kwai·Rumble·Spotify·Apple Music·TikTok Shop·Amazon Shop·Google Shopping·Trustpilot·TripAdvisor·Yelp·Linktree·Komi·Pillar·lnk.bio·Facebook Ads·Google Ads·LinkedIn Ads·Google Search·Google News·Finance·Polymarket·Tavily·Hacker News·GitHub·Perplexity·Naver·Utility·Universal Search·TikTok·Instagram·YouTube·Facebook·X·LinkedIn·Reddit·Threads·Pinterest·Twitch·Truth Social·Snapchat·Kick·Bluesky·Kwai·Rumble·Spotify·Apple Music·TikTok Shop·Amazon Shop·Google Shopping·Trustpilot·TripAdvisor·Yelp·Linktree·Komi·Pillar·lnk.bio·Facebook Ads·Google Ads·LinkedIn Ads·Google Search·Google News·Finance·Polymarket·Tavily·Hacker News·GitHub·Perplexity·Naver·Utility·Universal Search
TikTok·Instagram·YouTube·Facebook·X·LinkedIn·Reddit·Threads·Pinterest·Twitch·Truth Social·Snapchat·Kick·Bluesky·Kwai·Rumble·Spotify·Apple Music·TikTok Shop·Amazon Shop·Google Shopping·Trustpilot·TripAdvisor·Yelp·Linktree·Komi·Pillar·lnk.bio·Facebook Ads·Google Ads·LinkedIn Ads·Google Search·Google News·Finance·Polymarket·Tavily·Hacker News·GitHub·Perplexity·Naver·Utility·Universal Search·TikTok·Instagram·YouTube·Facebook·X·LinkedIn·Reddit·Threads·Pinterest·Twitch·Truth Social·Snapchat·Kick·Bluesky·Kwai·Rumble·Spotify·Apple Music·TikTok Shop·Amazon Shop·Google Shopping·Trustpilot·TripAdvisor·Yelp·Linktree·Komi·Pillar·lnk.bio·Facebook Ads·Google Ads·LinkedIn Ads·Google Search·Google News·Finance·Polymarket·Tavily·Hacker News·GitHub·Perplexity·Naver·Utility·Universal Search
TikTok·Instagram·YouTube·Facebook·X·LinkedIn·Reddit·Threads·Pinterest·Twitch·Truth Social·Snapchat·Kick·Bluesky·Kwai·Rumble·Spotify·Apple Music·TikTok Shop·Amazon Shop·Google Shopping·Trustpilot·TripAdvisor·Yelp·Linktree·Komi·Pillar·lnk.bio·Facebook Ads·Google Ads·LinkedIn Ads·Google Search·Google News·Finance·Polymarket·Tavily·Hacker News·GitHub·Perplexity·Naver·Utility·Universal SearchUniversal Search API
Everywhere API로 무엇을 할 수 있을까요
Everywhere 엔드포인트가 통합 스키마와 계산 필드를 담은 Universal Search 데이터를 한 번의 요청으로 보내드려요. 스크래핑 인프라를 직접 만들거나 유지할 필요가 없어요.
요청 예시
# GET /v1/search/everywhere: 20 credits per call. Cache hits are free and failed calls are refunded.
# Check the price first for 0 credits: add dry_run=1 to the query. Nothing is fetched or charged.
# --max-time 38: this endpoint's measured p99 latency x 1.5.
# --retry 3: retries timeouts, 429 and 5xx, honoring Retry-After.
# -o response.json keeps only the final attempt's body.
# One Idempotency-Key per request, reused on every retry, so a retried call is never charged twice.
IDEMPOTENCY_KEY=$(od -An -N16 -tx1 /dev/urandom | tr -d ' \n')
curl -sS --max-time 38 --retry 3 -o response.json \
-H "x-api-key: YOUR_API_KEY" \
-H "Idempotency-Key: $IDEMPOTENCY_KEY" \
"https://www.socialcrawl.dev/v1/search/everywhere?query=kanye+west&lookback_days=30&sources=reddit%2Cyoutube%2Cgithub&include_transcripts=false" && cat response.json# GET /v1/search/everywhere: 20 credits per call. Cache hits are free and failed calls are refunded.
# Check the price first for 0 credits: add dry_run=1 to the query. Nothing is fetched or charged.
import os
import random
import time
import uuid
import requests
API_KEY = os.environ.get("SOCIALCRAWL_API_KEY", "YOUR_API_KEY")
TIMEOUT_S = 38 # this endpoint's measured p99 latency x 1.5.
MAX_RETRIES = 3
URL = "https://www.socialcrawl.dev/v1/search/everywhere"
def backoff(attempt):
# Exponential backoff with jitter: about 1 s, 2 s, then 4 s.
return 2 ** attempt * (0.5 + random.random() / 2)
def socialcrawl(params):
# One Idempotency-Key per request, reused on every retry, so a retried call is never charged twice.
idempotency_key = str(uuid.uuid4())
for attempt in range(MAX_RETRIES + 1):
try:
res = requests.get(
URL,
params=params,
headers={"x-api-key": API_KEY, "Idempotency-Key": idempotency_key},
timeout=TIMEOUT_S,
)
body = res.json()
except (requests.RequestException, ValueError):
# A timeout, a dropped connection or a non-JSON gateway page: retry with the same key.
if attempt == MAX_RETRIES:
raise
time.sleep(backoff(attempt))
continue
if body["success"]:
return body
error = body["error"]
# Branch on error["type"], never on the message text.
if error["type"] == "RESOURCE_NOT_FOUND":
return None # refunded: nothing to read
retry_after = res.headers.get("Retry-After")
# SERVICE_UNAVAILABLE without Retry-After is a withdrawn endpoint: permanent.
permanent = error["type"] == "SERVICE_UNAVAILABLE" and retry_after is None
if not error.get("retryable") or permanent or attempt == MAX_RETRIES:
raise RuntimeError(f"{error['type']}: {error['message']} (request_id {body['request_id']})")
# Retry-After (seconds) wins; otherwise back off.
time.sleep(float(retry_after) if retry_after else backoff(attempt))
params = {
"query": "kanye west",
"lookback_days": "30",
"sources": "reddit,youtube,github",
"include_transcripts": "false",
}
body = socialcrawl(params)
if body is not None:
print(body["data"])// GET /v1/search/everywhere: 20 credits per call. Cache hits are free and failed calls are refunded.
// Check the price first for 0 credits: add dry_run=1 to the query. Nothing is fetched or charged.
const API_KEY = process.env.SOCIALCRAWL_API_KEY ?? "YOUR_API_KEY";
const TIMEOUT_MS = 38_000; // this endpoint's measured p99 latency x 1.5.
const MAX_RETRIES = 3;
type Page = { next_cursor: string | null; has_more: boolean };
type SocialCrawlResponse =
| { success: true; data: any; pagination?: Page; credits_used: number; request_id: string }
| { success: false; error: { type: string; message: string; retryable: boolean }; request_id: string };
const sleep = (ms: number) => new Promise((resolve) => setTimeout(resolve, ms));
// Exponential backoff with jitter: about 1 s, 2 s, then 4 s.
const backoffMs = (attempt: number) => 2 ** attempt * 1000 * (0.5 + Math.random() / 2);
async function socialcrawl(url: URL) {
// One Idempotency-Key per request, reused on every retry, so a retried call is never charged twice.
const idempotencyKey = crypto.randomUUID();
for (let attempt = 0; ; attempt++) {
let res: Response;
let body: SocialCrawlResponse;
try {
res = await fetch(url, {
headers: {
"x-api-key": API_KEY,
"Idempotency-Key": idempotencyKey,
},
signal: AbortSignal.timeout(TIMEOUT_MS),
});
body = (await res.json()) as SocialCrawlResponse;
} catch (error) {
// A timeout, a dropped connection or a non-JSON gateway page: retry with the same key.
if (attempt >= MAX_RETRIES) throw error;
await sleep(backoffMs(attempt));
continue;
}
if (body.success) return body;
// Branch on error.type, never on the message text.
if (body.error.type === "RESOURCE_NOT_FOUND") return null; // refunded: nothing to read
const retryAfter = res.headers.get("Retry-After");
// SERVICE_UNAVAILABLE without Retry-After is a withdrawn endpoint: permanent.
const permanent = body.error.type === "SERVICE_UNAVAILABLE" && retryAfter === null;
if (!body.error.retryable || permanent || attempt >= MAX_RETRIES) {
throw new Error(`${body.error.type}: ${body.error.message} (request_id ${body.request_id})`);
}
// Retry-After (seconds) wins; otherwise back off.
await sleep(retryAfter ? Number(retryAfter) * 1000 : backoffMs(attempt));
}
}
const url = new URL("https://www.socialcrawl.dev/v1/search/everywhere");
url.searchParams.set("query", "kanye west");
url.searchParams.set("lookback_days", "30");
url.searchParams.set("sources", "reddit,youtube,github");
url.searchParams.set("include_transcripts", "false");
const body = await socialcrawl(url);
if (body) console.log(body.data);파라미터
| 파라미터 | 필수 | 설명 |
|---|---|---|
| lookback_days | 아니오 | Recency window in days (minimum 1, default 30). This is a ranking signal, not a hard filter: it sets the freshness curve, so a much older item can still rank when nothing recent matches, and it sets the date window sent to `facebook`. When `from_date` is sent too, `from_date` applies. On the stream, windows over 90 days add a `warning` chunk. For hard bounds use `since`, `until`, `from_date` and `to_date`. Check each row's `date_confidence` and `date_source` before filtering on its date: `low` means the date is an estimate (a rounded YouTube label, a KnowledgeiN estimate). |
| from_date | 아니오 | Lower date bound, YYYY-MM-DD (from the start of that UTC day) or an ISO 8601 timestamp; when `lookback_days` is sent too, `from_date` applies. A hard bound on `items`: rows dated before it are dropped, rows with no date are kept, and `data.since` reports `{ since, until, dropped, kept_undated }`. Sent with `since`, the later of the two applies and `data._warnings` says so. An invalid date is a free 400. |
| to_date | 아니오 | Upper date bound, YYYY-MM-DD (to the end of that UTC day, inclusive) or an ISO 8601 timestamp; defaults to today when from_date is set alone. A hard bound on `items`: rows dated after it are dropped, rows with no date are kept. Sent with `until`, the earlier of the two applies and `data._warnings` says so. An invalid date is a free 400. |
| since | 아니오 | Only rows published at or after this time (ISO 8601 timestamp or date), for polling: pass the previous run's time. A hard filter on `items`, unlike lookback_days; rows with no date are kept and `data.since` reports `{ since, until, dropped, kept_undated }`. Billed as usual. |
| until | 아니오 | Only rows published at or before this time: YYYY-MM-DD (that whole UTC day is included) or an ISO 8601 timestamp. A hard filter on `items`, like since; rows with no date are kept and counted in `data.since`. Billed as usual. An invalid date is a free 400. |
| period | 아니오 | A window that holds, by name: `Nd` (1 to 3650 days, ending now), `yesterday`, `this_week`, `last_week`, `this_month`, `last_month`, `last_quarter`, `this_year` or `ytd`, with calendar periods read in `tz`. Each platform is sent its own date filter, and every row is checked against the window again, so rows outside it are dropped whatever the platform did; `data.request.window` echoes the resolved window and `data.platforms.<p>.window` counts the rows dropped. `since`, `until`, `from_date`, `to_date` and `lookback_days` win over `period` when sent with it, and `data._warnings` says so. Billed as usual. |
| tz | 아니오 | IANA time zone name (default UTC, for example Asia/Seoul) that `period` and bare `since`, `until`, `from_date` and `to_date` dates are read in. An unknown zone is a free 400. |
| undated | 아니오 | What a row with no date does inside a window: `keep` (default) keeps it and counts it in `data.request.window.undated_kept`, `drop` removes it and counts it in `undated_dropped`. Applies only when a window is set. (keep | drop) |
| limit | 아니오 | How many ranked results `items` returns, 1 to 100 (default 40). Above 100 is clamped to 100 with a `data._warnings` line. It trims the answer only: the search, its price and its cache entry are the same whatever the limit, so `limit=10` then `limit=20` on the same query is one billed search. |
| sources | 아니오 | Optional CSV allowlist of sources (mutually exclusive with exclude). Valid names: reddit, twitter, twitter-ai-search, youtube, tiktok, instagram, hackernews, polymarket, github, threads, pinterest, perplexity, web, linkedin, rumble, tiktok-hashtag, instagram-hashtag, youtube-hashtag, naver, facebook, bluesky, news, quora. `naver` (Naver blog, cafe and KnowledgeiN) is in the default set only when the query contains Hangul. `facebook` (public post search) runs only when you name it here. `x` is another name for `twitter` (X posts) and `tavily` for `web`; `twitter-ai-search` here means `twitter` plus include=synthesis. Platform shorthands expand to their full group: youtube, instagram, tiktok also include their -hashtag lane. Unknown names return a 400. |
| platforms | 아니오 | Another name for sources, with the same values. When both are sent and differ, sources applies and `data._warnings` says so. |
| exclude | 아니오 | Optional CSV blocklist of sources (mutually exclusive with sources). Same valid names and platform shorthands as sources: excluding youtube/instagram/tiktok also excludes the platform's -hashtag lane. Unknown names return a 400. |
| include_transcripts | 아니오 | Fetch spoken-word transcripts for the top 3 video results (default false), so a video whose title never mentions your query but whose narration does can still be found and quoted. Applies to the YouTube, Rumble, TikTok and Instagram lanes; YouTube and Rumble transcripts carry timestamped segments, TikTok and Instagram are plain text. Transcripts land on `data.items[i].source_items[0].metadata.transcript` and stream as `transcript_enriched` chunks. Included in the flat 20 credits. |
| relevance | 아니오 | Optional. filter drops the ranked results our relevance judgment already scored as off-topic for your query (unrelated, or clearly about a different thing that shares its words) and lists their ids in data.relevance.dropped_ids, with counts. A result that could not be judged is never dropped; when none could be judged the call is a refunded 503 with details.reason judge_unavailable, because a filter that cannot judge must not pass every row. items_by_source is not filtered. Omit it to keep every ranked result, ordered as before; each result still carries computed.relevance by default (see judgments). Included in the flat 20 credits. (score | filter | off) |
| include | 아니오 | Optional CSV of extra blocks and opt-in sources. synthesis adds the X summary (twitter-ai-search) and returns it in data.synthesis.x with its citations. facebook adds Facebook public post search to the default sources (it is not in the default fan-out, and `sources=` would replace the defaults instead). stance is now on by default and accepted for compatibility: data.items[i].computed.stance ({ label: positive, negative, neutral, no_opinion or null when unsure, probabilities, confidence }) says what each post, with any replies shown, says about your query, and data.stance_split counts it per platform and overall with the ids behind every count. Posts judged under the confidence floor count as uncertain, never as a stance. If the judgment is unavailable the search still returns, stance is null and data._warnings says stance_unavailable (or stance_skipped when judging was skipped). Included in the flat 20 credits. |
| judgments | 아니오 | Optional. on (default) or off. On, every result also carries data.items[i].computed.stance (see include) and data.items[i].computed.relevance ({ score 0 to 1, on_topic, entity }), with data.relevance counting the off-topic results and listing their ids. Nothing is dropped or reordered and the price does not change. off returns the response without these blocks. (on | off) |
| switch_from | 아니오 | Optional brand. data.switch_receipts lists results where the author says they personally left that brand, with the verbatim text, the reason, where they went, and the link. There is no percentage. Rows that are not a switch stay in items. Included in the flat 20 credits. |
| query | 아니오 | The phrase to search on every platform, 1 to 512 characters. Send `query` or `keywords`; with both, `query` applies and `data._warnings` says so. |
| keywords | 아니오 | 1 to 6 phrases; each keyword is a separate 20-credit search |
| context | 아니오 | 3 to 2,000 characters; the text rows are judged against |
| format | 아니오 | classic (the API's default), evidence, compact or text |
| deadline_s | 아니오 | 8 to 96 seconds; no default on the API, 25 in the tools |
| exclude_platforms | 아니오 | names or aliases from the source table |
| sort | 아니오 | relevance, recent or engagement; applied at render |
| max_per_platform | 아니오 | 1 to 100 rows per platform; applied at render |
| relevance_threshold | 아니오 | 0 to 1, with relevance=filter; with none sent, only rows judged off topic by their level are dropped |
| label | 아니오 | stance (default), none or sponsored |
| comments.per_post | 아니오 | 5 to 50 comments per post |
| comments.replies | 아니오 | true or false |
| authors.top | 아니오 | 1 to 100 distinct authors |
| since_watermark | 아니오 | data.next.watermark of an earlier answer to the same request |
| max_credits | 아니오 | at least 20 per search; on a GET the default is the dry run's max, on a POST it is required |
| languages | 아니오 | 1 to 4 ISO 639-1 language codes; each is a search of its own |
| country | 아니오 | 1 to 10 ISO 3166-1 alpha-2 country codes |
| unknown_language | 아니오 | keep (default) or drop, with languages |
| unknown_country | 아니오 | keep (default) or drop, with country |
| depth | 아니오 | standard (default) or quick |
응답 예시
Universal Search Everywhere API는 무엇을 돌려주나요
모든 응답은 하나의 통합 스키마를 따라요. 크레딧을 쓰기 전에 어떤 필드가 돌아오는지, 실제 응답 본문 그대로 확인해 보세요.
응답 예시 보기
{
"success": true,
"platform": "search",
"endpoint": "/v1/search/everywhere",
"data": {
"request_id": "meta-1790945284064-0bmfbq",
"query": "kanye west",
"plan": {
"intent": "factual",
"freshness_mode": "balanced_recent",
"cluster_mode": "story",
"subqueries": [
{
"label": "primary",
"search_query": "kanye west",
"ranking_query": "What recent evidence from the last 30 days is most relevant to kanye west?",
"sources": [
"reddit",
"youtube"
],
"weight": 1
}
],
"source_weights": {
"reddit": 0.25,
"youtube": 0.25,
"youtube-hashtag": 0.25,
"github": 0.25
},
"notes": [
"deterministic-plan",
"llm-plan"
]
},
"items": [
{
"candidate_id": "https://reddit.com/r/music/comments/1wv1ox9/kanye_wests_soldout_russia_concerts_canceled",
"item_id": "1wv1ox9",
"source": "reddit",
"title": "Kanye West's sold-out Russia concerts canceled",
"url": "https://www.reddit.com/r/Music/comments/1wv1ox9/kanye_wests_soldout_russia_concerts_canceled/",
"snippet": "",
"subquery_labels": [
"primary"
],
"native_ranks": {
"primary:reddit": 1
},
"local_relevance": 0.2222222222222222,
"freshness": 89,
"engagement": 77,
"source_quality": 0.6,
"rrf_score": 0.0008115565654926149,
"sources": [
"reddit"
],
"source_items": [
{
"item_id": "1wv1ox9",
"source": "reddit",
"title": "Sample comment text (redacted).",
"body": "Sample comment text (redacted).",
"url": "https://www.reddit.com/r/Music/comments/1wv1ox9/kanye_wests_soldout_russia_concerts_canceled/",
"author": "user_d83d82",
"published_at": "2026-10-01T14:59:27.000Z",
"date_confidence": "low",
"engagement": {
"score": 782,
"num_comments": 68
},
"relevance_hint": 0.5,
"why_relevant": "",
"snippet": "Sample comment text (redacted).",
"metadata": {
"top_comments": [
{
"score": 544,
"excerpt": "Sample comment text (redacted).",
"truncated": false,
"author": "user_8164a5",
"url": "https://example.com/redacted",
"date": "2026-10-01T15:42:25.433Z"
},
{
"score": 216,
"excerpt": "Sample comment text (redacted).",
"truncated": false,
"author": "user_f3bf8b",
"url": "https://example.com/redacted",
"date": "2026-10-01T15:52:14.228Z"
}
]
},
"media": {
"thumbnail_url": null,
"video_url": null,
"duration_s": null,
"image_urls": [],
"aspect_ratio": null,
"author_avatar_url": null,
"favicon_url": null
},
"local_relevance": 0.2222222222222222,
"freshness": 89,
"engagement_score": 77,
"source_quality": 0.6,
"local_rank_score": 0.4439444444444444
}
],
"final_score": 66.20088914137315,
"metadata": {
"provenance": [
{
"source": "reddit",
"subquery_label": "primary",
"native_rank": 1,
"item_id": "1wv1ox9"
}
]
},
"rerank_score": 81.83,
"explanation": "Directly discusses the query's entity or question",
"computed": {
"relevance": {
"score": 0.74,
"on_topic": true,
"entity": 0.97
},
"stance": {
"label": "negative",
"probabilities": {
"positive": 0,
"negative": 0.96,
"neutral": 0.03,
"no_opinion": 0.01
},
"confidence": 0.94
}
},
"cluster_id": "cluster-1"
},
{
"candidate_id": "https://youtube.com/watch?v=qxoewuahoiw",
"item_id": "qxOeWuAHOiw",
"source": "youtube",
"title": "Joe Rogan Experience #1554 - Kanye West",
"url": "https://www.youtube.com/watch?v=qxOeWuAHOiw",
"snippet": "",
"subquery_labels": [
"primary"
],
"native_ranks": {
"primary:youtube": 13
},
"local_relevance": 0.2222222222222222,
"freshness": 0,
"engagement": 43,
"source_quality": 0.85,
"rrf_score": 0.0006781500067815001,
"sources": [
"youtube"
],
"source_items": [
{
"item_id": "qxOeWuAHOiw",
"source": "youtube",
"title": "Sample comment text (redacted).",
"body": "Sample comment text (redacted).",
"url": "https://www.youtube.com/watch?v=qxOeWuAHOiw",
"author": "user_e3b0c4",
"published_at": "2021-10-02T12:48:09.738Z",
"date_confidence": "med",
"engagement": {
"views": 21128467
},
"relevance_hint": 0.5,
"why_relevant": "",
"snippet": "Sample comment text (redacted).",
"metadata": {
"top_comments": [
{
"score": 7,
"excerpt": "Sample comment text (redacted).",
"truncated": false,
"author": "user_446c78",
"url": null,
"date": "2026-07-18T06:28:44.000Z"
},
{
"score": 6,
"excerpt": "Sample comment text (redacted).",
"truncated": false,
"author": "user_bd900e",
"url": null,
"date": "2026-07-17T05:47:30.000Z"
}
]
},
"media": {
"thumbnail_url": "https://i.ytimg.com/vi/qxOeWuAHOiw/hqdefault.jpg?sqp=-oaymwEnCOADEI4CSFryq4qpAxkIARUAAIhCGAHYAQHiAQoIGBACGAY4AUAB&rs=AOn4CLBTYB39onRUPWxvKQWCPtVgaBR9LA",
"video_url": null,
"duration_s": null,
"image_urls": [],
"aspect_ratio": null,
"author_avatar_url": "https://example.com/avatars/user_7c6736.png",
"favicon_url": null
},
"local_relevance": 0.2222222222222222,
"freshness": 0,
"engagement_score": 43,
"source_quality": 0.85,
"local_rank_score": 0.18744444444444444
}
],
"final_score": 62.56753750169537,
"metadata": {
"provenance": [
{
"source": "youtube",
"subquery_label": "primary",
"native_rank": 13,
"item_id": "qxOeWuAHOiw"
}
]
},
"rerank_score": 88.58,
"explanation": "Directly discusses the query's entity or question",
"computed": {
"relevance": {
"score": 0.85,
"on_topic": true,
"entity": 0.97
},
"stance": {
"label": "positive",
"probabilities": {
"positive": 0.95,
"negative": 0.03,
"neutral": 0.02,
"no_opinion": 0
},
"confidence": 0.93
}
},
"cluster_id": "cluster-2"
}
],
"items_by_source": {
"youtube-hashtag": [
{
"item_id": "jSrQBGbw4jo",
"source": "youtube-hashtag",
"title": "Sample comment text (redacted).",
"body": "Sample comment text (redacted).",
"url": "https://www.youtube.com/watch?v=jSrQBGbw4jo",
"author": "user_1114db",
"published_at": "2026-05-02T12:48:09.564Z",
"date_confidence": "med",
"engagement": {
"views": 1816022
},
"relevance_hint": 0.5,
"why_relevant": "",
"snippet": "Sample comment text (redacted).",
"metadata": {},
"media": {
"thumbnail_url": "https://i.ytimg.com/vi/jSrQBGbw4jo/hq720.jpg?sqp=-oaymwFBCNAFEJQDSFryq4qpAzMIARUAAIhCGAHYAQHiAQoIGBACGAY4AUAB8AEB-AH-CYAC0AWKAgwIABABGGUgZShlMA8=&rs=AOn4CLDqUfH2OrVPMbTsimnFaqOqdtlCZA",
"video_url": null,
"duration_s": 310,
"image_urls": [],
"aspect_ratio": null,
"author_avatar_url": "https://example.com/avatars/user_8cfd54.png",
"favicon_url": null
},
"local_relevance": 0.19841269841269835,
"freshness": 0,
"engagement_score": 50,
"source_quality": 0.85,
"local_rank_score": 0.17896825396825394
}
],
"youtube": [
{
"item_id": "PsO6ZnUZI0g",
"source": "youtube",
"title": "Sample comment text (redacted).",
"body": "Sample comment text (redacted).",
"url": "https://www.youtube.com/watch?v=PsO6ZnUZI0g",
"author": "user_609f62",
"published_at": "2009-10-02T12:48:09.738Z",
"date_confidence": "med",
"engagement": {
"views": 558565305
},
"relevance_hint": 0.5,
"why_relevant": "",
"snippet": "Sample comment text (redacted).",
"metadata": {
"top_comments": [
{
"score": 50,
"excerpt": "Sample comment text (redacted).",
"truncated": false,
"author": "user_28677c",
"url": null,
"date": "2026-09-19T05:56:11.000Z"
},
{
"score": 11,
"excerpt": "Sample comment text (redacted).",
"truncated": false,
"author": "user_4eaf1d",
"url": null,
"date": "2026-09-24T20:35:45.000Z"
}
]
},
"media": {
"thumbnail_url": "https://i.ytimg.com/vi/PsO6ZnUZI0g/hq720.jpg?sqp=-oaymwEnCNAFEJQDSFryq4qpAxkIARUAAIhCGAHYAQHiAQoIGBACGAY4AUAB&rs=AOn4CLCk_duirSSQANf5RrOjzwWqGNVNRg",
"video_url": null,
"duration_s": 267,
"image_urls": [],
"aspect_ratio": null,
"author_avatar_url": "https://example.com/avatars/user_9b9273.png",
"favicon_url": null
},
"local_relevance": 0.2222222222222222,
"freshness": 0,
"engagement_score": 100,
"source_quality": 0.85,
"local_rank_score": 0.24444444444444444
},
{
"item_id": "6vwNcNOTVzY",
"source": "youtube",
"title": "Sample comment text (redacted).",
"body": "Sample comment text (redacted).",
"url": "https://www.youtube.com/watch?v=6vwNcNOTVzY",
"author": "user_609f62",
"published_at": "2009-10-02T12:48:09.738Z",
"date_confidence": "med",
"engagement": {
"views": 425271144
},
"relevance_hint": 0.5,
"why_relevant": "",
"snippet": "Sample comment text (redacted).",
"metadata": {
"top_comments": [
{
"score": 7,
"excerpt": "Sample comment text (redacted). Sample comment text (redacted). Sample comment text (redacted). Sample comment text (redacted).",
"truncated": false,
"author": "user_876555",
"url": null,
"date": "2026-09-10T12:39:36.000Z"
},
{
"score": 3,
"excerpt": "Sample comment text (redacted).",
"truncated": false,
"author": "user_7ed478",
"url": null,
"date": "2026-09-29T18:48:17.000Z"
}
]
},
"media": {
"thumbnail_url": "https://i.ytimg.com/vi/6vwNcNOTVzY/hq720.jpg?sqp=-oaymwEnCNAFEJQDSFryq4qpAxkIARUAAIhCGAHYAQHiAQoIGBACGAY4AUAB&rs=AOn4CLAJlkmdS4UoEq0Dq4w21KP9oBy3sg",
"video_url": null,
"duration_s": 222,
"image_urls": [],
"aspect_ratio": null,
"author_avatar_url": "https://example.com/avatars/user_9b9273.png",
"favicon_url": null
},
"local_relevance": 0.2222222222222222,
"freshness": 0,
"engagement_score": 95,
"source_quality": 0.85,
"local_rank_score": 0.23944444444444443
}
],
"reddit": [
{
"item_id": "1wv1ox9",
"source": "reddit",
"title": "Sample comment text (redacted).",
"body": "Sample comment text (redacted).",
"url": "https://www.reddit.com/r/Music/comments/1wv1ox9/kanye_wests_soldout_russia_concerts_canceled/",
"author": "user_d83d82",
"published_at": "2026-10-01T14:59:27.000Z",
"date_confidence": "low",
"engagement": {
"score": 782,
"num_comments": 68
},
"relevance_hint": 0.5,
"why_relevant": "",
"snippet": "Sample comment text (redacted).",
"metadata": {
"top_comments": [
{
"score": 544,
"excerpt": "Sample comment text (redacted).",
"truncated": false,
"author": "user_8164a5",
"url": "https://example.com/redacted",
"date": "2026-10-01T15:42:25.433Z"
},
{
"score": 216,
"excerpt": "Sample comment text (redacted).",
"truncated": false,
"author": "user_f3bf8b",
"url": "https://example.com/redacted",
"date": "2026-10-01T15:52:14.228Z"
}
]
},
"media": {
"thumbnail_url": null,
"video_url": null,
"duration_s": null,
"image_urls": [],
"aspect_ratio": null,
"author_avatar_url": null,
"favicon_url": null
},
"local_relevance": 0.2222222222222222,
"freshness": 89,
"engagement_score": 77,
"source_quality": 0.6,
"local_rank_score": 0.4439444444444444
},
{
"item_id": "1wqtof6",
"source": "reddit",
"title": "Sample comment text (redacted).",
"body": "Sample comment text (redacted).",
"url": "https://www.reddit.com/r/hiphopheads/comments/1wqtof6/kanye_west_joins_chris_brown_and_usher_for/",
"author": "user_f971f7",
"published_at": "2026-09-26T15:41:54.000Z",
"date_confidence": "low",
"engagement": {
"score": 1102,
"num_comments": 250
},
"relevance_hint": 0.5,
"why_relevant": "",
"snippet": "Sample comment text (redacted).",
"metadata": {
"top_comments": [
{
"score": 1341,
"excerpt": "Sample comment text (redacted).",
"truncated": false,
"author": "user_75c03e",
"url": "https://example.com/redacted",
"date": "2026-09-26T15:52:58.895Z"
},
{
"score": 1174,
"excerpt": "Sample comment text (redacted).",
"truncated": false,
"author": "user_b81fcb",
"url": "https://example.com/redacted",
"date": "2026-09-26T15:46:45.381Z"
}
]
},
"media": {
"thumbnail_url": null,
"video_url": null,
"duration_s": null,
"image_urls": [],
"aspect_ratio": null,
"author_avatar_url": null,
"favicon_url": null
},
"local_relevance": 0.21555555555555553,
"freshness": 82,
"engagement_score": 93,
"source_quality": 0.6,
"local_rank_score": 0.4381111111111111
}
]
},
"clusters": [
{
"cluster_id": "cluster-1",
"title": "Kanye West's sold-out Russia concerts canceled",
"candidate_ids": [
"https://reddit.com/r/music/comments/1wv1ox9/kanye_wests_soldout_russia_concerts_canceled"
],
"representative_ids": [
"https://reddit.com/r/music/comments/1wv1ox9/kanye_wests_soldout_russia_concerts_canceled"
],
"sources": [
"reddit"
],
"score": 66.20088914137315,
"uncertainty": null
},
{
"cluster_id": "cluster-2",
"title": "Joe Rogan Experience #1554 - Kanye West",
"candidate_ids": [
"https://youtube.com/watch?v=qxoewuahoiw"
],
"representative_ids": [
"https://youtube.com/watch?v=qxoewuahoiw"
],
"sources": [
"youtube"
],
"score": 62.56753750169537,
"uncertainty": null
}
],
"sources_called": [
"youtube-hashtag",
"youtube"
],
"sources_failed": {},
"sources_succeeded": [
"youtube-hashtag",
"youtube"
],
"sources_pruned": {
"github": 0.04
},
"coverage": 1,
"topic_coverage": {
"verdict": "ok",
"best_p": 0.86
},
"partial_failure": false,
"relevance": {
"mode": "score",
"rows": 17,
"judged": 17,
"unjudged": 0,
"off_topic": 0,
"off_topic_ids": [],
"methodology_version": "search-everywhere-relevance/1"
},
"stance_split": {
"methodology_version": "search-everywhere-stance/1",
"confidence_floor": 0.5,
"overall": {
"posts": 17,
"counted": 7,
"positive": 3,
"negative": 4,
"neutral": 0,
"shares": {
"positive": 0.429,
"negative": 0.571,
"neutral": 0
},
"no_opinion": 5,
"uncertain": 5,
"unjudged": 0,
"ids": {
"positive": [
"https://youtube.com/watch?v=qxoewuahoiw",
"https://youtube.com/watch?v=zohhamvk-xm"
],
"negative": [
"https://reddit.com/r/music/comments/1wv1ox9/kanye_wests_soldout_russia_concerts_canceled",
"https://reddit.com/r/nostupidquestions/comments/1tt2tfu/how_did_kanye_west_become_uncancellable"
],
"neutral": [],
"no_opinion": [
"https://youtube.com/watch?v=l63jt6__agw",
"https://youtube.com/watch?v=dr_ytq0syva"
],
"uncertain": [
"https://reddit.com/r/hiphopheads/comments/1wqtof6/kanye_west_joins_chris_brown_and_usher_for",
"https://reddit.com/r/kanye/comments/1wufnn0/50_cent_baby_mama_daphne_joy_confirms_the_rumor"
],
"unjudged": []
}
},
"by_platform": {
"reddit": {
"posts": 7,
"counted": 3,
"positive": 0,
"negative": 3,
"neutral": 0,
"shares": {
"positive": 0,
"negative": 1,
"neutral": 0
},
"no_opinion": 0,
"uncertain": 4,
"unjudged": 0,
"ids": {
"positive": [],
"negative": [
"https://reddit.com/r/music/comments/1wv1ox9/kanye_wests_soldout_russia_concerts_canceled",
"https://reddit.com/r/nostupidquestions/comments/1tt2tfu/how_did_kanye_west_become_uncancellable"
],
"neutral": [],
"no_opinion": [],
"uncertain": [
"https://reddit.com/r/hiphopheads/comments/1wqtof6/kanye_west_joins_chris_brown_and_usher_for",
"https://reddit.com/r/kanye/comments/1wufnn0/50_cent_baby_mama_daphne_joy_confirms_the_rumor"
],
"unjudged": []
}
},
"youtube": {
"posts": 10,
"counted": 4,
"positive": 3,
"negative": 1,
"neutral": 0,
"shares": {
"positive": 0.75,
"negative": 0.25,
"neutral": 0
},
"no_opinion": 5,
"uncertain": 1,
"unjudged": 0,
"ids": {
"positive": [
"https://youtube.com/watch?v=qxoewuahoiw",
"https://youtube.com/watch?v=zohhamvk-xm"
],
"negative": [
"https://youtube.com/watch?v=6vwncnotvzy"
],
"neutral": [],
"no_opinion": [
"https://youtube.com/watch?v=l63jt6__agw",
"https://youtube.com/watch?v=dr_ytq0syva"
],
"uncertain": [
"https://youtube.com/watch?v=pso6znuzi0g"
],
"unjudged": []
}
}
}
},
"dropped": 0,
"run": {
"run_id": "run_example1234567890abcd",
"product": "search",
"status": "completed",
"stopped_because": null,
"credits": {
"spent": 20,
"by_stage": {
"search": 20,
"extras": 0
}
},
"version": 1
},
"next": {
"status_url": null,
"results_url": "https://www.socialcrawl.dev/v1/search/everywhere/runs/run_example1234567890abcd/results.jsonl",
"dry_run_url": "https://www.socialcrawl.dev/v1/search/everywhere?query=kanye+west&dry_run=1",
"watermark": null
}
},
"credits_used": 20,
"request_id": "req_example000000",
"cached": false,
"pagination": {
"next_cursor": null,
"has_more": false,
"page_size": 17
},
"credits_remaining": 9999,
"source": "captured",
"captured_at": "2026-10-02T12:48:16.419Z",
"redacted": true
}통합 응답 구조를 보여 주는 실제 샘플이에요. 필드 값은 조회한 대상에 따라 달라져요.
API 상세
Universal Search Everywhere API는 어떻게 동작하나요
API 키와 함께 GET 요청을 보내면, 통합 스키마와 계산 필드를 담은 깔끔한 JSON이 돌아와요.
메서드
GET
응답 형식
JSON
개발자 우선
소셜 미디어 데이터를 몇 초 만에 수집하는 방법
개발자를 위한 가장 빠른 소셜 미디어 스크래핑 API. 월간 활성 사용자 100억 명 이상을 포괄하는 75개 플랫폼에서 프로필, 게시물, 댓글, 분석 데이터를 수집하세요.
모든 플랫폼을 하나의 스키마로
동일한 응답 구조로 75개 플랫폼을 조회하세요. 연동은 한 번이면 충분합니다.
단순 수집을 넘어 계산된 필드 제공
엔드포인트가 해당 지표를 지원하고 계산에 필요한 원본 값이 있을 때, 정규화된 레코드에 engagement_rate, estimated_reach, content_category, language를 함께 담아 바로 활용할 수 있습니다.
코드 한 줄 쓰기 전에, 데이터부터
Visual Data Explorer에 URL만 붙여넣으면 결과 카드와 정형화된 테이블, CSV 내보내기를 바로 사용할 수 있습니다.
import requests
response = requests.get(
'https://www.socialcrawl.dev/v1/tiktok/profile',
params={'handle': 'charlidamelio'},
headers={'x-api-key': 'sc_YOUR_API_KEY'}
)
data = response.json()[ .JSON ]
{
"success": true,
"platform": "tiktok",
"data": {
"author": {
"username": "charlidamelio",
"followers": 152400000
},
"engagement": {
"likes": 12400000000,
"engagement_rate": 0.087
},
"metadata": {
"language": "en",
"content_category": "lifestyle"
}
}
}자주 묻는 질문
자주 묻는 질문
API, 요금제, 기능에 대한 질문과 답변입니다.
문의하기API 호출 한 번으로 모든 소셜 미디어를 검색하려면 어떻게 하나요?
API 키와 함께 GET /v1/search/everywhere?query=검색어 를 호출하면 돼요. 레딧, X, 유튜브, 틱톡, 인스타그램, 해커뉴스, 폴리마켓, 깃허브, 스레드, 핀터레스트, 퍼플렉시티, 태빌리에 병렬로 검색을 보내고 순위·클러스터로 정리된 JSON 하나로 돌려드려요.
어떤 파라미터를 받나요?
필수는 query(1~512자) 하나예요. 옵션으로 lookback_days(기본 30일), ISO 날짜 범위를 직접 주는 from_date·to_date, 플랫폼을 고르는 sources 허용 목록과 exclude 제외 목록이 있어요. lookback_days와 날짜 범위, sources와 exclude는 각각 동시에 쓸 수 없어요.
검색 결과에는 뭐가 들어 있나요?
순위가 매겨진 결과마다 게시물 정보, 플랫폼, 참여도·최신성 신호, 그리고 실제 인기 댓글이 최대 5개까지 점수순으로 붙어 와요. 레딧 추천 댓글, 유튜브·틱톡 인기 댓글, 깃허브 이슈 토론처럼 플랫폼에서 가져온 진짜 반응이에요.
특정 플랫폼만 골라서 검색할 수 있나요?
네, sources=reddit,youtube,github처럼 허용 목록을 주면 그 플랫폼에만 검색을 보내요. 반대로 exclude로 뺄 플랫폼을 지정할 수도 있어요. 어느 쪽이든 요금은 호출당 20 크레딧 정액 그대로예요.
호출 한 번에 크레딧이 얼마나 드나요?
몇 개 소스가 응답했는지, 댓글이 얼마나 붙었는지와 상관없이 정확히 20 크레딧이에요. 파이프라인이 결과를 하나도 만들지 못하면 동기·스트리밍 모두 크레딧이 자동으로 환불돼요.
스트리밍 응답도 지원하나요?
네, Accept: text/event-stream을 보내면 타입이 정의된 SSE 청크로 와요. 각 게시물의 댓글이 도착할 때마다 comments_enriched 청크가 먼저 오고 마지막에 done 이벤트로 끝나요. 기본값인 application/json은 동기 응답 하나로 받아요.
AI에게 SocialCrawl을 물어보세요
Universal Search Everywhere 데이터, 가져올 준비 되셨어요?
API 키 받고 60초 안에 Universal Search 데이터를 받아 가세요.