Utility Find Endpoint API
설명한 작업을 할 가능성이 가장 높은 엔드포인트 세 개를 순서대로 반환합니다. 각각 질문에서 채운 파라미터, 아직 비어 있는 파라미터, 호출 한 번에 잡히는 크레딧, 신뢰도와 이유가 들어 있고, 대안도 함께 줍니다.
GET /v1/utility/findUtility Find Endpoint API는 언제 쓰나요
할 일은 알지만 어떤 엔드포인트인지 모를 때 첫 단계로 무료로 사용하세요. 아무것도 실행하지 않으며, 호출 전에 확인해야 할 때는 uncertain으로 알려 줍니다.
API 레퍼런스 영문 원문
Describe what you want in plain words, in any language ("last 200 comments on this TikTok <url>", "German Instagram creators about matcha") and get the three endpoints most likely to do it, best first: each with its method and path, the parameters your words already filled (only values you typed, never made up), the ones still missing, the credits that one call would hold (null with a note when it cannot be quoted yet), a confidence and a one-line reason, plus a few alternatives. Act on the top result only when uncertain is false. When no endpoint matches what the task means, or the matcher is unavailable, the results are keyword guesses and uncertain is always true. A request to act on an account (post, reply, like, follow, message, delete), about your own account or customers, or about billing returns no results (reason not_a_data_job) and the nearest reads as alternatives. A search value that names no topic (a placeholder such as "keyword", a country name, an English phrase for a Korean or Chinese platform, or most of the sentence) is left out and listed under missing, with a note saying why. A task that lists several topics or names several markets carries topics or markets (ISO codes) and is uncertain. Pass platform to keep the answer on one platform. Nothing is run. Free to call.
75개 플랫폼을 하나의 API로 제공합니다
Find Endpoint API로 무엇을 할 수 있을까요
Find Endpoint 엔드포인트가 통합 스키마와 계산 필드를 담은 Utility 데이터를 한 번의 요청으로 보내드려요. 스크래핑 인프라를 직접 만들거나 유지할 필요가 없어요.
요청 예시
# GET /v1/utility/find: Free: 0 credits per call.
# --max-time 10: this endpoint's measured p99 latency x 1.5.
# --retry 3: retries timeouts, 429 and 5xx, honoring Retry-After.
# -o response.json keeps only the final attempt's body.
# One Idempotency-Key per request, reused on every retry, so a retried call is never charged twice.
IDEMPOTENCY_KEY=$(od -An -N16 -tx1 /dev/urandom | tr -d ' \n')
curl -sS --max-time 10 --retry 3 -o response.json \
-H "x-api-key: YOUR_API_KEY" \
-H "Idempotency-Key: $IDEMPOTENCY_KEY" \
"https://www.socialcrawl.dev/v1/utility/find?task=last+200+comments+on+https%3A%2F%2Fwww.tiktok.com%2F%40stoolpresidente%2Fvideo%2F7623818255903329566" && cat response.json# GET /v1/utility/find: Free: 0 credits per call.
import os
import random
import time
import uuid
import requests
API_KEY = os.environ.get("SOCIALCRAWL_API_KEY", "YOUR_API_KEY")
TIMEOUT_S = 10 # this endpoint's measured p99 latency x 1.5.
MAX_RETRIES = 3
URL = "https://www.socialcrawl.dev/v1/utility/find"
def backoff(attempt):
# Exponential backoff with jitter: about 1 s, 2 s, then 4 s.
return 2 ** attempt * (0.5 + random.random() / 2)
def socialcrawl(params):
# One Idempotency-Key per request, reused on every retry, so a retried call is never charged twice.
idempotency_key = str(uuid.uuid4())
for attempt in range(MAX_RETRIES + 1):
try:
res = requests.get(
URL,
params=params,
headers={"x-api-key": API_KEY, "Idempotency-Key": idempotency_key},
timeout=TIMEOUT_S,
)
body = res.json()
except (requests.RequestException, ValueError):
# A timeout, a dropped connection or a non-JSON gateway page: retry with the same key.
if attempt == MAX_RETRIES:
raise
time.sleep(backoff(attempt))
continue
if body["success"]:
return body
error = body["error"]
# Branch on error["type"], never on the message text.
if error["type"] == "RESOURCE_NOT_FOUND":
return None # refunded: nothing to read
retry_after = res.headers.get("Retry-After")
# SERVICE_UNAVAILABLE without Retry-After is a withdrawn endpoint: permanent.
permanent = error["type"] == "SERVICE_UNAVAILABLE" and retry_after is None
if not error.get("retryable") or permanent or attempt == MAX_RETRIES:
raise RuntimeError(f"{error['type']}: {error['message']} (request_id {body['request_id']})")
# Retry-After (seconds) wins; otherwise back off.
time.sleep(float(retry_after) if retry_after else backoff(attempt))
params = {
"task": "last 200 comments on https://www.tiktok.com/@stoolpresidente/video/7623818255903329566",
}
body = socialcrawl(params)
if body is not None:
print(body["data"])// GET /v1/utility/find: Free: 0 credits per call.
const API_KEY = process.env.SOCIALCRAWL_API_KEY ?? "YOUR_API_KEY";
const TIMEOUT_MS = 10_000; // this endpoint's measured p99 latency x 1.5.
const MAX_RETRIES = 3;
type Page = { next_cursor: string | null; has_more: boolean };
type SocialCrawlResponse =
| { success: true; data: any; pagination?: Page; credits_used: number; request_id: string }
| { success: false; error: { type: string; message: string; retryable: boolean }; request_id: string };
const sleep = (ms: number) => new Promise((resolve) => setTimeout(resolve, ms));
// Exponential backoff with jitter: about 1 s, 2 s, then 4 s.
const backoffMs = (attempt: number) => 2 ** attempt * 1000 * (0.5 + Math.random() / 2);
async function socialcrawl(url: URL) {
// One Idempotency-Key per request, reused on every retry, so a retried call is never charged twice.
const idempotencyKey = crypto.randomUUID();
for (let attempt = 0; ; attempt++) {
let res: Response;
let body: SocialCrawlResponse;
try {
res = await fetch(url, {
headers: {
"x-api-key": API_KEY,
"Idempotency-Key": idempotencyKey,
},
signal: AbortSignal.timeout(TIMEOUT_MS),
});
body = (await res.json()) as SocialCrawlResponse;
} catch (error) {
// A timeout, a dropped connection or a non-JSON gateway page: retry with the same key.
if (attempt >= MAX_RETRIES) throw error;
await sleep(backoffMs(attempt));
continue;
}
if (body.success) return body;
// Branch on error.type, never on the message text.
if (body.error.type === "RESOURCE_NOT_FOUND") return null; // refunded: nothing to read
const retryAfter = res.headers.get("Retry-After");
// SERVICE_UNAVAILABLE without Retry-After is a withdrawn endpoint: permanent.
const permanent = body.error.type === "SERVICE_UNAVAILABLE" && retryAfter === null;
if (!body.error.retryable || permanent || attempt >= MAX_RETRIES) {
throw new Error(`${body.error.type}: ${body.error.message} (request_id ${body.request_id})`);
}
// Retry-After (seconds) wins; otherwise back off.
await sleep(retryAfter ? Number(retryAfter) * 1000 : backoffMs(attempt));
}
}
const url = new URL("https://www.socialcrawl.dev/v1/utility/find");
url.searchParams.set("task", "last 200 comments on https://www.tiktok.com/@stoolpresidente/video/7623818255903329566");
const body = await socialcrawl(url);
if (body) console.log(body.data);파라미터
| 파라미터 | 필수 | 설명 |
|---|---|---|
| task | 아니오 | The job in plain words, in any language. Up to 600 characters are read. Provide this or query |
| query | 아니오 | Alias for task. Provide this or task |
| platform | 아니오 | Keep the answer on one platform slug (tiktok, instagram, ...). Omit to search every platform |
Utility Find Endpoint API는 무엇을 돌려주나요
문서에 나온 응답 구조와 필드를 보여 주기 위해 만든 합성 예시예요. 값은 이해를 돕기 위한 것이며 실제 API 응답은 아니에요.
응답 예시 보기
{
"success": true,
"platform": "utility",
"endpoint": "/v1/utility/find",
"data": {
"kind": "endpoint_find",
"version": 1,
"methodology_version": "find-1/router-3/lexical-1",
"platform": null,
"uncertain": false,
"reason": "routed",
"source": "router",
"confidence": 0.76,
"results": [
{
"id": "tiktok/profile",
"method": "GET",
"path": "/v1/tiktok/profile",
"params_filled": {},
"missing": [
"handle"
],
"one_of_missing": [
[
"handle",
"user_id"
]
],
"estimated_credits": 1,
"expected_min": 1,
"pricing": "flat",
"priced_with_examples": [
"handle"
],
"confidence": 0.76,
"why": "Use it when you have a handle and want a quick snapshot of an account before pulling its videos or followers.",
"source": "router"
},
{
"id": "tiktok/profile/full",
"method": "GET",
"path": "/v1/tiktok/profile/full",
"params_filled": {},
"missing": [
"handle"
],
"one_of_missing": [
[
"handle",
"user_id"
]
],
"estimated_credits": 5,
"expected_min": 5,
"pricing": "flat",
"priced_with_examples": [
"handle"
],
"confidence": 0.2,
"why": "Use it instead of profile when you want the account, its recent posts, and the engagement maths in one call rather than three.",
"source": "router"
}
],
"alternatives": [
{
"id": "tiktok/profile/region",
"method": "GET",
"confidence": 0,
"source": "router"
},
{
"id": "tiktok/profile/playlists",
"method": "GET",
"confidence": null,
"source": "lexical"
}
],
"notes": [
"results are ranked best first. Act on results[0] only when uncertain is false; otherwise show the options or check them with GET /v1/utility/endpoint?id=.",
"estimated_credits is what that one call holds up front with the params shown (the most it can cost); a missing param is priced at the endpoint's example and listed in priced_with_examples. For a whole job, use GET /v1/utility/plan or /v1/utility/estimate."
]
},
"credits_used": 0,
"request_id": "req_example000000",
"cached": false
}문서에 나온 응답 구조를 확인하기 위한 합성 예시예요. 값은 이해를 돕기 위한 것이며 운영 환경에서 가져온 응답이 아니에요.
Utility Find Endpoint API는 어떻게 동작하나요
API 키와 함께 GET 요청을 보내면, 통합 스키마와 계산 필드를 담은 깔끔한 JSON이 돌아와요.
메서드
GET
응답 형식
JSON
소셜 미디어 데이터를 몇 초 만에 수집하는 방법
개발자를 위한 가장 빠른 소셜 미디어 스크래핑 API. 월간 활성 사용자 100억 명 이상을 포괄하는 75개 플랫폼에서 프로필, 게시물, 댓글, 분석 데이터를 수집하세요.
모든 플랫폼을 하나의 스키마로
동일한 응답 구조로 75개 플랫폼을 조회하세요. 연동은 한 번이면 충분합니다.
단순 수집을 넘어 계산된 필드 제공
엔드포인트가 해당 지표를 지원하고 계산에 필요한 원본 값이 있을 때, 정규화된 레코드에 engagement_rate, estimated_reach, content_category, language를 함께 담아 바로 활용할 수 있습니다.
코드 한 줄 쓰기 전에, 데이터부터
Visual Data Explorer에 URL만 붙여넣으면 결과 카드와 정형화된 테이블, CSV 내보내기를 바로 사용할 수 있습니다.
import requests
response = requests.get(
'https://www.socialcrawl.dev/v1/tiktok/profile',
params={'handle': 'charlidamelio'},
headers={'x-api-key': 'sc_YOUR_API_KEY'}
)
data = response.json(){
"success": true,
"platform": "tiktok",
"data": {
"author": {
"username": "charlidamelio",
"followers": 152400000
},
"engagement": {
"likes": 12400000000,
"engagement_rate": 0.087
},
"metadata": {
"language": "en",
"content_category": "lifestyle"
}
}
}자주 묻는 질문
API, 요금제, 기능에 대한 질문과 답변입니다.
문의하기Find Endpoint API는 어떤 데이터를 돌려주나요?
Find Endpoint 엔드포인트는 언제 쓰면 좋나요?
Find Endpoint API 비용은 얼마인가요?
Find Endpoint API에는 어떤 파라미터가 필요한가요?
Find Endpoint API는 어떻게 호출하나요?
AI에게 SocialCrawl을 물어보세요
Utility Find Endpoint 데이터, 가져올 준비 되셨어요?
API 키 받고 60초 안에 Utility 데이터를 받아 가세요.
