100 free credits — no credit card required.Start building
Logo
100 free credits — no credit card required

Universal Search News API

Scrape Universal Search News data with one API call. Plans your query into search angles, localizes each angle into the language of every requested country edition (one combined LLM call, fail-open), then fans out up to 12 parallel legs against Google News (50 supported country editions) and merges the articles into one deduplicated list. Every leg reports truthful provenance: `query_source` says whether its keyword was `translated`, confirmed `original`, or a `fallback_original` after a localization failure. Supports streaming via `Accept: text/event-stream` (the `plan_refined` chunk always carries the expanded legs with per-leg provenance before any leg settles) and sync via `Accept: application/json`. Filters: `publisher`, `from`/`to` exact date windows (these pin legs to the primary source), `time_range` recency, `depth` per-leg article depth, `max_legs` cost cap. Billing is metered: a base fee covers planning, then 1 credit per leg that returned articles; the unused ceiling is refunded automatically.

Last updated August 2026Maintained by the SocialCrawl team

Returns one deduplicated list of news articles for a query, searched across the Google News editions of the countries you pick, in each one's language.

Use it for news coverage across several countries at once; for one topic across social platforms use search/everywhere.

Searching 46 platforms in parallel

·TikTok logoTikTok·Instagram logoInstagram·YouTube logoYouTube·Facebook logoFacebook·X logoX·LinkedIn logoLinkedIn·Reddit logoReddit·Threads logoThreads·Pinterest logoPinterest·Twitch logoTwitch·Truth Social logoTruth Social·Snapchat logoSnapchat·Kick logoKick·Bluesky logoBluesky·Kwai logoKwai·Rumble logoRumble·Spotify logoSpotify·TikTok Shop logoTikTok Shop·Amazon Shop logoAmazon Shop·Google Shopping logoGoogle Shopping·Trustpilot logoTrustpilot·TripAdvisor logoTripAdvisor·Linktree logoLinktree·Komi logoKomi·Pillar logoPillar·lnk.bio logolnk.bio·Facebook Ads logoFacebook Ads·Google Ads logoGoogle Ads·LinkedIn Ads logoLinkedIn Ads·Google Search logoGoogle Search·Google News logoGoogle News·Google Finance logoGoogle Finance·Polymarket logoPolymarket·Tavily logoTavily·Hacker News logoHacker News·GitHub logoGitHub·Perplexity logoPerplexity·Naver logoNaver·Utility·Universal Search logoUniversal Search
·TikTok logoTikTok·Instagram logoInstagram·YouTube logoYouTube·Facebook logoFacebook·X logoX·LinkedIn logoLinkedIn·Reddit logoReddit·Threads logoThreads·Pinterest logoPinterest·Twitch logoTwitch·Truth Social logoTruth Social·Snapchat logoSnapchat·Kick logoKick·Bluesky logoBluesky·Kwai logoKwai·Rumble logoRumble·Spotify logoSpotify·TikTok Shop logoTikTok Shop·Amazon Shop logoAmazon Shop·Google Shopping logoGoogle Shopping·Trustpilot logoTrustpilot·TripAdvisor logoTripAdvisor·Linktree logoLinktree·Komi logoKomi·Pillar logoPillar·lnk.bio logolnk.bio·Facebook Ads logoFacebook Ads·Google Ads logoGoogle Ads·LinkedIn Ads logoLinkedIn Ads·Google Search logoGoogle Search·Google News logoGoogle News·Google Finance logoGoogle Finance·Polymarket logoPolymarket·Tavily logoTavily·Hacker News logoHacker News·GitHub logoGitHub·Perplexity logoPerplexity·Naver logoNaver·Utility·Universal Search logoUniversal Search
·TikTok logoTikTok·Instagram logoInstagram·YouTube logoYouTube·Facebook logoFacebook·X logoX·LinkedIn logoLinkedIn·Reddit logoReddit·Threads logoThreads·Pinterest logoPinterest·Twitch logoTwitch·Truth Social logoTruth Social·Snapchat logoSnapchat·Kick logoKick·Bluesky logoBluesky·Kwai logoKwai·Rumble logoRumble·Spotify logoSpotify·TikTok Shop logoTikTok Shop·Amazon Shop logoAmazon Shop·Google Shopping logoGoogle Shopping·Trustpilot logoTrustpilot·TripAdvisor logoTripAdvisor·Linktree logoLinktree·Komi logoKomi·Pillar logoPillar·lnk.bio logolnk.bio·Facebook Ads logoFacebook Ads·Google Ads logoGoogle Ads·LinkedIn Ads logoLinkedIn Ads·Google Search logoGoogle Search·Google News logoGoogle News·Google Finance logoGoogle Finance·Polymarket logoPolymarket·Tavily logoTavily·Hacker News logoHacker News·GitHub logoGitHub·Perplexity logoPerplexity·Naver logoNaver·Utility·Universal Search logoUniversal Search
·TikTok logoTikTok·Instagram logoInstagram·YouTube logoYouTube·Facebook logoFacebook·X logoX·LinkedIn logoLinkedIn·Reddit logoReddit·Threads logoThreads·Pinterest logoPinterest·Twitch logoTwitch·Truth Social logoTruth Social·Snapchat logoSnapchat·Kick logoKick·Bluesky logoBluesky·Kwai logoKwai·Rumble logoRumble·Spotify logoSpotify·TikTok Shop logoTikTok Shop·Amazon Shop logoAmazon Shop·Google Shopping logoGoogle Shopping·Trustpilot logoTrustpilot·TripAdvisor logoTripAdvisor·Linktree logoLinktree·Komi logoKomi·Pillar logoPillar·lnk.bio logolnk.bio·Facebook Ads logoFacebook Ads·Google Ads logoGoogle Ads·LinkedIn Ads logoLinkedIn Ads·Google Search logoGoogle Search·Google News logoGoogle News·Google Finance logoGoogle Finance·Polymarket logoPolymarket·Tavily logoTavily·Hacker News logoHacker News·GitHub logoGitHub·Perplexity logoPerplexity·Naver logoNaver·Utility·Universal Search logoUniversal Search
Universal Search API

What can you do with the News API?

The News endpoint gives you structured Universal Search data with computed fields in a single request. No scraping infrastructure to build or maintain.

Example Request

curl -H "x-api-key: YOUR_API_KEY" \
  "https://www.socialcrawl.dev/v1/search/news?query=samsung+galaxy+launch"
import requests

response = requests.get(
    "https://www.socialcrawl.dev/v1/search/news",
    params={
    'query': 'samsung galaxy launch',
    },
    headers={"x-api-key": "YOUR_API_KEY"},
)

data = response.json()
const response = await fetch(
  "https://www.socialcrawl.dev/v1/search/news?query=samsung+galaxy+launch",
  {
    headers: { "x-api-key": "YOUR_API_KEY" },
  },
);

const data = await response.json();

Parameters

ParameterRequiredDescription
queryYesNews topic or question (1-500 chars). Boolean AND/OR/NOT and quoted phrases are supported; Google advanced operators (site:, intitle:, before:) are rejected.
countriesNoCSV of ISO 3166-1 alpha-2 country codes to search (1-12 of the 50 supported editions, default US). Each country searches its Google News edition in its default language; duplicates collapse.
time_rangeNoRecency window (day | week | month | year, default day). Ignored when from/to is present. (day | week | month | year)
fromNoLower publish-date bound, YYYY-MM-DD or Unix seconds. Pins every leg to the primary news source.
toNoUpper publish-date bound, YYYY-MM-DD or Unix seconds. Pins every leg to the primary news source.
publisherNoBare publisher domain filter (e.g. bbc.com; no scheme or path). Pins every leg to the primary news source.
depthNoArticles requested per leg (10-100 in steps of 10, default 10).
max_legsNoHard cap on billable legs (1-12, default 12). The upfront hold shrinks with it.
Example Response

What does the Universal Search News API return?

This example shows the endpoint's response shape and fields. Values are illustrative; this is not a live capture.

Example response
{
  "success": true,
  "platform": "search",
  "endpoint": "/v1/search/news",
  "data": {
    "query": "samsung electronics",
    "status": "succeeded",
    "plan": {
      "topic": "samsung electronics",
      "source": "llm",
      "degraded": false,
      "subqueries": [
        {
          "id": "sq0",
          "label": "Samsung Electronics 재무 실적",
          "search_query": "Samsung Electronics quarterly results revenue profit guidance",
          "ranking_query": "Focus on earnings, revenue/profit trends, guidance, and investor updates reported by major outlets.",
          "weight": 1
        }
      ],
      "notes": [
        "llm-plan"
      ]
    },
    "legs": [
      {
        "leg_id": "sq0|KR",
        "country": "KR",
        "language": "ko",
        "angle_id": "sq0",
        "angle_label": "Samsung Electronics 재무 실적",
        "effective_query": "삼성전자 실적 매출 이익 전망",
        "query_source": "translated",
        "status": "succeeded",
        "article_count": 10,
        "quarantined_count": 0,
        "credits_used": 1,
        "latency_ms": 1452,
        "error": null
      },
      {
        "leg_id": "sq0|US",
        "country": "US",
        "language": "en",
        "angle_id": "sq0",
        "angle_label": "Samsung Electronics 재무 실적",
        "effective_query": "Samsung Electronics earnings revenue profit guidance",
        "query_source": "translated",
        "status": "succeeded",
        "article_count": 10,
        "quarantined_count": 0,
        "credits_used": 1,
        "latency_ms": 3177,
        "error": null
      }
    ],
    "items": [
      {
        "id": "gn_9599da30",
        "title": "키움증권 \"삼성전자 3분기 영업이익 120조 전망, 메모리 가격 20% 오를 것\"",
        "url": "https://www.businesspost.co.kr/BP?command=article_view&num=443626",
        "canonical_url": "https://www.businesspost.co.kr/BP?command=article_view&num=443626",
        "source_name": "비즈니스포스트",
        "domain": "www.businesspost.co.kr",
        "snippet": null,
        "image_url": "https://www.businesspost.co.kr/news/photo/202306/20230629221229_98416.jpg",
        "published_at": "2026-07-31T00:57:26.000Z",
        "rank": 1,
        "placement": "news_search",
        "country_code": "KR",
        "language_code": "ko",
        "angle_id": "sq0",
        "effective_query": "삼성전자 실적 매출 이익 전망",
        "query_source": "translated",
        "legs_returned": [
          "sq0|KR"
        ]
      },
      {
        "id": "gn_2c3f9190",
        "title": "Samsung Sees Chip Crunch Through 2028 as Profit Soars to Record",
        "url": "https://www.wsj.com/tech/samsungs-chip-earnings-push-net-profit-to-record-cf8711bc",
        "canonical_url": "https://www.wsj.com/tech/samsungs-chip-earnings-push-net-profit-to-record-cf8711bc",
        "source_name": "WSJ",
        "domain": "www.wsj.com",
        "snippet": null,
        "image_url": "https://images.wsj.net/im-46577202?width=700&height=466",
        "published_at": "2026-07-30T08:59:00.000Z",
        "rank": 1,
        "placement": "news_search",
        "country_code": "US",
        "language_code": "en",
        "angle_id": "sq0",
        "effective_query": "Samsung Electronics earnings revenue profit guidance",
        "query_source": "translated",
        "legs_returned": [
          "sq0|US"
        ]
      }
    ],
    "total_articles": 20,
    "countries_searched": [
      "KR",
      "US"
    ],
    "credits_used": 4,
    "methodology_version": "search-news/1.0"
  },
  "credits_used": 4,
  "credits_remaining": 9999,
  "request_id": "req_example000000",
  "cached": false
}

Illustrative fixture for the documented response shape. Values are examples, not a production capture.

API Details

How does the Universal Search News API work?

Send a GET request with your API key and get back clean, structured JSON in our unified schema. Supported computed fields are populated when the source provides the required inputs.

Method

GET

Response

JSON

Why SocialCrawl

Why use SocialCrawl for Universal Search News data?

We handle the complexity of Universal Search data extraction so you can focus on building. Unified schema, AI enrichment, and zero platform logic in your code.

Developer First

How do you scrape social media data in seconds?

The fastest social media scraping API for developers. Scrape profiles, posts, comments, and analytics from 46 platforms covering 10B+ monthly active users.

One schema, every platform

Query 46 platforms with identical response structures. Write your integration once.

Computed fields, not just scraped

When an endpoint supports these metrics and the source provides the required inputs, the normalized record includes engagement_rate, estimated_reach, content_category, and language — ready to use.

See your data before you code

Visual Data Explorer — paste any URL, get rich result cards, sortable tables, CSV export.

import requests

response = requests.get(
    'https://www.socialcrawl.dev/v1/tiktok/profile',
    params={'handle': 'charlidamelio'},
    headers={'x-api-key': 'sc_YOUR_API_KEY'}
)
data = response.json()
[ .JSON ]
{
  "success": true,
  "platform": "tiktok",
  "data": {
    "author": {
      "username": "charlidamelio",
      "followers": 152400000
    },
    "engagement": {
      "likes": 12400000000,
      "engagement_rate": 0.087
    },
    "metadata": {
      "language": "en",
      "content_category": "lifestyle"
    }
  }
}
+ 46 platforms
FAQ

Have a question? We got answers

Find answers to frequently asked questions about SocialCrawl's API, pricing, and capabilities.

Contact us
What is the SocialCrawl news search API?
GET /v1/search/news takes one query, plans it into search angles with an LLM, localizes each angle into the target languages, and fans it out across Google News country editions in parallel. You get one deduplicated article list with per-country, per-language provenance on every item.
Which countries can I search news in?
50 country editions, from the United States and the United Kingdom to South Korea, Japan, Germany, and Brazil. Pass countries as a CSV of ISO codes (countries=KR,US,JP) and the lane searches up to 12 countries in one call, each in its edition's own language.
How much does a news search cost?
Each call starts at 2 credits and adds 1 credit per country leg that actually returns articles, so the total lands between 2 and 14 credits. A search that finds nothing bills the 2-credit base only, and if every leg fails outright the whole charge is refunded automatically.
How does the query localization work?
One combined LLM call plans the search angles and writes each one natively in the target languages, so the Korean edition is searched in Korean and the Japanese edition in Japanese. Every result row carries a query_source stamp (translated, original, or fallback_original) so you can always see exactly which query text a leg ran.
Can I stream news results as they arrive?
Yes. Send Accept: text/event-stream and you get typed SSE chunks: the refined plan with per-leg provenance first, then each country's articles as its leg settles, then a done summary with the exact credits used. The default Accept: application/json returns one synchronous envelope.

Ask AI about SocialCrawl

Ready to scrape Universal Search News data?

Get your API key and start pulling Universal Search data in under 60 seconds.

Start for free

🤖 AI agent or LLM? Read this page as markdown