Content Analysis Scraper API
The Content Analysis API is 10 endpoints for web-wide brand intelligence: a paginated mention search, summary and sentiment rollups, rating distribution, phrase and category trends, plus four reference lookups. Analytic calls cost 5 credits and lookups 1 credit, all behind the same x-api-key and unified JSON envelope as SocialCrawl's other 43 platforms.
TL;DR
The Content Analysis API by SocialCrawl returns Content Analysis data as structured JSON — 10 endpoints behind one x-api-key, from 1 credit per call. It shares one unified schema with 43 other platforms, so the same client code works everywhere.
Where to find SocialCrawl
Try the Content Analysis API in your browser
Type a real handle, run a real request, see the JSON SocialCrawl returns. No signup, no key — same response shape you get in production.
Try the Content Analysis Search API
See real data before writing a single line
What data does the Content Analysis API return?
Every endpoint returns structured JSON in a unified envelope. Computed fields such as engagement rate and content category are included only where the endpoint supports them and the required source inputs are present.
Last updated July 2026
Maintained by the SocialCrawl team, reviewed July 2026
What Content Analysis data can you get?
Every Content Analysis endpoint uses the same response envelope, so one parser handles the whole platform. These are fields returned by current public responses, subject to each endpoint's documented cache window.
Fields you get back in a Content Analysis response include:
- engagement_rate_percentages
- recent_posts
- followers
- comments
- likes
- recent_posts_explanation
- id_user
- username
- is_private
- posts_details
How to scrape Content Analysis in 3 steps
No proxies, no headless browsers, no login sessions. Send one authenticated GET request and read structured JSON back.
- 1
Get a free API key
Create an account and copy your key from the dashboard. Signup includes 100 free credits, and no card is required.
- 2
Call the Search endpoint
Send a GET request with your key in the x-api-key header. Here is the full Content Analysis Search request:
curl -H "x-api-key: YOUR_API_KEY" \ "https://www.socialcrawl.dev/v1/content_analysis/search?keyword=openai" - 3
Read the unified JSON
The response comes back in the shared SocialCrawl schema. Where the endpoint supports them and the required source inputs are present, fields such as engagement_rate and content_category are filled in too. Your client can rely on the shared envelope while treating enriched fields as optional.
Requirements and limits
Everything you need to know before your first Content Analysis call.
- Authentication
- One API key, passed in the x-api-key request header. No OAuth flow, no app review, and no per-platform credentials to manage.
- Pagination
- List endpoints return a next_cursor and a has_more flag. Pass the cursor back to page through results, with the same contract on every platform.
- Credits
- Calls start at 1 credits and are deducted per request. Every account starts with 100 free credits, and credits never expire.
- Rate limits
- There are no artificial rate limits. Your credit balance is the only throttle, so you can run requests concurrently as fast as you need.
How much does the Content Analysis API cost?
Simple credit-based pricing with no subscription. You pay per call, and the exact credit cost of every Content Analysis endpoint is listed below.
| Endpoint | Credits per call |
|---|---|
| Search | 20 credits |
| Summary | 20 credits |
| Sentiment | 20 credits |
| Rating Distribution | 20 credits |
| Phrase Trends | 20 credits |
| Category Trends | 20 credits |
| Languages | 1 credit |
| Locations | 1 credit |
| Categories | 1 credit |
| Filters | 1 credit |
Every account starts with 100 free credits, and no card is required.
At credit-pack pricing that works out to roughly £0.002 to £0.12 per call, and credits never expire.
How do you scrape social media data in seconds?
The fastest social media scraping API for developers. Scrape profiles, posts, comments, and analytics from 44 platforms covering 10B+ monthly active users.
One schema, every platform
Query 44 platforms with identical response structures. Write your integration once.
Computed fields, not just scraped
When an endpoint supports these metrics and the source provides the required inputs, the normalized record includes engagement_rate, estimated_reach, content_category, and language — ready to use.
See your data before you code
Visual Data Explorer — paste any URL, get rich result cards, sortable tables, CSV export.
import requests
response = requests.get(
'https://www.socialcrawl.dev/v1/tiktok/profile',
params={'handle': 'charlidamelio'},
headers={'x-api-key': 'sc_YOUR_API_KEY'}
)
data = response.json(){
"success": true,
"platform": "tiktok",
"data": {
"author": {
"username": "charlidamelio",
"followers": 152400000
},
"engagement": {
"likes": 12400000000,
"engagement_rate": 0.087
},
"metadata": {
"language": "en",
"content_category": "lifestyle"
}
}
}How does SocialCrawl handle 44 different platforms?
Social media scraping is hard. Schema normalization, authentication, rate limits, pagination — we handle it all before your data arrives.
Write once, query them all.
44 platforms return 44 different JSON shapes. We normalize every response into one consistent structure.
Metrics ready before you ask.
Normalized records include supported metrics such as engagement rate, estimated reach, content category, and language when the required source inputs are available.
One cursor, every platform.
Every platform paginates differently. We give you one consistent cursor-based system.
Fresh when it matters. Free on repeat.
Cache misses fetch current public data. Identical requests are cached for 2 to 30 minutes by data type and cost 0 credits on a hit; send Cache-Control: no-cache for a billed refresh.
Auth, proxies, and rate limits — handled.
Platform authentication, IP rotation, rate limit management — abstracted away. Just send a GET request.
What developers say
The unified schema saved us weeks of integration work. One parser handles every platform.
Our agents process social data from 44 platforms with zero platform-specific logic — one schema, end to end.
I paste an influencer's URL and get everything — followers, engagement rate, content categories — without touching code.
We switched from building our own scrapers. SocialCrawl handles the hard stuff, we focus on insights.
The computed fields alone — engagement_rate, estimated_reach, content_category — saved us an entire data pipeline.
How does SocialCrawl compare to Build-your-own NLP pipeline for Content Analysis data?
Same Content Analysis data, two very different paths. Auth, rate limits, schema, and cost — side by side.
| Feature | SocialCrawl | Build-your-own NLP pipeline |
|---|---|---|
| Setup | One GET per question — mentions, sentiment, and trends are each a single call | Crawler, mention index, and NLP models to build, train, and host |
| Coverage | Web-wide citation database — news, blogs, ecommerce, message boards | Limited to whatever your crawler reaches and you can afford to store |
| Sentiment scoring | 6-axis emotion model plus positive/negative/neutral probabilities, passed through verbatim | Model selection, training data, and accuracy tuning are all on you |
| Pricing | 5 credits per analytic call, 1 credit per reference lookup; 100 free credits to start | Compute, storage, and data engineering time before the first result |
| Maintenance | Endpoints stay stable behind the unified schema | Crawlers and models drift — retraining and fixes never stop |
Setup
Coverage
Sentiment scoring
Pricing
Maintenance
How much does Content Analysis scraping cost?
SocialCrawl uses credit-based pricing: you pay per API call, and most Content Analysis endpoints cost just a few credits. Every account starts with 100 free credits — no subscriptions, no compute units, no credit card required.
See pricingIs Content Analysis scraping legal?
SocialCrawl returns publicly available Content Analysis data. Courts have generally upheld scraping public data — most notably in hiQ v. LinkedIn — but compliance depends on your use case and jurisdiction. You are responsible for following applicable laws and platform terms.
Common Content Analysis scraping terms
The phrases developers search for when they need Content Analysis data, and what each one means with SocialCrawl.
- Content Analysis scraper API
- A Content Analysis scraper API returns Content Analysis data as structured JSON without you running any scraping infrastructure. SocialCrawl handles the proxies, parsing, and format changes, so you call an endpoint and get clean fields back. Pricing starts at 1 credits per call.
- Content Analysis data API
- A Content Analysis data API is a programmatic way to read public Content Analysis data on demand. SocialCrawl exposes 10 Content Analysis endpoints behind one x-api-key, all sharing the same unified schema, so your integration never has to change per platform.
- scrape Content Analysis
- To scrape Content Analysis is to extract its public data programmatically instead of by hand. With SocialCrawl you scrape Content Analysis by sending a single authenticated request, and the response is normalised into the same JSON shape used across every platform.
Have a question? We got answers
Find answers to frequently asked questions about SocialCrawl's API, pricing, and capabilities.
Contact usWhat is the SocialCrawl content analysis API?
Does it return social media posts or web page mentions?
What endpoints does the content analysis API have?
How is sentiment scored in the brand mention data?
How much does the content analysis API cost?
What is the best API for social media sentiment analysis?
Does SocialCrawl offer a content analysis data API?
Is scraping Content Analysis data legal?
Content Analysis scraping API vs the official Content Analysis API — what's the difference?
Ask AI about SocialCrawl
Ready to start scraping Content Analysis data?
Get your API key and access all 10 Content Analysis endpoints in under 60 seconds.
Start for free