On-Page Scraper API
Access 1 On-Page API endpoints through one unified interface for profiles, posts, comments, search, and more. When an endpoint supports a computed field and the required source inputs are present, that optional field is included in the unified response.
TL;DR
The On-Page API by SocialCrawl returns On-Page data as structured JSON: 1 endpoints behind one x-api-key, from 1 credit per call. It shares one unified schema with 50 other platforms, so the same client code works everywhere.
Where to find SocialCrawl
Try the On-Page API in your browser
Type a real handle, run a real request, see the JSON SocialCrawl returns. No signup, no key. Same response shape you get in production.
Returns a technical on-page SEO audit for one URL: title, meta, heading counts, on-page score, checks, and page timing.
Use it to audit a single public URL in one call rather than crawling a whole site.
Try the On-Page Page API
See real data before writing a single line
What data does the On-Page API return?
Every endpoint returns structured JSON in a unified envelope. Computed fields such as engagement rate and content category are included only where the endpoint supports them and the required source inputs are present.
Last updated August 2026
Maintained by the SocialCrawl team, reviewed August 2026
What On-Page data can you get?
Every On-Page endpoint uses the same response envelope, so one parser handles the whole platform. These are fields returned by current public responses, subject to each endpoint's documented cache window.
Fields you get back in a On-Page response include:
- engagement_rate_percentages
- recent_posts
- followers
- comments
- likes
- recent_posts_explanation
- id_user
- username
- is_private
- posts_details
How to scrape On-Page in 3 steps
No proxies, no headless browsers, no login sessions. Send one authenticated GET request and read structured JSON back.
- 1
Get a free API key
Create an account and copy your key from the dashboard. Signup includes 100 free credits, and no card is required.
- 2
Call the Page endpoint
Send a GET request with your key in the x-api-key header. Here is the full On-Page Page request:
curl -H "x-api-key: YOUR_API_KEY" \ "https://www.socialcrawl.dev/v1/on_page/page?url=https%3A%2F%2Fwww.socialcrawl.dev%2F" - 3
Read the unified JSON
The response comes back in the shared SocialCrawl schema. Where the endpoint supports them and the required source inputs are present, fields such as engagement_rate and content_category are filled in too. Your client can rely on the shared envelope while treating enriched fields as optional.
Requirements and limits
Everything you need to know before your first On-Page call.
- Authentication
- One API key, passed in the x-api-key request header. No OAuth flow, no app review, and no per-platform credentials to manage.
- Pagination
- List endpoints return a next_cursor and a has_more flag. Pass the cursor back to page through results, with the same contract on every platform.
- Credits
- Calls start at 1 credits and are deducted per request. Every account starts with 100 free credits, and credits never expire.
- Rate limits
- Two ceilings, both per API key and identical on every plan: 600 requests per minute and 50 simultaneous requests. Neither costs you a credit when it rejects a request, and past them your credit balance is the only throttle.
How much does the On-Page API cost?
Simple credit-based pricing with no subscription. You pay per call, and the exact credit cost of every On-Page endpoint is listed below.
| Endpoint | Credits per call |
|---|---|
| Page | 1 credit |
Every account starts with 100 free credits, and no card is required.
At credit-pack pricing that works out to roughly £0.002 to £0.006 per call, and credits never expire.
How do you scrape social media data in seconds?
The fastest social media scraping API for developers. Scrape profiles, posts, comments, and analytics from 51 platforms covering 10B+ monthly active users.
One schema, every platform
Query 51 platforms with identical response structures. Write your integration once.
Computed fields, not just scraped
When an endpoint supports these metrics and the source provides the required inputs, the normalized record includes engagement_rate, estimated_reach, content_category, and language. Ready to use.
See your data before you code
Visual Data Explorer. Paste any URL, get rich result cards, sortable tables, CSV export.
import requests
response = requests.get(
'https://www.socialcrawl.dev/v1/tiktok/profile',
params={'handle': 'charlidamelio'},
headers={'x-api-key': 'sc_YOUR_API_KEY'}
)
data = response.json(){
"success": true,
"platform": "tiktok",
"data": {
"author": {
"username": "charlidamelio",
"followers": 152400000
},
"engagement": {
"likes": 12400000000,
"engagement_rate": 0.087
},
"metadata": {
"language": "en",
"content_category": "lifestyle"
}
}
}How does SocialCrawl handle 51 different platforms?
Social media scraping is hard. Schema normalization, authentication, rate limits, pagination. We handle all of it before your data arrives.
Write once, query them all.
51 platforms return 51 different JSON shapes. We normalize every response into one consistent structure.
Metrics ready before you ask.
Normalized records include supported metrics such as engagement rate, estimated reach, content category, and language when the required source inputs are available.
One cursor, every platform.
Every platform paginates differently. We give you one consistent cursor-based system.
Fresh when it matters. Free on repeat.
Cache misses fetch current public data. Identical requests are cached for 2 to 30 minutes by data type and cost 0 credits on a hit; send Cache-Control: no-cache for a billed refresh.
Auth, proxies, and rate limits, handled
Platform authentication, IP rotation, and rate limit management are all abstracted away. Just send a GET request.
What developers say
The unified schema saved us weeks of integration work. One parser handles every platform.
Our agents process social data from 51 platforms with zero platform-specific logic. One schema, end to end.
I paste an influencer's URL and get everything (followers, engagement rate, content categories) without touching code.
We switched from building our own scrapers. SocialCrawl handles the hard stuff, we focus on insights.
The computed fields alone (engagement_rate, estimated_reach, content_category) saved us an entire data pipeline.
How much does On-Page scraping cost?
SocialCrawl uses credit-based pricing: you pay per API call, and most On-Page endpoints cost just a few credits. Every account starts with 100 free credits. No subscriptions, no compute units, no credit card required.
See pricingIs On-Page scraping legal?
SocialCrawl returns publicly available On-Page data. Courts have generally upheld scraping public data, most notably in hiQ v. LinkedIn, but compliance depends on your use case and jurisdiction. You are responsible for following applicable laws and platform terms.
Common On-Page scraping terms
The phrases developers search for when they need On-Page data, and what each one means with SocialCrawl.
- On-Page scraper API
- A On-Page scraper API returns On-Page data as structured JSON without you running any scraping infrastructure. SocialCrawl handles the proxies, parsing, and format changes, so you call an endpoint and get clean fields back. Pricing starts at 1 credits per call.
- On-Page data API
- A On-Page data API is a programmatic way to read public On-Page data on demand. SocialCrawl exposes 1 On-Page endpoints behind one x-api-key, all sharing the same unified schema, so your integration never has to change per platform.
- scrape On-Page
- To scrape On-Page is to extract its public data programmatically instead of by hand. With SocialCrawl you scrape On-Page by sending a single authenticated request, and the response is normalised into the same JSON shape used across every platform.
Have a question? We got answers
Find answers to frequently asked questions about SocialCrawl's API, pricing, and capabilities.
Contact usWhat is the SocialCrawl on-page SEO API?
Does it crawl a whole site or one URL?
What does the on-page audit return?
How much does the on-page audit API cost?
Do I need to enable JavaScript for the audit?
Is this a Lighthouse report?
Is scraping On-Page data legal?
On-Page scraping API vs the official On-Page API: what's the difference?
Ask AI about SocialCrawl
Ready to start scraping On-Page data?
Get your API key and access all 1 On-Page endpoints in under 60 seconds.
Start for free