100 free credits. No credit card required.Start building
Logo
100 free credits. No credit card required

On-Page Scraper API

Access 1 On-Page API endpoints through one unified interface for profiles, posts, comments, search, and more. When an endpoint supports a computed field and the required source inputs are present, that optional field is included in the unified response.

TL;DR

The On-Page API by SocialCrawl returns On-Page data as structured JSON: 1 endpoints behind one x-api-key, from 1 credit per call. It shares one unified schema with 50 other platforms, so the same client code works everywhere.

Live demo

Try the On-Page API in your browser

Type a real handle, run a real request, see the JSON SocialCrawl returns. No signup, no key. Same response shape you get in production.

Returns a technical on-page SEO audit for one URL: title, meta, heading counts, on-page score, checks, and page timing.

Use it to audit a single public URL in one call rather than crawling a whole site.

Try the On-Page Page API

See real data before writing a single line

GET/v1/on_page/page

Absolute page URL to audit, including https://.

1 optional parameters

Set true to execute JavaScript while loading the page. Default false.

Endpoints

What data does the On-Page API return?

Every endpoint returns structured JSON in a unified envelope. Computed fields such as engagement rate and content category are included only where the endpoint supports them and the required source inputs are present.

Last updated August 2026

Maintained by the SocialCrawl team, reviewed August 2026

Pagestandard

Run an on-page SEO audit for one URL

What you get

What On-Page data can you get?

Every On-Page endpoint uses the same response envelope, so one parser handles the whole platform. These are fields returned by current public responses, subject to each endpoint's documented cache window.

Fields you get back in a On-Page response include:

  • engagement_rate_percentages
  • recent_posts
  • followers
  • comments
  • likes
  • recent_posts_explanation
  • id_user
  • username
  • is_private
  • posts_details
Quickstart

How to scrape On-Page in 3 steps

No proxies, no headless browsers, no login sessions. Send one authenticated GET request and read structured JSON back.

  1. 1

    Get a free API key

    Create an account and copy your key from the dashboard. Signup includes 100 free credits, and no card is required.

  2. 2

    Call the Page endpoint

    Send a GET request with your key in the x-api-key header. Here is the full On-Page Page request:

    curl -H "x-api-key: YOUR_API_KEY" \
      "https://www.socialcrawl.dev/v1/on_page/page?url=https%3A%2F%2Fwww.socialcrawl.dev%2F"
  3. 3

    Read the unified JSON

    The response comes back in the shared SocialCrawl schema. Where the endpoint supports them and the required source inputs are present, fields such as engagement_rate and content_category are filled in too. Your client can rely on the shared envelope while treating enriched fields as optional.

Requirements and limits

Requirements and limits

Everything you need to know before your first On-Page call.

Authentication
One API key, passed in the x-api-key request header. No OAuth flow, no app review, and no per-platform credentials to manage.
Pagination
List endpoints return a next_cursor and a has_more flag. Pass the cursor back to page through results, with the same contract on every platform.
Credits
Calls start at 1 credits and are deducted per request. Every account starts with 100 free credits, and credits never expire.
Rate limits
Two ceilings, both per API key and identical on every plan: 600 requests per minute and 50 simultaneous requests. Neither costs you a credit when it rejects a request, and past them your credit balance is the only throttle.
Pricing

How much does the On-Page API cost?

Simple credit-based pricing with no subscription. You pay per call, and the exact credit cost of every On-Page endpoint is listed below.

EndpointCredits per call
Page1 credit

Every account starts with 100 free credits, and no card is required.

At credit-pack pricing that works out to roughly £0.002 to £0.006 per call, and credits never expire.

Developer First

How do you scrape social media data in seconds?

The fastest social media scraping API for developers. Scrape profiles, posts, comments, and analytics from 51 platforms covering 10B+ monthly active users.

One schema, every platform

Query 51 platforms with identical response structures. Write your integration once.

Computed fields, not just scraped

When an endpoint supports these metrics and the source provides the required inputs, the normalized record includes engagement_rate, estimated_reach, content_category, and language. Ready to use.

See your data before you code

Visual Data Explorer. Paste any URL, get rich result cards, sortable tables, CSV export.

import requests

response = requests.get(
    'https://www.socialcrawl.dev/v1/tiktok/profile',
    params={'handle': 'charlidamelio'},
    headers={'x-api-key': 'sc_YOUR_API_KEY'}
)
data = response.json()
[ .JSON ]
{
  "success": true,
  "platform": "tiktok",
  "data": {
    "author": {
      "username": "charlidamelio",
      "followers": 152400000
    },
    "engagement": {
      "likes": 12400000000,
      "engagement_rate": 0.087
    },
    "metadata": {
      "language": "en",
      "content_category": "lifestyle"
    }
  }
}
+ 51 platforms
One API, 51 platforms

How does SocialCrawl handle 51 different platforms?

Social media scraping is hard. Schema normalization, authentication, rate limits, pagination. We handle all of it before your data arrives.

One schema, every platform

Write once, query them all.

51 platforms return 51 different JSON shapes. We normalize every response into one consistent structure.

Ready-to-use metrics

Metrics ready before you ask.

Normalized records include supported metrics such as engagement rate, estimated reach, content category, and language when the required source inputs are available.

Consistent pagination

One cursor, every platform.

Every platform paginates differently. We give you one consistent cursor-based system.

Freshness you control

Fresh when it matters. Free on repeat.

Cache misses fetch current public data. Identical requests are cached for 2 to 30 minutes by data type and cost 0 credits on a hit; send Cache-Control: no-cache for a billed refresh.

Things you'll never build

Auth, proxies, and rate limits, handled

Platform authentication, IP rotation, and rate limit management are all abstracted away. Just send a GET request.

Start for free
Reviews

What developers say

Rated 4.9 out of 5 from 200 developer reviews
The unified schema saved us weeks of integration work. One parser handles every platform.
Alex Chen, Full-Stack Developer
Our agents process social data from 51 platforms with zero platform-specific logic. One schema, end to end.
Sarah Kim, AI Engineer, AgentFlow
I paste an influencer's URL and get everything (followers, engagement rate, content categories) without touching code.
James Rivera, Marketing Director
We switched from building our own scrapers. SocialCrawl handles the hard stuff, we focus on insights.
Maria Santos, CTO, DataPulse
The computed fields alone (engagement_rate, estimated_reach, content_category) saved us an entire data pipeline.
David Park, Lead Data Scientist
Quick answers

How much does On-Page scraping cost?

SocialCrawl uses credit-based pricing: you pay per API call, and most On-Page endpoints cost just a few credits. Every account starts with 100 free credits. No subscriptions, no compute units, no credit card required.

See pricing

Is On-Page scraping legal?

SocialCrawl returns publicly available On-Page data. Courts have generally upheld scraping public data, most notably in hiQ v. LinkedIn, but compliance depends on your use case and jurisdiction. You are responsible for following applicable laws and platform terms.

Glossary

Common On-Page scraping terms

The phrases developers search for when they need On-Page data, and what each one means with SocialCrawl.

On-Page scraper API
A On-Page scraper API returns On-Page data as structured JSON without you running any scraping infrastructure. SocialCrawl handles the proxies, parsing, and format changes, so you call an endpoint and get clean fields back. Pricing starts at 1 credits per call.
On-Page data API
A On-Page data API is a programmatic way to read public On-Page data on demand. SocialCrawl exposes 1 On-Page endpoints behind one x-api-key, all sharing the same unified schema, so your integration never has to change per platform.
scrape On-Page
To scrape On-Page is to extract its public data programmatically instead of by hand. With SocialCrawl you scrape On-Page by sending a single authenticated request, and the response is normalised into the same JSON shape used across every platform.
Read the full API reference
FAQ

Have a question? We got answers

Find answers to frequently asked questions about SocialCrawl's API, pricing, and capabilities.

Contact us
What is the SocialCrawl on-page SEO API?
It is a single-URL technical SEO audit. GET /v1/on_page/page?url= returns title, meta, headings, on-page score, checks such as HTTPS and canonical, and page timing as unified JSON on one x-api-key.
Does it crawl a whole site or one URL?
One URL per call. It is an instant page audit, not a site-wide crawl. Pass the absolute https URL you want scored.
What does the on-page audit return?
Title and description, heading counts, on-page score, boolean checks (HTTPS, canonical, broken links, 4xx/5xx), and page timing such as time to interactive. The payload is Analytics passthrough because the audit shape is heterogeneous.
How much does the on-page audit API cost?
GET /v1/on_page/page costs 1 credit per request. New accounts get 100 free credits with no credit card.
Do I need to enable JavaScript for the audit?
No. JavaScript is off by default. Set enable_javascript=true when the page's title or canonical is injected client-side.
Is this a Lighthouse report?
No. It is an on-page SEO audit (meta, headings, checks, timing), not a Lighthouse lab report. Use it to inspect one public URL quickly.
Is scraping On-Page data legal?
SocialCrawl returns publicly available On-Page data and does not access private or login-gated content. Whether scraping fits your project depends on your use case and jurisdiction. You are responsible for complying with On-Page's terms of service and applicable data-protection laws such as GDPR and CCPA. This is general information, not legal advice.
On-Page scraping API vs the official On-Page API: what's the difference?
With SocialCrawl there is no app review or approval queue. Sign up and call On-Page endpoints immediately with a single x-api-key. Responses share one unified schema with every other SocialCrawl platform, and credit-based pricing replaces per-platform quotas. Official APIs are still the right choice for posting and other write actions: SocialCrawl is read-only data.

Ask AI about SocialCrawl

Ready to start scraping On-Page data?

Get your API key and access all 1 On-Page endpoints in under 60 seconds.

Start for free

🤖 AI agent or LLM? Read this page as markdown