What is cursor pagination?
Cursor pagination is a way to page through API results using an opaque token, the cursor, that marks your position, instead of an offset or page number. You pass the cursor from the previous response back on the next request. Because it points at a record rather than a numeric position, results stay stable even as new items arrive.
Offset pagination (page=2, page=3) breaks when rows are inserted or deleted between requests: you skip or repeat items. A cursor avoids that, which is why high-volume feeds use it.
SocialCrawl list endpoints return a next cursor on each page; loop until it comes back empty to walk the full result set the upstream allows.
Do it with SocialCrawl
Page through results with a cursor, not an offset
curl "https://www.socialcrawl.dev/v1/reddit/subreddit?subreddit=python&cursor=CURSOR" \
-H "x-api-key: sc_your_api_key_here"Have a question? We got answers
Find answers to frequently asked questions about SocialCrawl's API, pricing, and capabilities.
Contact usAsk AI about SocialCrawl