Social data APIs

Short-form platforms expose a fraction of their data through official APIs, and each one draws the line somewhere different. Anyone building on this data runs into the same questions about coverage, rate limits, terms of service and schema stability.

This topic is written for engineers. It covers what the official APIs do and do not return, how third-party providers fill the gaps, and the practical mechanics — pagination, backfill, rate limiting, schema drift — of keeping a pipeline running.

Articles for this topic are on the way. In the meantime, the glossary and the free tools below cover the same ground.

Common questions

Do the official platform APIs return trend data?
Mostly not. The official TikTok, Instagram and YouTube APIs are built for account owners and advertisers: they return your own content, your own metrics, and limited public metadata. Cross-account discovery, outlier detection and trend measurement sit outside them, which is why third-party data providers exist.
What breaks first when you build on social data?
Schema drift and rate limits, in that order. Field names and nesting change without a version bump, so parse defensively and alert on missing fields rather than on exceptions. Then design for the quota you actually have: cache aggressively, backfill off-peak, and treat every call as a budget line.
Is scraping social platforms legal?
It depends on the data, the jurisdiction and the platform's terms, and it is a question for your own counsel. The practical point for engineers is separate: personal data carries obligations under GDPR and similar laws regardless of how it was collected, so decide what you store and for how long before you write the pipeline.
How much data do I need before a trend signal is reliable?
Enough of the same niche to establish a baseline. A trend is acceleration relative to normal, so the signal is only as good as the normal you measured. One account's history is rarely enough; a few hundred comparable accounts sampled consistently usually is.

Put it to work

Build on short-form video data

A read-only API for TikTok, Instagram Reels and YouTube Shorts. Pay per call, $5 in free credits, no trial required.