Twitter Scraping Dashboard
Streamlit dashboard for exploring Twitter data fetched via the Twitter API v2. Includes sample data, visualizations, and a Tweepy-based fetcher.
Streamlit dashboard for exploring Twitter data fetched via Twitter API v2. Built as a learning project to understand the API limits, data structure, and what you can actually do with raw tweet data.
The dashboard lets you search by keyword or account, visualize tweet volume over time, explore engagement patterns, and browse the raw data. Includes sample datasets so it works without needing API credentials to demo.
Uses Tweepy as the API client. The fetcher handles pagination and rate limit backoff automatically.
highlights
- +Twitter API v2 integration via Tweepy with automatic rate limit handling
- +Streamlit dashboard with keyword/account search, timeline charts, and raw data explorer
- +Ships with sample data so it runs without API credentials
- +Pagination handled transparently across all fetch operations
what was hard
Twitter API v2 access tiers changed significantly during development. What started as a free-tier project hit walls quickly. Most of the interesting data (full conversation threads, historical search) requires paid access. The project became more about working within constraints than the original scope.