Case study
Data automation & lead-gen systems
Data platforms and scraper operations for B2B lead generation, enrichment, deduplication, and reporting.
300+ tasks • 11 contributors
Challenge
Scrapers had to keep 7M+ records usable through target-site changes, proxy failures, migrations, and CRM syncs.
Outcome
Processed 7M+ records and 1M+ B2B leads for the DACH market.
Team mix: 5 backend, 2 frontend, 2 UI/UX, 1 DevOps, 1 QA.
My contribution
Coordinated scraper stability, data quality fixes, AWS/server migrations, database updates, client handoffs, and reporting workflows.
What shipped
- Pipelines that scraped 7M+ records and processed 1M+ B2B leads
- CRM enrichment and deduplication, synced to Pipedrive
- Looker Studio reporting
- Survived server migrations and repeated client handoffs
Stack
- Python
- Django
- AWS
- nginx
- Docker
- SQL
- web scraping
- database sync
- CSV exports
- Pipedrive
- Looker Studio