This article is written by Lukas Prokein, frontend engineer at Thinknum. We started crawling the web in 2014, and to-date have aggregated alternative data on 500,000 companies worldwide. Our users (300+ investment firms, hedge funds, internet companies and more) access these datasets via UI and an API.
If you’re interested in data engineering work check out Thinknum’s career page for our open positions (remote and based in NYC).
In this blog post I'll go through the process of creating a scraper for the REST API used by a food delivery mobile app, when there's no web interface