Problem

They found the ProgrammableWeb directory, which is the largest API directory, however, the data was not available in any format to download.

Solution

Prepare a scraper to scrape the directory (with permission) and extract the data. Create a database and put the data into the database for easy access and processing. Carry out a preliminary analysis.