🚀 New: Agent Skills - extract any dataset using OpenWeb Ninja APIs with ready-to-use AI agent skills: View on GitHub

Product

4 min read

Introducing the OpenWeb Ninja Universal Scraper

Extract data from 35+ public web APIs using natural language - no API wiring, no boilerplate. Just describe what you want and Claude handles the rest.

April 5, 2026|By the OpenWeb Ninja Team

AI Agent · Claude Code · Data Extraction

We built OpenWeb Ninja to make public web data accessible - but getting data out of an API still takes work. You need to find the right endpoint, wire up auth, handle pagination, and write output logic. For every new use case, you start again.

Today we're releasing the OpenWeb Ninja Universal Scraper - a Claude Code skill that connects Claude directly to 35+ OpenWeb Ninja APIs. Describe what you want in plain language, and Claude selects the right API, runs the script, and returns results as JSON or CSV - ready to use, share, or pipe into your workflow.

What you can do with it

Lead generation

Find businesses, emails, phones, and social profiles by location or industry.

Market research

Search news, forums, reviews, and product listings across the web.

Competitor analysis

Scrape websites, compare pricing, and monitor reviews at scale.

Job & talent research

Search job listings, salary data, and company profiles.

Finance & real estate

Pull stock quotes, property listings, and Zillow estimates.

GEO tracking

Monitor how AI search engines (ChatGPT, Gemini, Copilot) reference your brand or topic.

Example prompts

Extract all dental clinics in Los Angeles with emails, phone numbers, and websites, and sync them to Airtable.
Analyze the top 20 wireless earbuds on Amazon US with full details and top 50 reviews per product, generate a sentiment summary, and save to S3.
Fetch the latest 50 "data engineer" jobs in Germany with salary estimates and company details, and export to Google Sheets.
Find 100 apartments for rent in New York under $3,000, including commute times to Times Square, and export to CSV.
Analyze sentiment for Spotify using the latest 50 reviews from Trustpilot and Glassdoor, and output a structured JSON report.

How it works

The skill lives in your Claude Code skills directory and gives Claude full knowledge of every API - endpoints, parameters, pagination, rate limits, and output formats. When you make a request, Claude picks the right API, constructs the call, and runs the script. No configuration needed per-request.

Under the hood, each API has its own scrape.js with full CLI support, so you can also run scripts directly from the terminal for scheduled jobs or automation pipelines.

# Ask Claude naturally

> "Find Italian restaurants in Chicago with emails"

> "Get the latest news about OpenAI"

> "Search Amazon for standing desks under $500, export to CSV"

# Or run scripts directly

node --env-file=.env apis/local-business-data/scrape.js \

--query "plumbers" --contacts --format csv

35+ APIs across 13 categories

Local & Maps: Local Business, Local Rank Tracker, Waze, EV Charge Finder, Driving Directions
E-commerce: Amazon, Product Search, Walmart, Costco
Jobs & Salaries: JSearch, Job Salary Data, Glassdoor
Reviews: Trustpilot, Yelp
News & Forums: Real-Time News, Forums Search
Search: Web Search, Image Search, Lens, Shorts, Autocomplete, Reverse Image
Social & Contacts: Website Contacts, Social Links, Email Search
Real Estate: Zillow
Finance: Real-Time Finance Data
Events & Books: Events Search, Books Data
Apps: Play Store Apps
AI Search / GEO: ChatGPT, Gemini, Copilot, AI Overviews, Google AI Mode
Web: Web Unblocker

Output anywhere

Results aren't limited to local files. The skill supports a range of output destinations out of the box.

Local JSON / CSVWebhook (Zapier, Make, n8n)AirtableSlackAWS S3FTPGoogle Sheets

Getting started

You need a RapidAPI key with subscriptions to the APIs you want to use, or an OpenWeb Ninja API key. Then install the skill and add your key to a .env file - that's it.

# 1. Add to Claude Code skills

~/.claude/skills/openwebninja-universal-scraper/

# 2. Install dependencies

cd ~/.claude/skills/openwebninja-universal-scraper && npm install

# 3. Add your API key to .env

RAPIDAPI_KEY=your_key_here

View on GitHub