CrawlForge
Api Reference
API Reference

CrawlForge MCP API Reference

Complete reference for all 18 CrawlForge MCP tools. Build powerful web scraping applications with our developer-first API.

API Overview

Base URL
https://crawlforge.dev/api/v1
Authentication

All API requests require an API key passed in the X-API-Key header:

Bash

Get your API key from the dashboard.

Request Format

All tool endpoints accept JSON in the request body:

Json
Response Format

All responses follow a standard format:

Json

HTTP Status Codes

CodeDescription
200OK - Request successful
400Bad Request - Invalid parameters
401Unauthorized - Invalid or missing API key
402Payment Required - Insufficient credits
429Too Many Requests - Rate limit exceeded
500Internal Server Error

Rate Limits

Rate limits apply per API key and vary by plan. Exceeding the limit returns a 429 Too Many Requests response.
Free Plan
2 requests per second
Hobby Plan
5 requests per second
Professional Plan
20 requests per second
Business Plan
50 requests per second

All Tools

Basic Tools

1-2 credits
fetch_url
1 credit
Fetch and parse web pages with automatic handling
extract_text
1 credit
Extract clean text from HTML with intelligent parsing
extract_links
1 credit
Discover and extract all links from a webpage
extract_metadata
1 credit
Extract page metadata, OpenGraph, and Twitter Card tags
scrape_structured
2 credits
Extract structured data using CSS selectors
extract_content
2 credits
Extract main content from web pages with readability detection
map_site
2 credits
Discover and map website structure and URLs
process_document
2 credits
Process documents from multiple formats including PDFs
localization
2 credits
Multi-language and geo-location management for scraping

Advanced Tools

3-5 credits
monitor_changes
3 credits
Monitor web pages for content changes with intelligent detection
analyze_content
3 credits
Analyze content for sentiment, language, and topics
summarize_content
4 credits
Generate intelligent summaries of text content
crawl_deep
4 credits
Deep website crawling using breadth-first search
stealth_mode
5 credits
Anti-detection browser management with fingerprint randomization
scrape_with_actions
5 credits
Execute browser actions before scraping (clicks, forms, etc.)
batch_scrape
5 credits
Process multiple URLs simultaneously with async job management
search_web
5 credits
Search the web using Google Custom Search API

Premium Tools

10 credits
deep_research
10 credits
Multi-stage research with AI synthesis and source verification

Error Handling

All errors follow a standard format with error.code and error.message fields.
Json

See the Error Reference for a complete list of error codes and solutions.

Ready to start building?
Pick a tool and explore its documentation
View Tool DocsBack to Getting Started