mcp/scrapegraph

Verified Publisher

By mcp

Updated 8 months ago

ScapeGraph MCP Server

Image
Machine learning & AI
4

10K+

mcp/scrapegraph repository overview

ScrapeGraph MCP Server

ScapeGraph MCP Server.

What is an MCP Server?

MCP Info

Image Building Info

AttributeDetails
Dockerfilehttps://github.com/ScrapeGraphAI/scrapegraph-mcp/blob/3579efb4afc8b23a7a968021995a321142118bfc/Dockerfile
Commit3579efb4afc8b23a7a968021995a321142118bfc
Docker Image built byDocker Inc.
Docker Scout Health ScoreDocker Scout Health Score
Verify SignatureCOSIGN_REPOSITORY=mcp/signatures cosign verify mcp/scrapegraph --key https://raw.githubusercontent.com/docker/keyring/refs/heads/main/public/mcp/latest.pub
LicenceMIT License

Available Tools (8)

Tools provided by this ServerShort Description
agentic_scrapperExecute complex multi-step web scraping workflows with AI-powered automation.
markdownifyConvert a webpage into clean, formatted markdown.
scrapeFetch raw page content from any URL with optional JavaScript rendering.
searchscraperPerform AI-powered web searches with structured data extraction.
sitemapExtract and discover the complete sitemap structure of any website.
smartcrawler_fetch_resultsRetrieve the results of an asynchronous SmartCrawler operation.
smartcrawler_initiateInitiate an asynchronous multi-page web crawling operation with AI extraction or markdown conversion.
smartscraperExtract structured data from a webpage, HTML, or markdown using AI-powered extraction.

Tools Details

Tool: agentic_scrapper

Execute complex multi-step web scraping workflows with AI-powered automation.

This tool runs an intelligent agent that can navigate websites, interact with forms and buttons, follow multi-step workflows, and extract structured data. Ideal for complex scraping scenarios requiring user interaction simulation, form submissions, or multi-page navigation flows. Supports custom output schemas and step-by-step instructions. Variable credit cost based on complexity. Can perform actions on the website (non-read-only, non-idempotent).

The agent accepts flexible input formats for steps (list or JSON string) and output_schema (dict or JSON string) to accommodate different client implementations.

ParametersTypeDescription
urlstring
ai_extractionstring optional
output_schemastring optional
persistent_sessionstring optional
stepsstring optional
timeout_secondsstring optional
user_promptstring optional

Tool: markdownify

Convert a webpage into clean, formatted markdown.

This tool fetches any webpage and converts its content into clean, readable markdown format. Useful for extracting content from documentation, articles, and web pages for further processing. Costs 2 credits per page. Read-only operation with no side effects.

ParametersTypeDescription
website_urlstring

This tool is read-only. It does not modify its environment.


Tool: scrape

Fetch raw page content from any URL with optional JavaScript rendering.

This tool performs basic web scraping to retrieve the raw HTML content of a webpage. Optionally enable JavaScript rendering for Single Page Applications (SPAs) and sites with heavy client-side rendering. Lower cost than AI extraction (1 credit/page). Read-only operation with no side effects.

ParametersTypeDescription
website_urlstring
render_heavy_jsstring optional

This tool is read-only. It does not modify its environment.


Tool: searchscraper

Perform AI-powered web searches with structured data extraction.

This tool searches the web based on your query and uses AI to extract structured information from the search results. Ideal for research, competitive analysis, and gathering information from multiple sources. Each website searched costs 10 credits (default 3 websites = 30 credits). Read-only operation but results may vary over time (non-idempotent).

ParametersTypeDescription
user_promptstring
num_resultsstring optional
number_of_scrollsstring optional

This tool is read-only. It does not modify its environment.


Tool: sitemap

Extract and discover the complete sitemap structure of any website.

This tool automatically discovers all accessible URLs and pages within a website, providing a comprehensive map of the site's structure. Useful for understanding site architecture before crawling or for discovering all available content. Very cost-effective at 1 credit per request. Read-only operation with no side effects.

ParametersTypeDescription
website_urlstring

This tool is read-only. It does not modify its environment.


Tool: smartcrawler_fetch_results

Retrieve the results of an asynchronous SmartCrawler operation.

This tool fetches the results from a previously initiated crawling operation using the request_id. The crawl request processes asynchronously in the background. Keep polling this endpoint until the status field indicates 'completed'. While processing, you'll receive status updates. Read-only operation that safely retrieves results without side effects.

ParametersTypeDescription
request_idstringThe unique request ID returned by smartcrawler_initiate. Use this to retrieve the crawling results. Keep polling until status is 'completed'. Example: 'req_abc123xyz'

This tool is read-only. It does not modify its environment.


Tool: smartcrawler_initiate

Initiate an asynchronous multi-page web crawling operation with AI extraction or markdown conversion.

This tool starts an intelligent crawler that discovers and processes multiple pages from a starting URL. Choose between AI Extraction Mode (10 credits/page) for structured data or Markdown Mode (2 credits/page) for content conversion. The operation is asynchronous - use smartcrawler_fetch_results to retrieve results. Creates a new crawl request (non-idempotent, non-read-only).

SmartCrawler supports two modes:

  • AI Extraction Mode: Extracts structured data based on your prompt from every crawled page
  • Markdown Conversion Mode: Converts each page to clean markdown format Parameters|Type|Description -|-|- url|string| depth|string optional| extraction_mode|string optional| max_pages|string optional| prompt|string optional| same_domain_only|string optional|

Tool: smartscraper

Extract structured data from a webpage, HTML, or markdown using AI-powered extraction.

This tool uses advanced AI to understand your natural language prompt and extract specific
structured data from web content. Supports three input modes: URL scraping, local HTML processing,
or local markdown processing. Ideal for extracting product information, contact details,
article metadata, or any structured content. Costs 10 credits per page. Read-only operation.
ParametersTypeDescription
user_promptstring
number_of_scrollsstring optional
output_schemastring optional
render_heavy_jsstring optional
stealthstring optional
total_pagesstring optional
website_htmlstring optional
website_markdownstring optional
website_urlstring optional

This tool is read-only. It does not modify its environment.


Use this MCP Server

{
  "mcpServers": {
    "scrapegraph": {
      "command": "docker",
      "args": [
        "run",
        "-i",
        "--rm",
        "-e",
        "SGAI_API_KEY",
        "mcp/scrapegraph"
      ],
      "env": {
        "SGAI_API_KEY": "YOUR_SGAI_API_KEY"
      }
    }
  }
}

Why is it safer to run MCP Servers with Docker?

Install from MCP:Hub

Tag summary

Content type

Image

Digest

sha256:43e315d80

Size

72.9 MB

Last updated

8 months ago

docker pull mcp/scrapegraph

This week's pulls

Pulls:

1,093

Last week