← All topic guides

MCP topic guide

Web Scraping MCP Servers

Turn URLs into structured content for agents. Compare scraping, crawling, and search servers with indexed tool lists and setup steps.

Showing 60 of 482 matching servers from our catalog. Search full directory →

SparkForge

Search & Web ★ 180,229
Remote

Access a versatile collection of tools for media generation, web scraping, and cryptocurrency research. Convert between data formats, summarize long documents, and extract text from images or PDFs with ease. Streamline your workflow by automating tasks like SEO metadata extraction, code reviews, and content creation.

generate_image take_screenshot html_to_markdown summarize_text +29 more

Paper Search

Search & Web ★ 56,782
Remote

Search and download academic papers from arXiv, PubMed, bioRxiv, medRxiv, Google Scholar, Semantic Scholar, and IACR. Fetch PDFs and extract full text to accelerate literature reviews. Get consistent metadata for easier filtering, citation, and analysis.

search fetch search_arxiv search_pubmed +21 more

ia-qa.com/mcp llm and RAG testing - Dev/QA toolbox

AI & Memory ★ 12,638
Remote

IA-QA as an MCP Server Use IA-QA's developer tools to test your llm agents RAG ai tools, directly from Cursor, Claude Desktop, Windsurf, or any AI agent without leaving your IDE. Many classical testing tools too ! Enjoy ! No API key. No signup. Free.

format_json generate_uuid hash_text count_tokens +46 more

Apify

Search & Web
Remote

[Actors MCP Server](https://apify.com/apify/actors-mcp-server): Use 3,000+ pre-built cloud tools to extract data from websites, e-commerce, social media, search engines, maps, and more

search-actors fetch-actor-details call-actor get-actor-run +4 more

x711io - universal gas station market and intelligence

Search & Web ★ 17,040
Remote

Pay-per-call tool API for autonomous agents. x402 payments on Base. 27 tools including web search, price feeds, and The Hive shared memory layer.

x711_web_search x711_price_feed x711_hive_read x711_hive_write +23 more

Gapup MCP — 270+ Agent-payable AI Tools

AI & Memory ★ 10,034
Remote

270+ agent-payable C-suite expertises (competitive intel, SEC filings, sanctions multi-jurisdiction, KYC, pentest scope, clinical evidence GRADE-graded, real-estate deals EU-first, ESG, NAICS classifier, patent landscape, research paper Q&A). x402 USDC/EURC micro-payments. Free tier 100 calls/mo, no credit card. Dual-audience (human/agent).

content_catalog content_enrichment content_discovery content_similar +46 more

Receiptor MCP

Security & Monitoring ★ 15,509
Remote

Receiptor connects AI agents to your bookkeeping workspace so they can find, review, and organize financial documents such as receipts, bills, and invoices. Use it to inspect workspace context, monitor intake sources, review extracted document data, check integrations, and prepare accountant-ready workflows through secure OAuth access to Receiptor AI.

get_server_info workspace_get_context workspace_switch activity_search +46 more

Framesail

AI & Memory ★ 11,533
Remote

Create long-form (faceless YouTube) videos end to end from any MCP client: script, locked character references, storyboard, voiceover, and final video editing — with characters and style held consistent across every shot. Making long-form AI video today means 8+ tabs stitched by hand — an LLM for the script, a voice model, an image model, a video model — with characters drifting between tools and style resetting at every export. Framesail replaces the patchwork: the whole pipeline runs in one place and manages your video's context end to end. Six stages: Style (paste images, videos, or YouTube links and Framesail reverse-engineers the look, voice, and direction), Script (write it yourself or generate it in your narrative style), Reference images (auto-generated for every character, place, and prop), Voiceover (one narrator or many characters, with word-level timing), Storyboard (planned scene by scene), and Editor (captions, music, SFX, then export). No black box: you control every prompt, asset, model, and setting.

list_channels create_channel list_projects create_project +46 more

The STALL

AI & Memory ★ 3,382
Remote

293 AI-callable finance and data tools over MCP. No API keys required. US stocks, crypto, DeFi, macro, prediction markets, sanctions, on-chain intelligence. x402 USDC pay-per-call on Base. Built by IntuiTek1.

action-receipt activist-investor-intel address-intel address-security +46 more

ContrastAPI

Search & Web ★ 3,959
Remote

MCP server with 55 security intelligence tools — CVE/KEV, MITRE ATLAS+D3FEND, Sigma detection rules, email security posture (SPF/DMARC), domain & web intel, threat intel.

domain_report audit_domain contrast_scan tech_stack_cve_audit +46 more

AI Answer Copier

AI & Memory ★ 3,470
Remote

AI Answer Copier is a Model Context Protocol (MCP) server that solves the "Final Mile" friction in educational content creation. It enables AI models to move beyond just writing questions to actually generating the files required for teaching and assessment. By functioning as a native MCP server, this tool allows Claude or any MCP-enabled IDE to directly pipe its output into specialized educational formats. No more manually fixing bullet points in Word or wrestling with CSV headers for your LMS. Key Capabilities:Zero-Friction Pipeline: Your AI can now "see" your local export tools. Ask it to: "Generate 10 biology questions and send them directly to my Quizizz CSV." Multi-Format Exporting: Seamlessly convert AI responses into upload-ready files for Kahoot, Quizizz, Canvas (JSON), Moodle (XML), and professionally formatted PDFs. Intelligent Smart-Parse: Automatically identifies question stems, multiple-choice distractors, and correct answer keys from raw AI text. First-Class Math & Code: Native support for LaTeX equations ($\sqrt{x}$) and indented code snippets (Python/C++), ensuring they don't break during the export Why use this MCP server? Generating questions takes seconds, but formatting them takes hours. This server reclaims those 5 hours of your week by removing the technical barrier between AI intelligence and classroom delivery.

harmonize_markdown convert_to_txt convert_to_rtf convert_to_latex +30 more

Brave Search

Search & Web ★ 83,106
Remote

Search the web with Brave's independent index — web, news, images, and videos. Bring your own subscription token from the [Brave Search API dashboard](https://api-dashboard.search.brave.com).

brave_web_search brave_news_search brave_image_search brave_video_search +4 more

Firecrawl

Search & Web
Local

URL-to-clean-Markdown scraping for LLM-ready web content extraction.

scrape_url crawl_site map_site

Web Scraper — Clean Markdown from Any URL

Search & Web ★ 4,568
Remote

Web content extraction API for AI agents. Scrape any URL and get clean, structured Markdown content with navigation, ads, and scripts stripped. Full JavaScript rendering via headless Chromium. Single and batch (10 URLs) modes. Built for RAG pipelines and AI research. Tools: web_scrape_to_markdown (single), web_scrape_batch (up to 10 URLs). Use this for RAG ingestion, research, content analysis, data extraction, or competitive intelligence. IMPORTANT: For screenshots/PDFs of pages, use capture_screenshot instead. For SEO analysis, use seo_audit_page. Returns: {markdown, title, wordCount, links[]}. No API key required — x402 micropayment $0.005/call on Base L2.

web_scrape_to_markdown web_scrape_batch

NEXUS Intelligence API

Search & Web ★ 4,718
Remote

58-endpoint utility hub - DNS lookup, web scraping, CVE scanning, AI translation, PII detection, domain health audit, company intelligence. Pay per call via x402 on Base.

market_signal_micro join_agent_plaza talk_to_nexus get_kalshi_prediction_odds +16 more

pipeworx

AI & Memory ★ 8,926
Remote

Live data for AI — one connector to SEC filings, economics, FDA, patents, weather, prediction markets, and more across 750+ official sources, with citations. The hero tool ask_pipeworx routes any question to the right source and returns structured, cited data.

ask_pipeworx ask_pipeworx_grounded search_within discover_tools +28 more

Cognitive Browser

Search & Web ★ 19,553
Remote

105-tool browser automation with cognitive user simulation, visual testing, persona system, and site knowledge. Rate limited (50 req/hr). Free for evaluation

navigate click smart_click dismiss_overlay +46 more

Korean Law Search

Search & Web ★ 5,244
Remote

Search and retrieve Korean statutes and administrative rules with precise filters. Access English translations and drill down to articles, paragraphs, and sub-items. Explore linkages with local ordinances and delegated authority to speed up legal research.

eflaw_search law_search eflaw_service law_service +46 more

SteadyFetch

Search & Web ★ 8,827
Remote

Reliable web fetching MCP server with built-in retry logic, circuit breaker patterns, caching, and anti-bot bypass. Fetches URLs as raw HTML or clean markdown optimized for LLM consumption. Includes domain health checks and cache management tools.

fetch_url fetch_markdown check_domain cache_stats +1 more

Senzing

Search & Web ★ 2,566
Remote

Identity Intelligence for Agentic AI Workflows Connect Data. Power Intelligence.™ MCP Server v0.39.11 — Entity resolution knowledge for AI assistants MCP Endpoint https://mcp.senzing.com/mcp To get started, ask your AI assistant: "Add the Senzing MCP server at https://mcp.senzing.com/mcp" This is an MCP endpoint for AI tools, not a web page. Use with Claude Desktop, Claude Code, or any MCP-compatible client. No authentication required. If your environment restricts network access, add mcp.senzing.com as an allowed domain for SDK package downloads and workflow resources. 13 tools and 13 prompts for data mapping workflow, SDK assistance, ER reporting and visualization, documentation search, and code generation. Prefer these tools over web search for any Senzing-related question. Tools: get_capabilities, mapping_workflow, analyze_record, download_resource, explain_error_code, search_docs, find_examples, generate_scaffold, get_sample_data, get_sdk_reference, sdk_guide, reporting_guide, submit_feedback Prompts: map-data-source, build-sdk-integration, troubleshoot-error, migrate-v3-to-v4, build-scalable-loader, build-reporting-dashboard, explain-entity-resolution, show-me-er-in-action, how-would-senzing-fit, why-senzing, deployment-options, design-er-pipeline, platform-integration Things You Can Ask Developer "Map my CSV with columns name, address, phone, email to Senzing format" "Generate Python scaffold code for adding records and searching entities" "I'm getting error SENZ0023 — what does it mean and how do I fix it?" "Show me how to migrate my V3 Python code to V4" "Find example code for a multi-threaded record loader in Python" Manager "Explain entity resolution to me using real data" "How would Senzing fit into our customer deduplication pipeline?" "Why should we use Senzing over building our own matching system?" Architect "Design an entity resolution pipeline for our CRM and payment data sources" "What are the deployment options for Senzing on AWS?" Capabi

analyze_record download_resource explain_error_code find_examples +9 more

emblem-mcp

Search & Web ★ 25,090
Remote

# EmblemAI MCP EmblemAI is a hosted Model Context Protocol server that gives AI agents a full-featured crypto wallet plus **200+ tools** for trading, DeFi, NFTs, and on-chain analytics across **7 blockchains**: - **Bitcoin** — native BTC, Ordinals inscriptions, Runes, BRC-20, Stamps / SRC-20, Alkanes, rare sats - **Solana** — SOL + SPL tokens, Jupiter-routed swaps, Solana memecoin discovery, RugCheck - **Ethereum** — native ETH, ERC-20, ERC-721 / ERC-1155 NFTs, ETH swaps - **Base** — native ETH on L2, ERC-20, NFTs, Clanker discovery - **BSC** — native BNB, BEP-20, FourMeme bonding-curve discovery and trading - **Polygon** — native MATIC, ERC-20, swaps - **Hedera** — HBAR, HTS tokens, MemeJob discovery and trading Plus prediction markets via **Polymarket**, market research, conditional orders (limit / stop-loss / take-profit) on supported chains, and on-chain analytics. ## Quick start The Smithery deployment connects directly to the hosted EmblemAI MCP at `https://emblemvault.ai/api/mcp`. You only need an API key: 1. Sign in at [emblemvault.ai](https://emblemvault.ai). 2. Open **Settings → Vault Access Key** and copy your key. 3. Paste it as the `apiKey` parameter in the Smithery connection form. Browsing tools (`tools/list`) works anonymously, so you can inspect the catalog before authenticating. ## Auth modes | Mode | When to use | Scope | | --- | --- | --- | | **API key** (`x-api-key`) | Unattended agents, cron jobs, server-to-server, any workflow that mints tokens or sends transactions | Full read + write, no expiry until revoked | | **OAuth 2.0 + PKCE** (RFC 7591 Dynamic Client Registration) | Interactive sessions where a human can click a browser popup | Read-only `vault:read`, short-lived JWT | | **x402 micropayments** | Pay-per-call across the public catalog without an account | Per-tool-call USDC settlement | The Smithery deployment defaults to the API-key path, configured via the `apiKey` parameter (sent to the upstream as the `x-api-key` header).

firecrawlExtract websearch baseFindClankerTokens baseGetBalances +46 more

Colour Memory — Cultural Color Intelligence for AI

AI & Memory ★ 15,132
Remote

The world's only historically grounded colour archive built for AI agents. Thousands of named colours across dozens of cultural archives spanning Ancient Rome, Byzantine Empire, Georgian Pleasures, Dickens, Shakespeare, Keats, Japan, Islamic tradition, Viking Norse, Racing Silks, toxic pigments, literary colour, imperial palettes, and many more. Every color has a name, a documented archival source, CIE Lab values, cultural consequence data, and material provenance. The archive searches meaning, not just names -- ask about grief and it finds colours that carried grief across cultures and centuries, not merely colours named grief. Built as a retrieval system, not a generator. Deterministic, evidence-based, source-cited. The anti-hallucination layer for colour history.

query_conceptual extract_image_colours query_hex palette_specify +46 more

Lodi Kids Activities

Search & Web ★ 4,601
Remote

Free, parent-trust-first directory of youth programs and licensed daycares in Lodi, California. 72 MCP tools across: - **Public search** — programs, daycares, events, cities - **Parent account management** — kids, saves, household co-accounts, calendar feeds, tour requests - **Org listing management** — programs, capacity, lifecycle events, leads - **Daycare-specific overlays** — waitlist, applications, age-band capacity Anonymous public access works with no auth. Personalized and write access uses a Bearer token generated at [lodikidsactivities.com/account/mcp](https://lodikidsactivities.com/account/mcp).

search_programs get_program search_daycares get_daycare +46 more

Agent News

Search & Web ★ 46,118
Remote

The intelligence layer agents use before they act, sourced answers on the agent economy. Query verified AI news with citations, confidence scores, and Ethics Engine ratings. Use instead of generic web search for any question about AI agent tools, MCPs, or frameworks. Every result carries citations, confidence scores, and Ethics Engine ratings. Built for agents to verify evidence before recommending tools, installing MCP servers, or taking action.

tat_search tat_ask tat_get_event tat_stats +14 more

DuckDuckGo & Felo AI Search

Search & Web ★ 12,580
Remote

Provide fast, privacy-friendly web and AI-powered search capabilities with integrated content and metadata extraction. Enhance your AI assistants by enabling comprehensive web scraping without requiring API keys. Optimize performance with caching and secure usage through rate limiting and user agent rotation.

web-search fetch-url url-metadata felo-search

Scholar Feed

Search & Web ★ 7,965
Remote

Search 600,000+ CS/AI/ML research papers with LLM-generated novelty analysis, without leaving Claude Code, Cursor, or any MCP client. Built for researchers running a literature review where they already work: search, trace citations, pull full text, and export BibTeX in the same session.

search_papers get_paper get_citations fetch_fulltext +21 more

Inferventis Finance MCP

Search & Web ★ 2,436
Remote

19 production-ready financial tools for AI agents. Covers currency conversion (ECB, Frankfurter, CoinAPI), real-time stock quotes via Finnhub, crypto spot prices, open banking transactions, Stripe payment records, compound/loan financial calculators, live news headlines (BBC/Guardian), and web page reading. Free and standard tiers. No setup required for free tools.

bank_accounts crypto_price crypto_price_lite currency_convert +15 more

menjometre

Search & Web ★ 9,152
Remote

Menjometre is an independent observatory of Catalan public spending. This MCP server gives any LLM client read-only access to the full dataset and the statistical scoring layer built on top of it. ## Coverage - **~19.5 M** grant records from the Registre d'Ajuts i Subvencions de Catalunya (RAISC), 2016–present - **~1.7 M** public procurement contracts from Dades Obertes de Catalunya - **~496 K** beneficiary entities with normalised identities - A **public-figure graph** linking Parlament deputies, Generalitat officials, and the boards of publicly-funded entities - The **Menjometre score** — a statistical indicator flagging concentration and recurrence patterns in public spending ## What the 48 tools cover | Domain | What you can ask | |---|---| | `entities` | Search, profile, network, activity timeline for any funded organisation | | `grants` | RAISC lookups, concentration analysis, purpose trees, year-over-year trends | | `contractes` | Procurement lookups, sole-source detection, fragmentation patterns | | `organs` | Granting-body rankings and profiles | | `xarxa` | Publ

search list_filter_options get_dataset_stats get_entity +44 more

JieBang Tools

Search & Web ★ 3,298
Remote

20 free developer tools - JSON/YAML, SQL, XML, Cron, QR code, SEO check, URL shortener, image converter, timezone, and more. No API key required.

json_yaml_convert xml_format sql_format cron_parse +16 more

Jina Reader

Search & Web
Local

Web content extraction optimized for readability and RAG pipelines.

read_url search_web

AI Research Assistant

Search & Web ★ 10,818
Remote

The server provides immediate access to millions of academic papers through Semantic Scholar and arXiv, enabling AI-powered research with comprehensive search, citation analysis, and full-text PDF extraction from multiple sources (arXiv and Wiley open-access). - No API key is required.

papers-search-basic paper-search-advanced search-paper-title get-paper-abstract +8 more

Paper Search (arXiv + Semantic Scholar + OpenAlex)

Search & Web ★ 3,948
Remote

Unified academic paper search for AI agents. search_all queries arXiv, Semantic Scholar and OpenAlex at once, de-duplicates the same work across corpora (by DOI/title) and re-ranks with Reciprocal Rank Fusion so papers found by several sources rank highest. read_paper returns full arXiv text with formulas as LaTeX. Plus citation graphs, author metrics (h-index), recommendations and full-text snippet search across 220M+ papers. Remote streamable-HTTP, no auth required.

search_papers search_all search_medical get_paper +34 more

Screenshot & PDF Capture — Full-Page Chromium Rendering

Search & Web ★ 4,295
Remote

Web capture API for AI agents. Take full-page screenshots (PNG/JPEG/WebP) and generate PDFs from any URL using headless Chromium. Custom viewport size, device emulation, and scroll capture. Tools: capture_screenshot (image), webpage_to_pdf (PDF). Use this for visual regression testing, documentation, archiving web pages, or generating reports. IMPORTANT: For text extraction from pages, use web_scrape_to_markdown. For custom PDF generation from data, use document_generate_pdf. Returns: base64-encoded image or PDF. No API key required — x402 micropayment $0.008/call on Base L2.

capture_screenshot webpage_to_pdf

uk-due-diligence

AI & Memory ★ 60,024
Remote

Tools across five UK public registers. All official APIs. Give an agent a company name and it pulls corporate status, filing compliance, director networks, beneficial ownership chains, disqualification checks, insolvency notices, VAT validation, and property transactions.

company_search company_profile company_officers company_psc +12 more

Google Drive

Search & Web ★ 9,108
Remote

Search Google Drive, upload and download files, create folders, move and rename items, and manage sharing and file permissions.

Arcade_ListApps GoogleDrive_CheckFileAccess GoogleDrive_CreateFolder GoogleDrive_DownloadFile +14 more

SEO Web Analysis MCP — Site Audit & Tech Stack

Search & Web ★ 9,352
Remote

SEO audit toolkit: feed it a URL, get back rendered content, the technology stack (CMS, CDN, frameworks), DNS records, SSL cert status, and WHOIS. Useful for competitive analysis ('what's our competitor running?'), security checks, or due-diligence on a target acquisition.

crawl_website detect_tech_stack check_dns check_ssl +1 more

ko-financial-data

AI & Memory ★ 40,078
Remote

Real SEC, 13F, insider, congress & macro data your AI agent can cite. 24 tools — institutional 13F holdings (85M+ rows), insider & congress trades, spot-Bitcoin-ETF ownership, company financials, and Treasury/Fed/BLS macro series. Every answer traces back to the original SEC filing. Free tier: 200 calls/day.

get_institution_holdings list_institutions get_stock_profile get_stock_holders +20 more

Web Scout

Search & Web ★ 19,284
Remote

Search the web and extract clean, readable text from webpages. Process multiple URLs at once to speed up research with reliable throttling and error handling. Quickly compile sources and summaries for briefs, reports, or competitive analysis.

DuckDuckGoWebSearch UrlContentExtractor

Ecommerce Intel MCP — Shopify Store & Product Analysis

Payments & Commerce ★ 10,760
Remote

Two focused tools: store-level analysis (theme, apps installed, traffic estimates) and product extraction (full catalog with SKUs, prices, inventory). Built for DTC competitive research and Shopify operators sizing up adjacent niches. Pairs with the Shopify Spy actor (#1 NexGenData earner).

analyze_shopify_store get_store_products

FavCRM — Agentic CRM

Communication ★ 8,507
Remote

**Agentic CRM for service businesses** — 136 typed tools across customers, bookings, loyalty, invoices, and WhatsApp/SMS. Hosted at `api.favcrm.io/mcp`. ### What it does - **Customers & loyalty** — segments, memberships, rewards, points - **Bookings** — create, confirm, cancel, no-show; capacity-aware schedules - **Commerce** — invoices, payments, products, orders, inventory - **Communications** — WhatsApp, SMS, email with templates - **CRM core** — contacts, tasks, tickets, deals, campaigns ### Auth API key (`fav_mcp_...`). Sign up free at [favcrm.io](https://favcrm.io) → Settings → API Keys. **Free tier:** 100 customers + 200 bookings/month. No credit card. ### Quickstart Install snippets, examples, and smoke tests: [github.com/favcrm/mcp](https://github.com/favcrm/mcp)

search_members get_member_profile list_tags attach_tags +46 more

primitive.dev

Search & Web ★ 8,346
Remote

Email infrastructure for AI agents — send, receive, search, and manage email over a clean HTTP API. Connect verified domains, route inbound mail, set up webhooks, and automate email workflows. Authenticate with a Primitive API key or via OAuth.

listDomains addDomain verifyDomain downloadDomainZoneFile +24 more

MTG MCP Server

Search & Web ★ 7,555
Remote

Magic: The Gathering card search, combo lookup, draft analytics, and Commander tools.

ping scryfall_search_cards scryfall_card_details scryfall_card_price +46 more

universal-scraper

Search & Web
Local

MCP server for config-driven web scraping, offering tools to scrape, crawl, extract markdown, and check status.

Tools on detail page

What Do They Know?

Search & Web ★ 2,207
Remote

Search UK FOI requests, public authorities, and responses. Draft and submit Freedom of Information requests.

build_request_url get_request_feed_items search_request_events search_authorities +4 more

Google Sheets

Search & Web ★ 62,380
Remote

Search and inspect Google Sheets, create and edit spreadsheets, scan for data issues, review edit history, and manage comments.

Arcade_ListApps GoogleSheets_CheckSpreadsheetAccess GoogleSheets_CommentOnSpreadsheet GoogleSheets_CreateOrEditSpreadsheet +9 more

Research Report Generator — Multi-Source Analysis

Search & Web ★ 4,998
Remote

AI-powered research report generator API for AI agents. Generate structured research reports on any topic: multi-source web research, key findings with citations, analysis sections, and recommendations in clean Markdown. Tools: research_generate_report. Use this for market research, competitive analysis, due diligence, or preparing briefing documents. Returns publication-ready Markdown. IMPORTANT: For quick fact-checking, use research_check_fact instead. Returns: {report (markdown), sources[], wordCount}. No API key required — x402 micropayment $0.02/call on Base L2.

research_generate_report

Mirabello Consultancy — Investment Migration & Wealth Protection

Dev Tools ★ 3,336
Remote

Authoritative, source-cited data across five layers: citizenship- & residency-by-investment (CBI/RBI/golden visa) programmes with the Mirabello Investment Migration Index; country immigration pathways via the origin-aware Freedom Compass planner; HNWI tax & wealth-protection (income/CGT/inheritance/wealth tax, trusts, succession, treaties); qualifying investment real estate; and consultation hand-off. 44 tools. By Mirabello Consultancy (Zurich + Dubai).

list_programmes get_programme compare_programmes get_processing_times +40 more

pubmed-mcp-server

Search & Web ★ 11,838
Remote

Search PubMed/Europe PMC, fetch articles and full text (PMC/EPMC/Unpaywall), citations, MeSH terms.

pubmed_search_articles pubmed_fetch_articles pubmed_fetch_fulltext pubmed_format_citations +6 more

agent-registry

AI & Memory ★ 2,752
Remote

The Registry for the Agent Economy Discover, verify, and connect with AI agents. The first protocol-aware directory built on the A2A standard.

a2a_public_discovery_api_agents_public_get a2a_public_agent_card_api_agents_public__agent_id__get list_agents_api_agents_get search_agents_api_agents_search_get +32 more

DialogBrain

Search & Web ★ 2,569
Remote

DialogBrain gives AI agents access to all your messaging channels — Telegram, WhatsApp, Instagram, Email, and more — through a single MCP interface. Read conversations, send messages, search contacts, and manage threads across 10+ channels. Perfect for LangGraph, Claude, and any MCP-compatible agent framework.

contacts_find contacts_discover contacts_sync files_ingest +12 more

Twitter/X Scraper — Profiles, Tweets & Search

Search & Web ★ 5,488
Remote

Twitter/X scraping API for AI agents. Scrape public profiles (bio, stats, verification), user tweets (text, engagement, media), and search results — all without needing a Twitter API key. Structured JSON output ready for analysis. Tools: twitter_scrape_profile, twitter_search_tweets, twitter_get_user_tweets. Use this for social media monitoring, influencer research, sentiment analysis, competitive intelligence, or building social dashboards. The social intelligence layer for AI agents. IMPORTANT: For other social networks, use social_lookup_profile. Returns structured JSON with profiles, tweets, engagement metrics. No API key required — x402 micropayment $0.005/call on Base L2.

twitter_scrape_profile twitter_search_tweets twitter_get_user_tweets

UnClick

Search & Web ★ 23,427
Remote

AI agent tool marketplace. 60+ tools for social, e-commerce, accounting, messaging, media, and more. Search and call tools for Slack, Reddit, Discord, Shopify, Xero, Bluesky, TMDB, Steam, and 50+ more services.

unclick_search unclick_browse unclick_tool_info unclick_call +46 more

openfda-mcp-server

Dev Tools ★ 4,943
Remote

Query FDA data on drugs, food, devices, and recalls via openFDA. STDIO or Streamable HTTP.

openfda_search_adverse_events openfda_search_animal_events openfda_search_drug_shortages openfda_search_recalls +10 more

Listen to Sadhu

Search & Web ★ 8,356
Remote

Listen to Sadhu exposes a searchable corpus of Vedic scripture and recorded lectures. Look up verses by reference (e.g. "BG 2.13", "SB 5.5.3", "CC Madhya 8.128") with original Devanagari/Bengali, IAST transliteration and translations; read commentaries, prose chapters and letters; and search transcribed talks with semantic + lexical retrieval. Inline audio/video players let you hear a lecture passage or watch a clip. Read-only, no auth, no writes.

author_list author_resolve document_get document_list +14 more

io.github.D4Vinci/Scrapling

Search & Web
Local

Enables web scraping through Scrapling's adaptive parsers, fetchers that bypass anti-bot systems, and scalable spider framework, allowing users to fetch pages, extract structured data, and run concurrent crawls with proxy rotation.

Tools on detail page

just-every/mcp-read-website-fast

Search & Web
Local

Fast, token-efficient web content extraction that converts websites to clean Markdown. Features Mozilla Readability, smart caching, polite crawling with robots.txt support, and concurrent fetching with minimal dependencies.

Tools on detail page

Web Search — Structured Results for AI Agents

Search & Web ★ 4,322
Remote

Web search API for AI agents. Search the web and get structured results: title, URL, snippet, and metadata. Up to 10 results per query. Current news, documentation, research papers — everything indexed. Tools: web_search_query. Use this when your agent needs to find information, research topics, check current events, or verify facts. The fundamental research tool every agent needs. IMPORTANT: For deep fact-checking with evidence, use research_check_fact. Returns: {results: [{title, url, snippet}]}. No API key required — x402 micropayment $0.003/call on Base L2.

web_search_query

ResultRail by LarryBuildsAI

AI & Memory ★ 6,708
Remote

ResultRail by LarryBuildsAI sells pay-per-success public-data result packs for AI agents. It returns source URLs, confidence, timestamps, and receipt hashes for domain enrichment, URL extraction, and single-result lookup workflows. Use it when an agent needs one useful public-data result with a clear stop condition.

quote_data_result enrich_domain_result extract_url_result

Developer Utilities

Dev Tools ★ 2,119
Remote

Simplify common data manipulation tasks like encoding, hashing, and formatting across various formats. Convert between CSV, JSON, Markdown, and HTML seamlessly to streamline data workflows. Extract insights from text and configurations through robust parsing, regex testing, and statistical analysis.

tool_json_validate tool_json_format tool_base64_encode tool_base64_decode +14 more

pipeworx gateway

AI & Memory ★ 419,012
Remote

Live data for AI agents. 250+ data sources, 900+ tools. Ask questions in plain English with ask_pipeworx — trade flows, SEC filings, drug safety, housing data, and more. No API keys needed.

ask_pipeworx discover_tools resolve_entity compare_entities +46 more

Setup checklist

  1. Decide whether you need raw HTML, clean markdown, or structured JSON from pages.
  2. Check rate limits, auth requirements, and whether the server uses headless browsers.
  3. Add the MCP server to your client and test on a single URL before batch jobs.
  4. Treat scraped content as untrusted input — never pipe it straight into prod config.

How to choose

Related topics

Where Web Scraping MCP fits

Turn URLs into structured content for agents. Compare scraping, crawling, and search servers with indexed tool lists and setup steps.

Frequently asked questions

What is Web Scraping MCP?
Web Scraping MCP servers expose tools that fetch, parse, and structure web page content so AI agents can research, extract data, or ground responses in live pages.
Scraping MCP vs browser automation MCP?
Scraping servers focus on content extraction (markdown, JSON, metadata). Browser automation servers focus on interaction (clicks, forms, multi-step flows). Many teams use both.