I craft unique cereal names, stories, and ridiculously cute Cereal Baby images.

bsmi021_mcp-server-webscan
Espejo de https: //github.com/bsmi021/mcp-server-webscan
0
Github Watches
1
Github Forks
0
Github Stars
MCP Webscan Server
A Model Context Protocol (MCP) server for web content scanning and analysis. This server provides tools for fetching, analyzing, and extracting information from web pages.
Features
- Page Fetching: Convert web pages to Markdown for easy analysis
- Link Extraction: Extract and analyze links from web pages
- Site Crawling: Recursively crawl websites to discover content
- Link Checking: Identify broken links on web pages
- Pattern Matching: Find URLs matching specific patterns
- Sitemap Generation: Generate XML sitemaps for websites
Installation
# Clone the repository
git clone <repository-url>
cd mcp-server-webscan
# Install dependencies
npm install
# Build the project
npm run build
Usage
Starting the Server
npm start
The server runs on stdio transport, making it compatible with MCP clients like Claude Desktop.
Available Tools
-
fetch_page
- Fetches a web page and converts it to Markdown
- Parameters:
-
url
(required): URL of the page to fetch -
selector
(optional): CSS selector to target specific content
-
-
extract_links
- Extracts all links from a web page with their text
- Parameters:
-
url
(required): URL of the page to analyze -
baseUrl
(optional): Base URL to filter links
-
-
crawl_site
- Recursively crawls a website up to a specified depth
- Parameters:
-
url
(required): Starting URL to crawl -
maxDepth
(optional, default: 2): Maximum crawl depth
-
-
check_links
- Checks for broken links on a page
- Parameters:
-
url
(required): URL to check links for
-
-
find_patterns
- Finds URLs matching a specific pattern
- Parameters:
-
url
(required): URL to search in -
pattern
(required): Regex pattern to match URLs against
-
-
generate_sitemap
- Generates a simple XML sitemap
- Parameters:
-
url
(required): Root URL for sitemap -
maxUrls
(optional, default: 100): Maximum number of URLs to include
-
Example Usage with Claude Desktop
- Configure the server in your Claude Desktop settings:
{
"mcpServers": {
"webscan": {
"command": "node",
"args": ["path/to/mcp-server-webscan/dist/index.js"],
"env": {
"NODE_ENV": "development"
}
}
}
}
- Use the tools in your conversations:
Could you fetch the content from https://example.com and convert it to Markdown?
Development
Prerequisites
- Node.js >= 18
- npm
Project Structure
mcp-server-webscan/
├── src/
│ └── index.ts # Main server implementation
├── dist/ # Compiled JavaScript
├── package.json
└── tsconfig.json
Building
npm run build
Development Mode
npm run dev
Error Handling
The server implements comprehensive error handling:
- Invalid parameters
- Network errors
- Content parsing errors
- URL validation
All errors are properly formatted according to the MCP specification.
Contributing
- Fork the repository
- Create your feature branch (
git checkout -b feature/amazing-feature
) - Commit your changes (
git commit -m 'Add some amazing feature'
) - Push to the branch (
git push origin feature/amazing-feature
) - Open a Pull Request
License
MIT License - see the LICENSE file for details
相关推荐
I find academic articles and books for research and literature reviews.
Evaluator for marketplace product descriptions, checks for relevancy and keyword stuffing.
Confidential guide on numerology and astrology, based of GG33 Public information
Emulating Dr. Jordan B. Peterson's style in providing life advice and insights.
This GPT assists in finding a top-rated business CPA - local or virtual. We account for their qualifications, experience, testimonials and reviews. Business operators provide a short description of your business, services wanted, and city or state.
Your go-to expert in the Rust ecosystem, specializing in precise code interpretation, up-to-date crate version checking, and in-depth source code analysis. I offer accurate, context-aware insights for all your Rust programming questions.
Advanced software engineer GPT that excels through nailing the basics.
Descubra la colección más completa y actualizada de servidores MCP en el mercado. Este repositorio sirve como un centro centralizado, que ofrece un extenso catálogo de servidores MCP de código abierto y propietarios, completos con características, enlaces de documentación y colaboradores.
La aplicación AI de escritorio todo en uno y Docker con trapo incorporado, agentes de IA, creador de agentes sin código, compatibilidad de MCP y más.
Manipulación basada en Micrypthon I2C del expansor GPIO de la serie MCP, derivada de AdaFruit_MCP230xx
Espejo dehttps: //github.com/agentience/practices_mcp_server
Plataforma de automatización de flujo de trabajo de código justo con capacidades de IA nativas. Combine el edificio visual con código personalizado, auto-anfitrión o nube, más de 400 integraciones.
Una puerta de enlace de API unificada para integrar múltiples API de explorador de blockchain similar a Esterscan con soporte de protocolo de contexto modelo (MCP) para asistentes de IA.
Reviews

user_AQS54UFr
I have been using the MCP Server Testing Application by UdhayaParameshwaran-ai, and I am truly impressed. The tool is efficient and easy to use, providing accurate server testing results. The intuitive interface coupled with the welcome information makes the experience seamless. Highly recommend this product for anyone needing reliable server testing. Check it out here: https://mcp.so/server/mcp-server-tester/UdhayaParameshwaran-ai