The Olostep MCP server provides web scraping, content extraction, and structured Google search capabilities through integration with the Olostep platform.
Core Tools:
Web Content Extraction (
get_webpage_content) - Retrieves webpage content in clean markdown format with JavaScript rendering support and configurable wait times for dynamic sitesWebsite URL Discovery (
get_website_urls) - Discovers and maps URLs from any website, sorted by relevance to a search queryGoogle Search (
google_search) - Executes searches with structured data including organic results, knowledge graph information, People Also Ask questions, related searches, and rich snippets
Key Features:
Geo-targeted requests through specific countries (US, CA, GB, etc.) for localized content and search results
Comprehensive error handling for API issues, authentication failures, network errors, and rate limits
Simple authentication via
OLOSTEP_API_KEYenvironment variableCompatible with Claude Desktop, Windsurf, Cursor, and Metorial
Provides structured data from Google search results through the google_search tool, including organic search results, knowledge graph data, and related questions
Supports waiting for JavaScript-heavy websites to render before scraping content, with configurable wait times
Retrieves webpage content in clean markdown format for easier consumption and formatting
Olostep MCP Server
A Model Context Protocol (MCP) server implementation that integrates with Olostep for web scraping, content extraction, and search capabilities. To set up Olostep MCP Server, you need to have an API key. You can get the API key by signing up on the Olostep website.
Features
Web page content extraction with clean markdown formatting
Google search results with structured data extraction
Website URL discovery and mapping
Country-specific request routing for geo-targeted content
Configurable wait times for JavaScript-heavy websites
Comprehensive error handling and reporting
Simple API key configuration
Related MCP server: mcp-mistral-ocr
Installation
Running with npx
Manual Installation
Running on Claude Desktop
Add this to your claude_desktop_config.json:
Or for a more straightforward way you can install via the Smithery CLI by running the following code in your device terminal
Running on Windsurf
Add this to your ./codeium/windsurf/model_config.json:
Running on Cursor
To configure Olostep MCP in Cursor:
Open Cursor Settings
Go to Features > MCP Servers
Click "+ Add New MCP Server"
Enter the following:
Name: "olostep-mcp" (or your preferred name)
Type: "command"
Command:
env OLOSTEP_API_KEY=your-api-key npx -y olostep-mcp
Replace your-api-key with your Olostep API key.
Configuration
Environment Variables
OLOSTEP_API_KEY: Your Olostep API key (required)
Available Tools
1. Get Webpage Content (get_webpage_content)
Retrieves webpage content in clean markdown format with support for JavaScript rendering.
Parameters:
url_to_scrape: The URL of the webpage to scrape (required)wait_before_scraping: Time to wait in milliseconds before starting the scrape (default: 0)country: Residential country to load the request from (e.g., US, CA, GB) (optional)
Response:
2. Get Website URLs (get_website_urls)
Search and retrieve relevant URLs from a website, sorted by relevance to your query.
Parameters:
url: The URL of the website to map (required)search_query: The search query to sort URLs by (required)
Response:
3. Google Search (google_search)
Retrieve structured data from Google search results.
Parameters:
query: The search query to perform (required)country: Country code for localized results (e.g., US, GB) (default: "US")
Response includes:
Organic search results with titles, links, and snippets
Knowledge graph data when available
Related questions (People Also Ask)
Related searches
Rich snippets and other structured data
Error Handling
The server provides robust error handling:
Detailed error messages for API issues
Network error reporting
Authentication failure handling
Rate limit information
Example error response:
License
ISC License