- Added
redactPIIto scrape, parse, and nested scrape option schemas so MCP callers can request PII redaction with a single flag.
- Fix stdio transport regression introduced in 3.18.0 where every tool call
failed with
Unauthorized: API key is required when not using a self-hosted instanceeven whenFIRECRAWL_API_KEYwas set. The OAuth refactor in 3.18.0 made theauthenticatecallback unconditionally readrequest.headers, butfirecrawl-fastmcpinvokesauthenticate(undefined)for stdio (there is no HTTP request context). The resultingTypeErrorwas swallowed by FastMCP, leaving the session unauthenticated. Added a null guard so env-var credentials (FIRECRAWL_API_KEY/FIRECRAWL_OAUTH_TOKEN) are honored on stdio again.
- Refined monitor goal guidance for meaningful-change monitoring.
- Documented
isMeaningful,judgment, andmeaningfulChangesmonitor results.
- Added a simplified
firecrawl_monitor_createpath usingpageorpagesplusgoal. - Added monitor check status filtering to
firecrawl_monitor_checks.
- Updated monitor tool guidance to prefer goal-based meaningful-change monitoring and document
judgmentresults.
- Critical bugfix for stdio transport hanging issues with Python clients
- Implemented transport-aware logging that directs logs to stderr when using stdio transport
- Resolves issue #22 where Python clients would hang during initialization or tool execution
- Improves compatibility with non-JavaScript MCP clients
- Environment variable support for all configuration options
- Detailed configuration documentation in README
- Made retry and credit monitoring settings configurable via environment variables:
FIRECRAWL_RETRY_MAX_ATTEMPTSFIRECRAWL_RETRY_INITIAL_DELAYFIRECRAWL_RETRY_MAX_DELAYFIRECRAWL_RETRY_BACKOFF_FACTORFIRECRAWL_CREDIT_WARNING_THRESHOLDFIRECRAWL_CREDIT_CRITICAL_THRESHOLD
- Enhanced configuration examples with detailed comments and use cases
- Improved documentation for retry behavior and credit monitoring
- Added comprehensive configuration examples for both cloud and self-hosted setups
- Added detailed explanations of retry behavior with timing examples
- Added credit monitoring threshold explanations
- Updated Claude Desktop configuration documentation
- Removed redundant batch configuration to rely on Firecrawl library's built-in functionality
- Simplified batch processing logic by leveraging library's native implementation
- Optimized parallel processing and rate limiting handling
- Reduced code complexity and potential configuration conflicts
- Removed custom
CONFIG.batchsettings (maxParallelOperationsanddelayBetweenRequests) - Simplified batch operation processing to use library's built-in batch handling
- Updated server startup logging to remove batch configuration references
- Maintained credit usage tracking and error handling functionality
- Resolved unused interface warnings for ExtractParams and ExtractResponse
- Improved type safety in extract operations
- Fixed type casting issues in API responses
- Improved type guards for better type inference
- Enhanced error messages for configuration validation
- Implemented automatic retries with exponential backoff for rate limits
- Added queue system for batch operations with parallel processing
- Integrated credit usage monitoring with warning thresholds
- Enhanced content validation with configurable criteria
- Added comprehensive logging system for operations and errors
- New search tool (
firecrawl_search) for web search with content extraction - Support for self-hosted Firecrawl instances via optional API URL configuration
- New
FIRECRAWL_API_URLenvironment variable - Automatic fallback to cloud API
- Improved error messages for self-hosted instances
- New
- Improved error handling for HTTP errors including 404s
- Enhanced URL validation before scraping
- Updated configuration with new retry and batch processing options
- Optimized rate limiting with automatic backoff strategy
- Improved documentation with new features and examples
- Added detailed self-hosted configuration guide
- Rate limit handling in batch operations
- Error response formatting
- Type definitions for response handlers
- Test suite mock responses
- Error handling for invalid search queries
- API configuration validation
- Initial release with basic scraping functionality
- Support for batch scraping
- URL discovery and crawling capabilities
- Rate limiting implementation