Crawl4AI MCP Server

Tools · 19

• crawl_url Extract web page content with JavaScript support
• deep_crawl_site Crawl multiple pages from a site with configurable depth
• crawl_url_with_fallback Crawl with fallback strategies for anti-bot sites
• intelligent_extract Extract specific data from web pages using LLM
• extract_entities Extract entities (emails, phones, etc.) from web pages
• extract_structured_data Extract structured data using CSS selectors or LLM
• extract_youtube_transcript Extract YouTube transcripts with timestamps
• batch_extract_youtube_transcripts Extract transcripts from multiple YouTube videos (max 3)
• get_youtube_video_info Get YouTube video metadata and transcript availability
• extract_youtube_comments Extract YouTube video comments with pagination
• search_google Search Google with genre filtering
• batch_search_google Perform multiple Google searches (max 3)
• search_and_crawl Search Google and crawl top results
• get_search_genres Get available search genres
• process_file Convert PDF, Word, Excel, PowerPoint, ZIP to markdown
• get_supported_file_formats Get supported file formats and capabilities
• enhanced_process_large_content Process large content with chunking and BM25 filtering
• batch_crawl Crawl multiple URLs with fallback (max 3 URLs)
• multi_url_crawl Multi-URL crawl with pattern-based config (max 5 URL patterns)