Robots.txt Builder Configuration User Agent All User Agents (*) Googlebot Bingbot Yahoo! Slurp DuckDuckBot Baiduspider YandexBot Custom Rules + Add Rule Crawl Delay (seconds) Sitemap URL Host Directive Presets Allow All Disallow All E-commerce Development Preview & Actions # Your robots.txt content will appear here Copy to Clipboard Download robots.txt ⚠️ Recommendations