Quick Templates

Basic Configuration

Hold Ctrl (Cmd on Mac) to select multiple bots
Optional: Time to wait between requests

Allow / Disallow Rules

Enter paths to block from crawling
Enter paths to explicitly allow

Custom Rules

Advanced: Add custom directives