# Allows only major search engines and known friendly spiders # Major Search Engines and Known Friendly Spiders (allowed) User-agent: Googlebot Disallow:/cms/ User-agent: Googlebot-Mobile Disallow:/cms/ User-agent: Googlebot-Image Disallow:/cms/ User-agent: MSNBot Disallow: /cms/ User-agent: Slurp Disallow: /cms/ # Everyone Else (NOT allowed) User-agent: * Disallow: /