# Allows only major search engines and known friendly spiders# Major Search Engines and Known Friendly Spiders (allowed)

User-agent: Mediapartners-Google
Disallow:User-agent: GooglebotDisallow:User-agent: MSNBotDisallow:User-agent: SlurpDisallow:User-agent: TeomaDisallow:User-agent: TwicelerDisallow:User-agent: GigabotDisallow:User-agent: ScrubbyDisallow:User-agent: RobozillaDisallow:# Everyone Else (NOT allowed)User-agent: *Disallow: /