User-agent: * Disallow: /ad Disallow: /blog/sites Disallow: /*.txt$ Disallow: /ads Disallow: /ads/www Disallow: /ads/www/delivery