# exclude some access-controlled areas User-agent: * Disallow: /test23 Disallow: /press Disallow: /*.exe$ Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.txt$ Disallow: /*.zip$