User-agent: *
Disallow: /shared/

User-agent: Web Downloader
Disallow: /

User-agent: Wget
Disallow: /

User-agent: Knack
Disallow: /

User-agent: Teleport Pro
Disallow: /

User-agent: LinkWalker
Disallow: /

User-agent: Wells Search II
Disallow: /

Sitemap: http://www.sexworkersproject.org/sitemap-index.xml.gz