# Only allow bots to crawl articles - not generated pages
User-agent: *
Disallow: /gw