To crawl, or not to crawl, that is the #robotstxt question. #Google updates robots.txt tool goo.gl/VrIeRo #SEO