corncott.com
robots.txt

Robots Exclusion Standard data for corncott.com

Resource Scan

Scan Details

Site Domain corncott.com
Base Domain corncott.com
Scan Status Ok
Last Scan2026-03-06T17:07:33+00:00
Next Scan 2026-04-05T17:07:33+00:00

Last Scan

Scanned2026-03-06T17:07:33+00:00
URL https://corncott.com/robots.txt
Redirect https://www.corncott.com/robots.txt
Redirect Domain www.corncott.com
Redirect Base corncott.com
Domain IPs 185.59.63.16
Redirect IPs 185.59.60.40, 185.59.60.41
Response IP 185.59.60.40
Found Yes
Hash 26bc870e9ac55b5c82b10ad71cf2db3d430edd49d30173c04fee2a45b45b4aac
SimHash b650924a2f74

Groups

*

Rule Path
Disallow /site-search/
Disallow /site-search
Disallow /booking/
Disallow /sagepay/
Disallow /generator/
Disallow /help/
Disallow /assessment-form
Disallow /paypal-execute-payment
Disallow /paypal-payment/
Disallow /ppc/
Disallow /advanced-search/

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
  • Agreed by John for removal @02/04/19, based on google recommendations, will be handled by on page meta tag (noi