click2houston.com
robots.txt

Robots Exclusion Standard data for click2houston.com

Resource Scan

Scan Details

Site Domain click2houston.com
Base Domain click2houston.com
Scan Status Ok
Last Scan2024-11-13T07:27:44+00:00
Next Scan 2024-11-20T07:27:44+00:00

Last Scan

Scanned2024-11-13T07:27:44+00:00
URL https://click2houston.com/robots.txt
Redirect https://www.click2houston.com/robots.txt
Redirect Domain www.click2houston.com
Redirect Base click2houston.com
Domain IPs 23.218.216.133, 23.218.216.138
Redirect IPs 23.209.46.76, 23.209.46.80, 2600:1413:b000:13::b857:c197, 2600:1413:b000:13::b857:c19c
Response IP 23.45.207.169
Found Yes
Hash d58e786d5e5a7d75e480b74b3fd06a40b1fceb57d75ff8bb4db4872d270680af
SimHash 490c58408b93

Groups

*

Rule Path
Disallow /appfeeds/*
Disallow /meta/*
Disallow /climate-collaborative/*
Disallow *outputType%3DrawHTML*
Disallow *outputType%3Dappfeeds*

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.click2houston.com/sitemap.xml
sitemap https://www.click2houston.com/arc/outboundfeeds/sitemap/?outputType=xml
sitemap https://www.click2houston.com/arc/outboundfeeds/news-sitemap/?outputType=xml
sitemap https://www.click2houston.com/arc/outboundfeeds/google-news-feed/?outputType=xml