deals.click2houston.com
robots.txt

Robots Exclusion Standard data for deals.click2houston.com

Resource Scan

Scan Details

Site Domain deals.click2houston.com
Base Domain click2houston.com
Scan Status Ok
Last Scan2024-05-12T10:02:58+00:00
Next Scan 2024-06-11T10:02:58+00:00

Last Scan

Scanned2024-05-12T10:02:58+00:00
URL https://deals.click2houston.com/robots.txt
Domain IPs 34.229.33.18, 34.239.72.213, 54.80.252.252
Response IP 54.80.252.252
Found Yes
Hash 2a0e9ebaec4dc8db206b82bbb04165d4f2ed322aa51dbe3d60ddd4b92be139bd
SimHash 687549932013

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

*

Rule Path
Disallow /300250/
Disallow /300250
Disallow /checkout
Disallow /orders
Disallow /paypal_checkout
Disallow /paypal_authorization_callback
Disallow /paypal_cancel_callback
Disallow /fb-product-feed
Disallow /fb-stitcher-feed
Disallow /tmp