compare.buyhatke.com
robots.txt

Robots Exclusion Standard data for compare.buyhatke.com

Resource Scan

Scan Details

Site Domain compare.buyhatke.com
Base Domain buyhatke.com
Scan Status Ok
Last Scan2024-11-14T20:51:36+00:00
Next Scan 2024-11-21T20:51:36+00:00

Last Scan

Scanned2024-11-14T20:51:36+00:00
URL https://compare.buyhatke.com/robots.txt
Domain IPs 104.21.26.145, 172.67.136.130, 2606:4700:3030::6815:1a91, 2606:4700:3033::ac43:8882
Response IP 172.67.136.130
Found Yes
Hash f6b2d6eca398baff29f41cdf84d32a81415cc3dc83fab61917bfec2e1ed136ed
SimHash 0465cc4363d0

Groups

sogou spider

Rule Path
Disallow /*

mediapartners-google

Rule Path
Disallow /tracking.php
Disallow /coupons/couponTracker.php
Disallow /discover/*
Disallow /*nofollow%3D*

googlebot

Rule Path
Disallow /tracking.php
Disallow /coupons/couponTracker.php
Disallow /discover/*
Disallow /*nofollow%3D*

googlebot-mobile

Rule Path
Disallow /tracking.php
Disallow /coupons/couponTracker.php
Disallow /discover/*
Disallow /*nofollow%3D*

*

Rule Path
Disallow /tracking.php
Disallow /coupons/couponTracker.php
Disallow /discover/*
Disallow /*nofollow%3D*