costcofood.com
robots.txt
Robots Exclusion Standard data for costcofood.com
Resource Scan
Scan Details
Site Domain | costcofood.com |
Base Domain | costcofood.com |
Scan Status | Ok |
Last Scan | 6/6/2025, 4:24:38 AM |
Next Scan | 6/13/2025, 4:24:38 AM |
Last Scan
Scanned | 6/6/2025, 4:24:38 AM |
URL | https://costcofood.com/robots.txt |
Domain IPs | 104.21.29.106, 172.67.171.115, 2606:4700:3034::ac43:ab73, 2606:4700:3035::6815:1d6a |
Response IP | 172.67.171.115 |
Found | Yes |
Hash | 0dab7efab0c198687b5260de4f62405e47c565df538792cded503e3af9fd763c |
SimHash | 43245c66a892 |
Groups
*
Rule | Path |
---|---|
Disallow | /?s= |
Disallow | /search/ |
Disallow | /wp-admin |
Disallow | *feed/ |
Disallow | /wp-login.php |
Disallow | /wp-register.php |
Disallow | /trackback/ |
Other Records
Field | Value |
---|---|
sitemap | https://costcofood.com/sitemap_index.xml |