canadian-shops.com
robots.txt
Robots Exclusion Standard data for canadian-shops.com
Resource Scan
Scan Details
| Site Domain | canadian-shops.com |
| Base Domain | canadian-shops.com |
| Scan Status | Ok |
| Last Scan | 2024-11-14T06:34:23+00:00 |
| Next Scan | 2024-11-21T06:34:23+00:00 |
Last Scan
| Scanned | 2024-11-14T06:34:23+00:00 |
| URL | https://canadian-shops.com/robots.txt |
| Domain IPs | 104.21.16.141, 172.67.212.245, 2606:4700:3033::ac43:d4f5, 2606:4700:3034::6815:108d |
| Response IP | 172.67.212.245 |
| Found | Yes |
| Hash | eb2baf96da06b6afe8aa54d5fb495ce4eed2ad06943fbbd9668012969401596e |
| SimHash | 6830eb006292 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /page/ |
| Disallow | /cron/ |
| Disallow | /search |
| Disallow | /item/*/add-review |
| Disallow | /item/*/directions |
| Disallow | /item/*/edit |
Comments