bigshopper.nl
robots.txt
Robots Exclusion Standard data for bigshopper.nl
Resource Scan
Scan Details
| Site Domain | bigshopper.nl |
| Base Domain | bigshopper.nl |
| Scan Status | Ok |
| Last Scan | 2024-11-14T02:55:56+00:00 |
| Next Scan | 2024-11-21T02:55:56+00:00 |
Last Scan
| Scanned | 2024-11-14T02:55:56+00:00 |
| URL | https://bigshopper.nl/robots.txt |
| Domain IPs | 172.66.40.172, 172.66.43.84, 2606:4700:3108::ac42:28ac, 2606:4700:3108::ac42:2b54 |
| Response IP | 172.66.40.172 |
| Found | Yes |
| Hash | cf577b4406d6aca9bd1f48972d03fd9f05bd82be9abd7f1e4cfeabb4ffcdda5c |
| SimHash | d05cc940e898 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */shop/ |
| Disallow | */send_mail/ |
| Disallow | */scripts/send_faq_searchbardata.php |