renecards.nl
robots.txt
Robots Exclusion Standard data for renecards.nl
Resource Scan
Scan Details
Site Domain | renecards.nl |
Base Domain | renecards.nl |
Scan Status | Ok |
Last Scan | 2024-11-05T09:19:33+00:00 |
Next Scan | 2024-12-05T09:19:33+00:00 |
Last Scan
Scanned | 2024-11-05T09:19:33+00:00 |
URL | https://renecards.nl/robots.txt |
Redirect | https://www.renecards.nl/robots.txt |
Redirect Domain | www.renecards.nl |
Redirect Base | renecards.nl |
Domain IPs | 104.26.12.62, 104.26.13.62, 172.67.69.124, 2606:4700:20::681a:c3e, 2606:4700:20::681a:d3e, 2606:4700:20::ac43:457c |
Redirect IPs | 104.26.12.62, 104.26.13.62, 172.67.69.124, 2606:4700:20::681a:c3e, 2606:4700:20::681a:d3e, 2606:4700:20::ac43:457c |
Response IP | 104.26.12.62 |
Found | Yes |
Hash | 99aed63885daa12124b4273f14cdf68208bc663447be8371f290289b9ad9458e |
SimHash | 671fdc70dc91 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /cart/ |
Disallow | /checkout/ |
Disallow | /customer/* |
Disallow | /search/ |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
Other Records
Field | Value |
---|---|
sitemap | https://www.renecards.nl/rss/ |