lijsterpaal.nl
robots.txt
Robots Exclusion Standard data for lijsterpaal.nl
Resource Scan
Scan Details
Site Domain | lijsterpaal.nl |
Base Domain | lijsterpaal.nl |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 1/22/2025, 8:55:43 AM |
Next Scan | 4/22/2025, 8:55:43 AM |
Last Successful Scan
Scanned | 12/7/2022, 5:46:28 PM |
URL | https://lijsterpaal.nl/robots.txt |
Redirect | https://www.lijsterpaal.nl/robots.txt |
Redirect Domain | www.lijsterpaal.nl |
Redirect Base | lijsterpaal.nl |
Domain IPs | 104.21.77.49, 172.67.204.165, 2606:4700:3030::6815:4d31, 2606:4700:3030::ac43:cca5 |
Redirect IPs | 104.21.77.49, 172.67.204.165, 2606:4700:3030::6815:4d31, 2606:4700:3030::ac43:cca5 |
Response IP | 172.67.204.165 |
Found | Yes |
Hash | 16d1fe7e0004dde5c259629b69c8ad142ff0d7bd025653331a0a2ac8d3ec7728 |
SimHash | 410113400157 |
Groups
*
Rule | Path |
---|---|
Allow | * |
Disallow | /images/ |
Disallow | /themes/ |
Disallow | /js/ |
Disallow | /products/ |
Disallow | /factory.html |
Disallow | /services.html |
Disallow | /about.html |
Disallow | /contact.html |
Other Records
Field | Value |
---|---|
sitemap | https://www.lijsterpaal.nl/sitemap.xml |