raadvanstate.nl
robots.txt
Robots Exclusion Standard data for raadvanstate.nl
Resource Scan
Scan Details
Site Domain | raadvanstate.nl |
Base Domain | raadvanstate.nl |
Scan Status | Ok |
Last Scan | 2024-09-27T05:45:43+00:00 |
Next Scan | 2024-10-11T05:45:43+00:00 |
Last Scan
Scanned | 2024-09-27T05:45:43+00:00 |
URL | https://raadvanstate.nl/robots.txt |
Redirect | https://www.raadvanstate.nl/robots.txt |
Redirect Domain | www.raadvanstate.nl |
Redirect Base | raadvanstate.nl |
Domain IPs | 185.38.232.224, 2a02:720:9:8::224 |
Redirect IPs | 104.22.68.192, 104.22.69.192, 172.67.4.101, 2606:4700:10::6816:44c0, 2606:4700:10::6816:45c0, 2606:4700:10::ac43:465 |
Response IP | 104.22.69.192 |
Found | Yes |
Hash | b22e229b275fb69cc3214046dec19991acf49f743f60247f3a03becc7f2b4d6f |
SimHash | 6c08dc418d15 |
Groups
*
Rule | Path |
---|---|
Allow | /aspx/read.aspx |
Disallow | /aspx/ |
Disallow | *export%3Dpdf* |
Disallow | export%3Dpdf |
Disallow | /*?*rss=true* |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
Other Records
Field | Value |
---|---|
sitemap | https://www.raadvanstate.nl/sitemap.xml |