joostdevree.nl
robots.txt

Robots Exclusion Standard data for joostdevree.nl

Resource Scan

Scan Details

Site Domain joostdevree.nl
Base Domain joostdevree.nl
Scan Status Ok
Last Scan2024-09-29T12:07:09+00:00
Next Scan 2024-10-06T12:07:09+00:00

Last Scan

Scanned2024-09-29T12:07:09+00:00
URL https://joostdevree.nl/robots.txt
Domain IPs 188.116.45.75, 2a10:7180:101:0:188:116:45:75
Response IP 188.116.45.75
Found Yes
Hash 31822a343edcb74565a49b2462ffa810f1fbd46c78cd87a76a5c1331fabd5b32
SimHash 611d5140c393

Groups

*

Rule Path
Disallow /bouwkunde/
Disallow /bouwkunde3/
Disallow /shtmls3/
Disallow /cgi-bin/
Disallow /norobots/
Disallow /vitruvius/
Disallow /aatrefwoorden_alle.htm

freefind

Rule Path
Disallow /bouwkunde/
Disallow /bouwkunde3/
Disallow /shtmls3/
Disallow /cgi-bin/
Disallow /norobots/
Disallow /vitruvius/
Allow /aatrefwoorden_alle.htm

Other Records

Field Value
sitemap https://www.joostdevree.nl/sitemap.xml