lookingateverything-with-des.webnode.nl
robots.txt

Robots Exclusion Standard data for lookingateverything-with-des.webnode.nl

Resource Scan

Scan Details

Site Domain lookingateverything-with-des.webnode.nl
Base Domain webnode.nl
Scan Status Ok
Last Scan2025-12-03T01:57:54+00:00
Next Scan 2026-01-02T01:57:54+00:00

Last Scan

Scanned2025-12-03T01:57:54+00:00
URL https://lookingateverything-with-des.webnode.nl/robots.txt
Domain IPs 18.185.25.67, 3.79.173.192
Response IP 18.185.25.67
Found Yes
Hash 7294c95cca9e09933183a2861d4de3306938b8ec9ead540db792b09fc6983274
SimHash 6954d8d083a3

Groups

psbot

Rule Path
Disallow /

*

Rule Path
Disallow /servers/frontend/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://lookingateverything-with-des.webnode.nl/sitemap.xml