pure.buas.nl
robots.txt

Robots Exclusion Standard data for pure.buas.nl

Resource Scan

Scan Details

Site Domain pure.buas.nl
Base Domain buas.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-06T02:04:32+00:00
Next Scan 2025-06-05T02:04:32+00:00

Last Successful Scan

Scanned2025-01-14T02:02:09+00:00
URL https://pure.buas.nl/robots.txt
Domain IPs 104.18.39.240, 172.64.148.16
Response IP 172.64.148.16
Found Yes
Hash f609a36c998ff7e4a3af089334c3c0b0a3af49164f4498d06e429ff5cb2c854c
SimHash eb1c9830a173

Groups

*

Rule Path
Disallow /*?*format=rss
Disallow /*?*export=xls

Other Records

Field Value
crawl-delay 5

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://pure.buas.nl/sitemap.xml