tweevoeter.nl
robots.txt

Robots Exclusion Standard data for tweevoeter.nl

Resource Scan

Scan Details

Site Domain tweevoeter.nl
Base Domain tweevoeter.nl
Scan Status Ok
Last Scan2025-06-24T06:51:44+00:00
Next Scan 2025-07-01T06:51:44+00:00

Last Scan

Scanned2025-06-24T06:51:44+00:00
URL https://tweevoeter.nl/robots.txt
Redirect https://www.tweevoeter.nl/robots.txt
Redirect Domain www.tweevoeter.nl
Redirect Base tweevoeter.nl
Domain IPs 104.21.93.246, 172.67.216.228, 2606:4700:3031::ac43:d8e4, 2606:4700:3037::6815:5df6
Redirect IPs 104.21.93.246, 172.67.216.228, 2606:4700:3031::ac43:d8e4, 2606:4700:3037::6815:5df6
Response IP 172.67.216.228
Found Yes
Hash 67f05d8674f58ab47b5372ef8c8c2eb3408bbd0d82304d9b392034d02e1f98ae
SimHash db4d4c88deb2

Groups

*

Rule Path
Disallow /*/trackback
Disallow /wp-admin/
Disallow /*/?replytocom

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.tweevoeter.nl/sitemap_index.xml