motor-forum.nl
robots.txt

Robots Exclusion Standard data for motor-forum.nl

Resource Scan

Scan Details

Site Domain motor-forum.nl
Base Domain motor-forum.nl
Scan Status Ok
Last Scan2024-11-11T02:06:22+00:00
Next Scan 2024-11-18T02:06:22+00:00

Last Scan

Scanned2024-11-11T02:06:22+00:00
URL https://motor-forum.nl/robots.txt
Domain IPs 104.26.10.195, 104.26.11.195, 172.67.75.203, 2606:4700:20::681a:ac3, 2606:4700:20::681a:bc3, 2606:4700:20::ac43:4bcb
Response IP 104.26.10.195
Found Yes
Hash cf4adf9b78d3ba5b936a85bc1466cae38be11530fe5d5a82bcba157ef2d00347
SimHash e16d50406e11

Groups

*

Rule Path
Disallow /whats-new/
Disallow /account/
Disallow /login/
Disallow /admin.php
Disallow /deferred.php
Disallow /logout
Disallow /goto
Allow /

mj12bot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.motor-forum.nl/sitemap.xml