niederanven.lu
robots.txt

Robots Exclusion Standard data for niederanven.lu

Resource Scan

Scan Details

Site Domain niederanven.lu
Base Domain niederanven.lu
Scan Status Ok
Last Scan2025-10-26T05:40:26+00:00
Next Scan 2025-11-25T05:40:26+00:00

Last Scan

Scanned2025-10-26T05:40:26+00:00
URL https://niederanven.lu/robots.txt
Redirect https://www.niederanven.lu/robots.txt
Redirect Domain www.niederanven.lu
Redirect Base niederanven.lu
Domain IPs 3.121.61.41, 35.158.10.103
Redirect IPs 3.121.61.41, 35.158.10.103
Response IP 3.121.61.41
Found Yes
Hash b8c528cc2f557724d7b0743f81e86ebafc3f1b80ebbcff363d7a1d77a5e83d5b
SimHash 615558306133

Groups

*

Rule Path
Disallow

mj12bot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.niederanven.lu/sitemap.xml

Comments

  • www.robotstxt.org/
  • Allow crawling of all content