mtb-news.de
robots.txt

Robots Exclusion Standard data for mtb-news.de

Resource Scan

Scan Details

Site Domain mtb-news.de
Base Domain mtb-news.de
Scan Status Ok
Last Scan2024-11-15T23:45:04+00:00
Next Scan 2024-11-22T23:45:04+00:00

Last Scan

Scanned2024-11-15T23:45:04+00:00
URL https://mtb-news.de/robots.txt
Redirect https://www.mtb-news.de/robots.txt
Redirect Domain www.mtb-news.de
Redirect Base mtb-news.de
Domain IPs 104.22.28.196, 104.22.29.196, 172.67.6.123, 2606:4700:10::6816:1cc4, 2606:4700:10::6816:1dc4, 2606:4700:10::ac43:67b
Redirect IPs 104.22.28.196, 104.22.29.196, 172.67.6.123, 2606:4700:10::6816:1cc4, 2606:4700:10::6816:1dc4, 2606:4700:10::ac43:67b
Response IP 172.67.6.123
Found Yes
Hash ae7f2f61a55e56b0068dc2068a86802b895f0194f6f3a7dea75f7d7e0611693d
SimHash c01cdb62a111

Groups

*

Rule Path
Disallow /search/
Disallow /news/wp-admin/
Disallow /forum/t/newsletter.311859/
Disallow /forum/tags/
Allow /news/wp-admin/admin-ajax.php

gptbot

Rule Path
Disallow /