gutefrage.net
robots.txt

Robots Exclusion Standard data for gutefrage.net

Resource Scan

Scan Details

Site Domain gutefrage.net
Base Domain gutefrage.net
Scan Status Ok
Last Scan2024-06-25T22:06:51+00:00
Next Scan 2024-07-02T22:06:51+00:00

Last Scan

Scanned2024-06-25T22:06:51+00:00
URL https://gutefrage.net/robots.txt
Redirect https://www.gutefrage.net/robots.txt
Redirect Domain www.gutefrage.net
Redirect Base gutefrage.net
Domain IPs 2600:9000:2164:1a00:3:67e0:9600:93a1, 2600:9000:2164:4800:3:67e0:9600:93a1, 2600:9000:2164:4a00:3:67e0:9600:93a1, 2600:9000:2164:4c00:3:67e0:9600:93a1, 2600:9000:2164:5600:3:67e0:9600:93a1, 2600:9000:2164:6c00:3:67e0:9600:93a1, 2600:9000:2164:7c00:3:67e0:9600:93a1, 2600:9000:2164:b400:3:67e0:9600:93a1, 99.86.38.110, 99.86.38.5, 99.86.38.70, 99.86.38.96
Redirect IPs 2600:9000:24db:1c00:3:67e0:9600:93a1, 2600:9000:24db:3600:3:67e0:9600:93a1, 2600:9000:24db:3800:3:67e0:9600:93a1, 2600:9000:24db:8800:3:67e0:9600:93a1, 2600:9000:24db:8e00:3:67e0:9600:93a1, 2600:9000:24db:a200:3:67e0:9600:93a1, 2600:9000:24db:ee00:3:67e0:9600:93a1, 2600:9000:24db:f200:3:67e0:9600:93a1, 99.86.38.110, 99.86.38.5, 99.86.38.70, 99.86.38.96
Response IP 18.165.171.102
Found Yes
Hash f2f1cc233131c7d44914caae9bae05b1cfc84ec62dd981ab31a75c3506ecbb36
SimHash 2a1d480105d3

Groups

googlebot

Rule Path
Disallow /nutzer_hinzufuegen
Disallow /home/suche
Disallow /frage_hinzufuegen
Disallow /forum
Disallow /nmms-template/

bingbot

Rule Path
Disallow /nutzer_hinzufuegen
Disallow /home/suche
Disallow /frage_hinzufuegen
Disallow /forum
Disallow /nmms-template/

duckduckbot

Rule Path
Disallow /nutzer_hinzufuegen
Disallow /home/suche
Disallow /frage_hinzufuegen
Disallow /forum
Disallow /nmms-template/

crawler4j

Rule Path
Disallow /

*

Rule Path
Disallow /nutzer_hinzufuegen
Disallow /home/suche
Disallow /frage_hinzufuegen
Disallow /forum
Disallow /nmms-template/
Disallow /crm-data

Other Records

Field Value
sitemap https://www.gutefrage.net/sitemap.xml
sitemap https://www.gutefrage.net/editorial-sitemap.xml