mulhauser.net
robots.txt

Robots Exclusion Standard data for mulhauser.net

Resource Scan

Scan Details

Site Domain mulhauser.net
Base Domain mulhauser.net
Scan Status Ok
Last Scan2024-09-28T09:28:27+00:00
Next Scan 2024-10-05T09:28:27+00:00

Last Scan

Scanned2024-09-28T09:28:27+00:00
URL https://mulhauser.net/robots.txt
Domain IPs 199.195.144.23
Response IP 199.195.144.23
Found Yes
Hash 644259387777b4fff552776481d3ad2c34e8a8d165ae40006110274d838a8d08
SimHash 891568107f80

Groups

*

Rule Path
Disallow /channel.html
Disallow /lib/wp-admin
Disallow /lib/?p=
Disallow /lib?p=
Disallow /recommend

googlebot

Rule Path
Disallow /channel.html
Disallow /recommend
Disallow /*/feed/
Disallow /*/feed/rss/
Disallow /*/feed/rss2/
Disallow /*/feed/atom/
Disallow /*/trackback/
Disallow /*/?preview=
Disallow /*?preview=
Disallow /*?p=
Disallow /*/wp-admin
Disallow /*/wp-content/plugins
Disallow /*/rss/
Disallow /*/date/
Disallow /*/comments/
Disallow /*.inc

mediapartners-google

Rule Path
Disallow
Disallow /*?p=

npbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

httrack

Rule Path
Disallow /

httrack 3.0x

Rule Path
Disallow /

ia_archiver
archive.org_bot

Rule Path
Disallow /

sbider

Rule Path
Disallow /

becomebot

Rule Path
Disallow /