celebrazio.net
robots.txt

Robots Exclusion Standard data for celebrazio.net

Resource Scan

Scan Details

Site Domain celebrazio.net
Base Domain celebrazio.net
Scan Status Ok
Last Scan2024-06-19T13:38:25+00:00
Next Scan 2024-07-19T13:38:25+00:00

Last Scan

Scanned2024-06-19T13:38:25+00:00
URL https://celebrazio.net/robots.txt
Redirect https://www.celebrazio.net/robots.txt
Redirect Domain www.celebrazio.net
Redirect Base celebrazio.net
Domain IPs 172.81.182.13, 2602:ffb6:4:c076:c0de:ace:0:cb
Redirect IPs 172.81.182.13, 2602:ffb6:4:c076:c0de:ace:0:cb
Response IP 172.81.182.13
Found Yes
Hash 75cf6e75631dbc3fe810622578bd0d0199a3a44261d886b6f01b4f054c83d179
SimHash 3444f932db13

Groups

gptbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

wisenutbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider+

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /relay/
Disallow /travel/

*

Rule Path
Disallow /tmp/
Disallow /logs/
Disallow /webstats/
Disallow /usage/

msnbot

Rule Path
Disallow /webstats/

yandex

Rule Path
Disallow /

yandex bot

Rule Path
Disallow /

Comments

  • /robots.txt for celebrazio.net
  • per google.com webmaster page.