freshman.tw
robots.txt

Robots Exclusion Standard data for freshman.tw

Resource Scan

Scan Details

Site Domain freshman.tw
Base Domain freshman.tw
Scan Status Ok
Last Scan2026-01-24T10:59:25+00:00
Next Scan 2026-02-23T10:59:25+00:00

Last Scan

Scanned2026-01-24T10:59:25+00:00
URL https://freshman.tw/robots.txt
Domain IPs 104.21.79.102, 172.67.169.238, 2606:4700:3031::ac43:a9ee, 2606:4700:3034::6815:4f66
Response IP 104.21.79.102
Found Yes
Hash 97c7922fe0b1c9d2be6b329a7476155ac87fd29fa4dc0c25212ff596a685ecf2
SimHash 4854c2844714

Groups

*

Rule Path
Disallow /

mediapartners-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot

Rule Path
Allow /

slurp

Rule Path
Allow /

bingbot

Rule Path
Allow /

Comments

  • http://support.google.com/webmasters/bin/answer.py?hl=en&answer=156449&from=40360&rd=1