zhuwei.me
robots.txt

Robots Exclusion Standard data for zhuwei.me

Resource Scan

Scan Details

Site Domain zhuwei.me
Base Domain zhuwei.me
Scan Status Ok
Last Scan2025-09-18T05:23:37+00:00
Next Scan 2025-10-18T05:23:37+00:00

Last Scan

Scanned2025-09-18T05:23:37+00:00
URL https://zhuwei.me/robots.txt
Domain IPs 104.21.5.125, 172.67.133.115, 2606:4700:3033::6815:57d, 2606:4700:3036::ac43:8573
Response IP 172.67.133.115
Found Yes
Hash 8f3e9207e80e82bdc3eb5c1a3c8bbdfc30a7715afc714332117e5f14ba7a6d42
SimHash aa70dc80c279

Groups

*

Rule Path
Disallow /*.py$
Disallow /*.zip$
Disallow /*.php$
Disallow /v1/
Disallow /site/

mj12bot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60