austinzhu.dev
robots.txt

Robots Exclusion Standard data for austinzhu.dev

Resource Scan

Scan Details

Site Domain austinzhu.dev
Base Domain austinzhu.dev
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-11-25T15:37:30+00:00
Next Scan 2025-12-02T15:37:30+00:00

Last Successful Scan

Scanned2025-10-25T01:18:11+00:00
URL https://austinzhu.dev/robots.txt
Domain IPs 104.21.39.72, 172.67.143.166, 2606:4700:3032::6815:2748, 2606:4700:3032::ac43:8fa6
Response IP 104.21.39.72
Found Yes
Hash 0141738f24520a46a1e2d184462519dbc53791fe9536e5142ae843ba023f17df
SimHash 6d454844cf91

Groups

*

Rule Path
Disallow /norobots/

Other Records

Field Value
sitemap https://austinzhu.dev/sitemap.xml