dev.twsiyuan.com
robots.txt

Robots Exclusion Standard data for dev.twsiyuan.com

Resource Scan

Scan Details

Site Domain dev.twsiyuan.com
Base Domain twsiyuan.com
Scan Status Ok
Last Scan2024-09-29T18:22:19+00:00
Next Scan 2024-10-29T18:22:19+00:00

Last Scan

Scanned2024-09-29T18:22:19+00:00
URL https://dev.twsiyuan.com/robots.txt
Domain IPs 2404:6800:4003:c05::79, 74.125.68.121
Response IP 74.125.24.121
Found Yes
Hash d24083970bfd672e6c0ea990ec1eed5600a9a7d74504a617ba116f12222bede7
SimHash 6905de00eb12

Groups

*

Rule Path
Disallow /search
Disallow /*_archive.html$
Disallow /feeds/*
Allow /

Other Records

Field Value
sitemap https://dev.twsiyuan.com/atom.xml?redirect=false&start-index=1&max-results=1000
sitemap https://dev.twsiyuan.com/sitemap.xml