Log In Sign Up

v2ex.com
robots.txt

Robots Exclusion Standard data for v2ex.com

Resource Scan

Scan Details

Site Domain v2ex.com
Base Domain v2ex.com
Scan Status Ok
Last Scan2024-09-20T21:12:24+00:00
Next Scan 2024-09-27T21:12:24+00:00

Last Scan

Scanned2024-09-20T21:12:24+00:00
URL https://v2ex.com/robots.txt
Domain IPs 104.20.47.180, 104.20.48.180, 172.67.35.211, 2606:4700:10::6814:2fb4, 2606:4700:10::6814:30b4, 2606:4700:10::ac43:23d3
Response IP 104.20.48.180
Found Yes
Hash 06f35030c4af8a9651194ccc36dc6f390223c04f406905923ffa9921587a6dd1
SimHash 659a8c4045f5

Groups

bingbot

Rule Path
Disallow /backstage/
Disallow /signin
Disallow /signout
Disallow /settings

Other Records

Field Value
crawl-delay 120

*

Rule Path
Disallow /backstage/
Disallow /signin
Disallow /signout
Disallow /settings
Back to top