Log In Sign Up

womenvn.com
robots.txt

Robots Exclusion Standard data for womenvn.com

Resource Scan

Scan Details

Site Domain womenvn.com
Base Domain womenvn.com
Scan Status Ok
Last Scan2024-11-15T12:38:14+00:00
Next Scan 2024-11-22T12:38:14+00:00

Last Scan

Scanned2024-11-15T12:38:14+00:00
URL https://womenvn.com/robots.txt
Domain IPs 104.21.83.80, 172.67.217.156, 2606:4700:3030::ac43:d99c, 2606:4700:3033::6815:5350
Response IP 172.67.217.156
Found Yes
Hash dfc57bb62e4c94c1607f03889dd257559ca348e4f872ebb4d97f9553c7d98fa9
SimHash 67018c31c3b1

Groups

*

Rule Path
Disallow

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5
Back to top

Other Records

Field Value
sitemap https://womenvn.com/sitemap.xml
Back to top

Warnings

  • `host` is not a known field.
Back to top