womenshealth.com.au
robots.txt

Robots Exclusion Standard data for womenshealth.com.au

Resource Scan

Scan Details

Site Domain womenshealth.com.au
Base Domain womenshealth.com.au
Scan Status Ok
Last Scan2024-10-06T19:30:09+00:00
Next Scan 2024-10-13T19:30:09+00:00

Last Scan

Scanned2024-10-06T19:30:09+00:00
URL https://womenshealth.com.au/robots.txt
Domain IPs 162.159.135.42
Response IP 162.159.135.42
Found Yes
Hash 3579598ecebb29b1f36fc23208e99946145ebba5f1b6c669415308236ba0921a
SimHash 4c59d2104791

Groups

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

slurp

Rule Path
Disallow

baiduspider

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

yandex

Rule Path
Disallow

lycos

Rule Path
Disallow

seekbot

Rule Path
Disallow

*

Rule Path
Disallow /

twitterbot

Rule Path
Allow /images

facebookexternalhit

Rule Path
Allow /images

Other Records

Field Value
sitemap https://www.womenshealth.com.au/sitemap_index.xml