uk.askmen.com
robots.txt

Robots Exclusion Standard data for uk.askmen.com

Resource Scan

Scan Details

Site Domain uk.askmen.com
Base Domain askmen.com
Scan Status Ok
Last Scan2024-06-23T20:33:01+00:00
Next Scan 2024-07-23T20:33:01+00:00

Last Scan

Scanned2024-06-23T20:33:01+00:00
URL https://uk.askmen.com/robots.txt
Redirect https://www.askmen.com/robots.txt
Redirect Domain www.askmen.com
Redirect Base askmen.com
Domain IPs 104.18.34.84, 172.64.153.172, 2606:4700:4400::6812:2254, 2606:4700:4400::ac40:99ac
Redirect IPs 104.18.34.84, 172.64.153.172, 2606:4700:4400::6812:2254, 2606:4700:4400::ac40:99ac
Response IP 172.64.153.172
Found Yes
Hash 4a2131fa2b83cbc3586fb5c425ef047fff29682326bfa995decccea8ededf8ff
SimHash 691c9840ed92

Groups

*

Rule Path
Disallow

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.askmen.com/sitemap-index.xml