coutorture.com
robots.txt

Robots Exclusion Standard data for coutorture.com

Resource Scan

Scan Details

Site Domain coutorture.com
Base Domain coutorture.com
Scan Status Ok
Last Scan2024-09-18T10:28:03+00:00
Next Scan 2024-10-18T10:28:03+00:00

Last Scan

Scanned2024-09-18T10:28:03+00:00
URL http://coutorture.com/robots.txt
Redirect https://www.popsugar.com/fashion/robots.txt
Redirect Domain www.popsugar.com
Redirect Base popsugar.com
Domain IPs 44.194.99.45, 52.22.210.224, 72.44.40.113
Redirect IPs 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91
Response IP 199.232.45.91
Found Yes
Hash a3f9c7e1f5b64405990a66aafd1010ccb84afff94d2aeb484d383190a8f7688e
SimHash f954f6b4fbc2

Groups

*

Rule Path
Allow /files/thumbor/
Disallow /*/next$
Disallow /*/previous$
Disallow /*/river$
Disallow /*/undefined/*
Disallow /*?*append_element
Disallow /*most-shared?*page=
Disallow /admin/
Disallow /ajax/
Allow /ajax/node-get-cta-content
Disallow /api/
Disallow /author/*?*page=
Disallow /favorites/
Disallow /find/
Disallow /forums/
Disallow /gallery/
Disallow /modules/
Disallow /mobile/
Disallow /outgoing/
Disallow /psvn/embed
Disallow /recipes/
Disallow /register
Disallow /remotelogin
Disallow /search
Disallow /shopstyle
Disallow /sign-up/
Disallow /static/ck.php
Disallow /sugar-ads/
Disallow /user/
Allow /user/login
Disallow /warn/
Disallow /*?fss=1
Disallow /*/tag-site/*
Disallow /stories/shop/

dotbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

*

Rule Path
Disallow /celebrity/Brad-Pitt-Crazy-Stuff-499534

Other Records

Field Value
sitemap https://www.popsugar.com/smap