throated.com
robots.txt

Robots Exclusion Standard data for throated.com

Resource Scan

Scan Details

Site Domain throated.com
Base Domain throated.com
Scan Status Ok
Last Scan2025-10-28T20:25:53+00:00
Next Scan 2025-11-27T20:25:53+00:00

Last Scan

Scanned2025-10-28T20:25:53+00:00
URL https://throated.com/robots.txt
Redirect https://www.throated.com/robots.txt
Redirect Domain www.throated.com
Redirect Base throated.com
Domain IPs 104.26.10.80, 104.26.11.80, 172.67.73.169
Redirect IPs 104.26.10.80, 104.26.11.80, 172.67.73.169
Response IP 172.67.73.169
Found Yes
Hash 9d3131a6a81826825163e1aaa4fc1daaf0543786341da505a350cac89cccf897
SimHash 7c691dd56530

Groups

*

Rule Path
Disallow /ratings/actor*
Disallow /media/signPhotoset*

Other Records

Field Value
sitemap https://www.throated.com/sitemap/main.xml
sitemap https://www.throated.com/sitemap/actor-1.xml
sitemap https://www.throated.com/sitemap/actor-2.xml
sitemap https://www.throated.com/sitemap/scene-1.xml
sitemap https://www.throated.com/sitemap/scene-2.xml
sitemap https://www.throated.com/sitemap/scene-3.xml
sitemap https://www.throated.com/sitemap/photoset-1.xml
sitemap https://www.throated.com/sitemap/photoset-2.xml
sitemap https://www.throated.com/sitemap/photoset-3.xml
sitemap https://xmlsitemap.throated.com/throated_20230412.xml