puretaboo.com
robots.txt

Robots Exclusion Standard data for puretaboo.com

Resource Scan

Scan Details

Site Domain puretaboo.com
Base Domain puretaboo.com
Scan Status Ok
Last Scan2024-09-01T08:33:52+00:00
Next Scan 2024-10-01T08:33:52+00:00

Last Scan

Scanned2024-09-01T08:33:52+00:00
URL https://puretaboo.com/robots.txt
Redirect https://www.puretaboo.com/robots.txt
Redirect Domain www.puretaboo.com
Redirect Base puretaboo.com
Domain IPs 104.27.201.89, 104.27.202.89
Redirect IPs 104.27.201.89, 104.27.202.89
Response IP 104.27.202.89
Found Yes
Hash 4a9edd6c0ac13977ff69c294698f3a0ba3cfc83d13d28387ee0eb391da53a9fa
SimHash 384d044d8b92

Groups

*

Rule Path
Disallow /ratings/actor*
Disallow /media/signPhotoset*

Other Records

Field Value
sitemap https://www.puretaboo.com/sitemap/main.xml
sitemap https://www.puretaboo.com/sitemap/actor.xml
sitemap https://www.puretaboo.com/sitemap/scene-1.xml
sitemap https://www.puretaboo.com/sitemap/scene-2.xml
sitemap https://www.puretaboo.com/sitemap/photoset-1.xml
sitemap https://www.puretaboo.com/sitemap/photoset-2.xml
sitemap https://xmlsitemap.puretaboo.com/puretaboo_20210707.xml