totalshape.com
robots.txt

Robots Exclusion Standard data for totalshape.com

Resource Scan

Scan Details

Site Domain totalshape.com
Base Domain totalshape.com
Scan Status Ok
Last Scan2024-11-08T06:57:55+00:00
Next Scan 2024-11-15T06:57:55+00:00

Last Scan

Scanned2024-11-08T06:57:55+00:00
URL https://totalshape.com/robots.txt
Domain IPs 104.26.10.49, 104.26.11.49, 172.67.74.196, 2606:4700:20::681a:a31, 2606:4700:20::681a:b31, 2606:4700:20::ac43:4ac4
Response IP 104.26.11.49
Found Yes
Hash caa9752ffc07536ea5105e072ebca2e16fb342e2f1ff0079320379386afa2560
SimHash 2b1cb262ec0a

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /product/
Disallow /wpx-security/
Disallow /cdn-cgi/
Disallow /cgi-bin/*
Disallow /captcha/*
Disallow /*?*
Allow /*?ver=*
Disallow /*?unapproved=*
Disallow /*attachment*
Allow /*.css?
Disallow /*/feed/
Disallow /uk/
Disallow /au/
Disallow /ca/
Disallow /take-a-quiz/

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://totalshape.com/sitemap.xml