Log In Sign Up

thesoftsense.com
robots.txt

Robots Exclusion Standard data for thesoftsense.com

Resource Scan

Scan Details

Site Domain thesoftsense.com
Base Domain thesoftsense.com
Scan Status Ok
Last Scan4/11/2025, 2:40:20 AM
Next Scan 4/18/2025, 2:40:20 AM

Last Scan

Scanned4/11/2025, 2:40:20 AM
URL https://thesoftsense.com/robots.txt
Redirect https://www.thesoftsense.com/robots.txt
Redirect Domain www.thesoftsense.com
Redirect Base thesoftsense.com
Domain IPs 104.21.95.222, 172.67.171.124, 2606:4700:3030::ac43:ab7c, 2606:4700:3036::6815:5fde
Redirect IPs 104.21.95.222, 172.67.171.124, 2606:4700:3030::ac43:ab7c, 2606:4700:3036::6815:5fde
Response IP 104.21.95.222
Found Yes
Hash c823ec1e3d89d55933e4b9c247e36e039491d3aaf7ec3c7627cd4282b03ecb74
SimHash 0b1494f07e9a

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Allow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.thesoftsense.com/sitemap.xml
sitemap https://www.thesoftsense.com/sitemap-pages.xml
Back to top