softsheen-carson.com
robots.txt

Robots Exclusion Standard data for softsheen-carson.com

Resource Scan

Scan Details

Site Domain softsheen-carson.com
Base Domain softsheen-carson.com
Scan Status Ok
Last Scan2024-06-19T17:59:13+00:00
Next Scan 2024-07-03T17:59:13+00:00

Last Scan

Scanned2024-06-19T17:59:13+00:00
URL https://softsheen-carson.com/robots.txt
Redirect https://www.softsheen-carson.com/robots.txt
Redirect Domain www.softsheen-carson.com
Redirect Base softsheen-carson.com
Domain IPs 104.18.34.107, 172.64.153.149, 2606:4700:4400::6812:226b, 2606:4700:4400::ac40:9995
Redirect IPs 104.18.34.107, 172.64.153.149, 2606:4700:4400::6812:226b, 2606:4700:4400::ac40:9995
Response IP 104.18.34.107
Found Yes
Hash 50a0d2bb583ad6ca28d02eb71d8ab8d0463a285d450289881ab605c5405c0ade
SimHash e54c6a9307e7

Groups

*

Rule Path
Disallow /*%7B
Disallow /*%7D
Disallow /*xsl
Disallow /*temp
Disallow /Views
Disallow /*.gz$
Disallow /*error
Disallow /*.inc$
Disallow /*.wmv$
Disallow /*.cgi$
Disallow /*.zip$
Disallow /*Models
Disallow /*upload
Disallow /layouts
Disallow /sign-in
Disallow /*.xlsx$
Disallow /*Content
Disallow /sitecore
Disallow /*sign-in
Disallow /*Handlers
Disallow /*Managers
Disallow /*register
Disallow /*/layouts
Disallow /pro-signin
Disallow /*Extensions
Disallow /*Properties
Disallow /*/templates
Disallow /*Controllers
Disallow /pro-register
Disallow /sitecore_files
Disallow /for-professionals
Disallow /retrieve-password
Disallow /magic-shave/sign-in
Disallow /*/pdtquickview.html

Other Records

Field Value
crawl-delay 180

Other Records

Field Value
sitemap https://www.softsheen-carson.com/sitemap-index.xml

Warnings

  • 1 invalid line.