c-sgroup.com
robots.txt

Robots Exclusion Standard data for c-sgroup.com

Resource Scan

Scan Details

Site Domain c-sgroup.com
Base Domain c-sgroup.com
Scan Status Ok
Last Scan2024-10-22T00:49:55+00:00
Next Scan 2024-11-21T00:49:55+00:00

Last Scan

Scanned2024-10-22T00:49:55+00:00
URL https://c-sgroup.com/robots.txt
Redirect https://www.c-sgroup.com/robots.txt
Redirect Domain www.c-sgroup.com
Redirect Base c-sgroup.com
Domain IPs 172.191.27.42
Redirect IPs 172.191.27.42
Response IP 172.191.27.42
Found Yes
Hash 58e068daafab873d7c3da2018bc2895a657b28cd8b548e5ce98f59d2fe23f6b6
SimHash 98011e758c52

Groups

*

Rule Path
Disallow /js/
Disallow /api/
Disallow /css/
Disallow /xsl/
Disallow /temp/
Disallow /upload/
Disallow /sitecore
Disallow /Sitecore
Disallow /sitecore/
Disallow /App_Data/
Disallow /App_config/
Disallow /App_Browsers/
Disallow /sitecore_files/

darodar

Rule Path
Disallow /

hypestat

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

appcodescrawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.c-sgroup.com/sitemap.xml

Warnings

  • 1 invalid line.