cerave.bg
robots.txt

Robots Exclusion Standard data for cerave.bg

Resource Scan

Scan Details

Site Domain cerave.bg
Base Domain cerave.bg
Scan Status Ok
Last Scan2024-10-05T11:17:43+00:00
Next Scan 2024-10-19T11:17:43+00:00

Last Scan

Scanned2024-10-05T11:17:43+00:00
URL https://cerave.bg/robots.txt
Redirect https://www.cerave.bg/robots.txt
Redirect Domain www.cerave.bg
Redirect Base cerave.bg
Domain IPs 104.18.39.68, 172.64.148.188, 2606:4700:4400::6812:2744, 2606:4700:4400::ac40:94bc
Redirect IPs 104.18.39.68, 172.64.148.188, 2606:4700:4400::6812:2744, 2606:4700:4400::ac40:94bc
Response IP 172.64.148.188
Found Yes
Hash 13c1eab9bff2bd83d96641bf9798c25d5ea5aa3c8ddb25b598fd73fe1152117f
SimHash 28510c774711

Groups

*

Rule Path
Disallow /xsl/
Disallow /temp/
Disallow /upload/
Disallow /sitecore
Disallow /Sitecore
Disallow *%26bvroute
Disallow *?bvroute
Disallow *?bvstate
Disallow *bvstate*
Disallow /App_Data/
Disallow /search?q=
Disallow /App_config/
Disallow /prosamples/
Disallow /App_Browsers/
Disallow /sitecore_files/

Other Records

Field Value
sitemap https://www.cerave.bg/sitemap-index.xml

Warnings

  • 1 invalid line.