cantika.com
robots.txt

Robots Exclusion Standard data for cantika.com

Resource Scan

Scan Details

Site Domain cantika.com
Base Domain cantika.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-13T06:40:20+00:00
Next Scan 2024-12-13T06:40:20+00:00

Last Successful Scan

Scanned2024-10-15T06:31:39+00:00
URL https://cantika.com/robots.txt
Redirect https://www.cantika.com:443/robots.txt
Redirect Domain www.cantika.com
Redirect Base cantika.com
Domain IPs 108.137.14.39, 43.218.172.96
Redirect IPs 104.18.6.159, 104.18.7.159, 2606:4700::6812:69f, 2606:4700::6812:79f
Response IP 104.18.6.159
Found Yes
Hash 5a0168aed90622ac431a6cc37171cf17a4502172e23c0c17ce189227440723bd
SimHash 481498750783

Groups

googlebot

Rule Path
Disallow /ajax/
Disallow /search/
Disallow /indeks/

*

Rule Path
Disallow /ajax/

grapeshot

Rule Path
Allow /

chatgpt-user

Rule Path
Disallow /

openai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.cantika.com/sitemap.xml