akala.ai
robots.txt

Robots Exclusion Standard data for akala.ai

Resource Scan

Scan Details

Site Domain akala.ai
Base Domain akala.ai
Scan Status Ok
Last Scan2024-11-12T04:23:22+00:00
Next Scan 2024-11-19T04:23:22+00:00

Last Scan

Scanned2024-11-12T04:23:22+00:00
URL https://akala.ai/robots.txt
Domain IPs 13.225.4.21, 13.225.4.62, 13.225.4.92, 13.225.4.94
Response IP 13.225.4.21
Found Yes
Hash c099857f4006a927fe4e5dd763a9f4aade3634dcde03fc93c83361fbe24e67c3
SimHash 501cca408518

Groups

yandex

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /companies/products-and-services/
Disallow /companies/*/patents-designs-trademarks/
Disallow /companies/*/jobs-*

Other Records

Field Value
sitemap https://akala.ai/sitemap.xml