korbit.ai
robots.txt

Robots Exclusion Standard data for korbit.ai

Resource Scan

Scan Details

Site Domain korbit.ai
Base Domain korbit.ai
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-12-09T13:32:01+00:00
Next Scan 2026-02-07T13:32:01+00:00

Last Successful Scan

Scanned2025-09-16T16:29:55+00:00
URL https://korbit.ai/robots.txt
Redirect https://www.korbit.ai/robots.txt
Redirect Domain www.korbit.ai
Redirect Base korbit.ai
Domain IPs 75.2.70.75, 99.83.190.102
Redirect IPs 13.203.125.58, 13.233.175.166, 3.109.243.18
Response IP 35.152.117.67
Found Yes
Hash c882711ef05295be6127a387236107df6b3e848ae2b52391ce884bfb4f7c3667
SimHash ad08ae40e013

Groups

*

Rule Path
Disallow /fr
Disallow /fr/

Other Records

Field Value
sitemap https://www.korbit.ai/sitemap.xml