cleat.ai
robots.txt

Robots Exclusion Standard data for cleat.ai

Resource Scan

Scan Details

Site Domain cleat.ai
Base Domain cleat.ai
Scan Status Ok
Last Scan2025-10-17T04:15:46+00:00
Next Scan 2025-11-16T04:15:46+00:00

Last Scan

Scanned2025-10-17T04:15:46+00:00
URL https://cleat.ai/robots.txt
Redirect https://www.cleat.ai/robots.txt
Redirect Domain www.cleat.ai
Redirect Base cleat.ai
Domain IPs 216.150.1.1, 216.150.1.129
Redirect IPs 66.33.60.35, 76.76.21.142
Response IP 76.76.21.93
Found Yes
Hash 9cccbf0cb05e03caab31795aaa2f4b4296209ea4236400d33cfc1e8bc76138c4
SimHash 49098232c222

Groups

*

Rule Path
Allow /
Disallow /dashboard/
Disallow /api/
Disallow /ingest/

Other Records

Field Value
sitemap https://www.cleat.ai/sitemap.xml
sitemap https://www.cleat.ai/sitemaps/vendors/index.xml
sitemap https://www.cleat.ai/sitemaps/naics/index.xml
sitemap https://www.cleat.ai/sitemaps/far/index.xml