leadar.ai
robots.txt
Robots Exclusion Standard data for leadar.ai
Resource Scan
Scan Details
| Site Domain | leadar.ai |
| Base Domain | leadar.ai |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-10-08T15:00:20+00:00 |
| Next Scan | 2026-01-06T15:00:20+00:00 |
Last Successful Scan
| Scanned | 2024-11-20T08:46:47+00:00 |
| URL | https://leadar.ai/robots.txt |
| Redirect | https://www.leadar.info/robots.txt |
| Redirect Domain | www.leadar.info |
| Redirect Base | leadar.info |
| Domain IPs | 104.21.70.145, 172.67.136.188, 2606:4700:3034::6815:4691, 2606:4700:3035::ac43:88bc |
| Redirect IPs | 104.18.8.175, 104.18.9.175, 2606:4700::6812:8af, 2606:4700::6812:9af |
| Response IP | 104.18.9.175 |
| Found | Yes |
| Hash | e807e20984712ae80920be8abb8d5f3600d3e7f2d7a554bbb80a37d95b890fcd |
| SimHash | f009dae0a813 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /opt-out/profile |
| Disallow | /search* |
| Disallow | /api/* |
| Disallow | /register |
| Disallow | /reset-password |
| Disallow | /forgot-password |
| Disallow | /login |
| Disallow | /logout |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.leadar.info/sitemap.xml |