abitant.com
robots.txt
Robots Exclusion Standard data for abitant.com
Resource Scan
Scan Details
| Site Domain | abitant.com |
| Base Domain | abitant.com |
| Scan Status | Ok |
| Last Scan | 2025-09-25T12:20:48+00:00 |
| Next Scan | 2025-10-25T12:20:48+00:00 |
Last Scan
| Scanned | 2025-09-25T12:20:48+00:00 |
| URL | https://abitant.com/robots.txt |
| Redirect | https://www.abitant.com/robots.txt |
| Redirect Domain | www.abitant.com |
| Redirect Base | abitant.com |
| Domain IPs | 104.21.65.208, 172.67.167.15, 2606:4700:3033::6815:41d0, 2606:4700:3035::ac43:a70f |
| Redirect IPs | 104.21.65.208, 172.67.167.15, 2606:4700:3033::6815:41d0, 2606:4700:3035::ac43:a70f |
| Response IP | 172.67.167.15 |
| Found | Yes |
| Hash | 9f2359e7376908dbeca2a19ac6ca39efc59d899379e0fba33057eb310b0f1806 |
| SimHash | 5f05be00a7f1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin* |
| Disallow | /redirect |
| Disallow | /events |
| Disallow | /en/events |
| Disallow | /it/events |
| Disallow | /en |
| Disallow | /it |
| Disallow | /es |
| Disallow | /*/destroy* |
| Disallow | /*/edit* |
| Disallow | /users/footmarks_users/* |
| Disallow | /apipie |
| Disallow | /search |
| Disallow | /rc |
| Disallow | /photobank |
| Disallow | /primatel_events |
| Disallow | /user_profile/* |
| Disallow | /buyer_profile/* |
| Disallow | *?* |
yandex
| Rule | Path |
|---|---|
| Disallow | /admin* |
| Disallow | /redirect |
| Disallow | /events |
| Disallow | /en/events |
| Disallow | /it/events |
| Disallow | /en |
| Disallow | /it |
| Disallow | /es |
| Disallow | /*/destroy* |
| Disallow | /*/edit* |
| Disallow | /users/footmarks_users/* |
| Disallow | /apipie |
| Disallow | /search |
| Disallow | /rc |
| Disallow | /photobank |
| Disallow | /primatel_events |
| Disallow | /user_profile/* |
| Disallow | /buyer_profile/* |
| Disallow | *?* |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.abitant.com/sitemap.xml.gz |
Warnings
- `host` is not a known field.