agencyafrica.com
robots.txt
Robots Exclusion Standard data for agencyafrica.com
Resource Scan
Scan Details
| Site Domain | agencyafrica.com |
| Base Domain | agencyafrica.com |
| Scan Status | Ok |
| Last Scan | 2024-09-06T05:50:19+00:00 |
| Next Scan | 2024-10-06T05:50:19+00:00 |
Last Scan
| Scanned | 2024-09-06T05:50:19+00:00 |
| URL | https://agencyafrica.com/robots.txt |
| Redirect | https://www.agencyafrica.com/robots.txt |
| Redirect Domain | www.agencyafrica.com |
| Redirect Base | agencyafrica.com |
| Domain IPs | 172.66.40.107, 172.66.43.149, 2606:4700:3108::ac42:286b, 2606:4700:3108::ac42:2b95 |
| Redirect IPs | 172.66.40.107, 172.66.43.149, 2606:4700:3108::ac42:286b, 2606:4700:3108::ac42:2b95 |
| Response IP | 172.66.40.107 |
| Found | Yes |
| Hash | 6233d56f7c310f4910a1c8b1cd1914d6df5c59c2ffc2365bfde60539e636fa96 |
| SimHash | 8c01ca31d5b1 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | /online-travel-agencies-otas.html |
| Disallow | /mobile-apps.html |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.agencyafrica.com/sitemap.xml |
Comments