xml.agency
robots.txt
Robots Exclusion Standard data for xml.agency
Resource Scan
Scan Details
| Site Domain | xml.agency |
| Base Domain | xml.agency |
| Scan Status | Ok |
| Last Scan | 2024-06-20T10:54:36+00:00 |
| Next Scan | 2024-07-04T10:54:36+00:00 |
Last Scan
| Scanned | 2024-06-20T10:54:36+00:00 |
| URL | https://xml.agency/robots.txt |
| Domain IPs | 104.21.12.63, 172.67.193.182, 2606:4700:3033::ac43:c1b6, 2606:4700:3037::6815:c3f |
| Response IP | 104.21.12.63 |
| Found | Yes |
| Hash | 58cda7bb126b2cfb86db0ddfaa92b13d818780c0a8a7ae10492e7eeb6d2d68a5 |
| SimHash | 7d5ada250cdc |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admflow |
| Disallow | /ajax |
| Disallow | /autocomplete |
| Disallow | /avia |
| Disallow | /callcenter |
| Disallow | /chargeback |
| Disallow | /company |
| Disallow | /custom |
| Disallow | /favorite |
| Disallow | /favoriteorders |
| Disallow | /gateway |
| Disallow | /hotel |
| Disallow | /info |
| Disallow | /link |
| Disallow | /news |
| Disallow | /notebook |
| Disallow | /partner |
| Disallow | /payment |
| Disallow | /rebook |
| Disallow | /refund |
| Disallow | /reserve |
| Disallow | /security |
| Disallow | /seo |
| Disallow | /service |
| Disallow | /si_ajax |
| Disallow | /stat |
| Disallow | /tech |
| Disallow | /test |
| Disallow | /tickets |
| Disallow | /train |
| Disallow | /uo_ajax |
| Disallow | /user |
| Disallow | /css |
| Disallow | /files |
| Disallow | /js |
| Disallow | /blog |
Warnings
- `host` is not a known field.