gotogate.nl
robots.txt
Robots Exclusion Standard data for gotogate.nl
Resource Scan
Scan Details
| Site Domain | gotogate.nl |
| Base Domain | gotogate.nl |
| Scan Status | Ok |
| Last Scan | 2024-11-11T07:55:07+00:00 |
| Next Scan | 2024-11-18T07:55:07+00:00 |
Last Scan
| Scanned | 2024-11-11T07:55:07+00:00 |
| URL | https://www.gotogate.nl/robots.txt |
| Domain IPs | 23.50.93.181, 2600:1413:b000:39a::22ee, 2600:1413:b000:39c::22ee |
| Response IP | 23.50.93.181 |
| Found | Yes |
| Hash | 0e263f7d6b4da440b99a6a30cfd88d62d32438c53dd3ecc11e487dd1f45f1c3a |
| SimHash | 380c7600e872 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ajax* |
| Disallow | /*.action$ |
| Disallow | /rf/mobile-travel-plan/* |
| Disallow | /from/ |
| Disallow | /top/ |
| Disallow | /rf/result |
| Disallow | /rf/traveler-details |
| Disallow | /rf/payment |
| Disallow | /rf/order-login |
| Disallow | /order-ntd-generate-ref/ |
| Disallow | /payment |
| Disallow | /sourcefiles/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.gotogate.nl/sitemap.xml |