travelio.co.id
robots.txt
Robots Exclusion Standard data for travelio.co.id
Resource Scan
Scan Details
Site Domain | travelio.co.id |
Base Domain | travelio.co.id |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2025-01-20T02:58:44+00:00 |
Next Scan | 2025-04-20T02:58:44+00:00 |
Last Successful Scan
Scanned | 2024-09-16T02:34:53+00:00 |
URL | https://travelio.co.id/robots.txt |
Redirect | https://www.travelio.co.id/robots.txt |
Redirect Domain | www.travelio.co.id |
Redirect Base | travelio.co.id |
Domain IPs | 104.26.2.116, 104.26.3.116, 172.67.74.245, 2606:4700:20::681a:274, 2606:4700:20::681a:374, 2606:4700:20::ac43:4af5 |
Redirect IPs | 104.26.2.116, 104.26.3.116, 172.67.74.245, 2606:4700:20::681a:274, 2606:4700:20::681a:374, 2606:4700:20::ac43:4af5 |
Response IP | 104.26.3.116 |
Found | Yes |
Hash | 5711aa7be6cbc6ed36e44d270245de15b75fb00b6eb31c4faea257ca2c5e3b3f |
SimHash | 4404c4444053 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /cdn-cgi/ |
Disallow | /en/welcome |
Disallow | /welcome |
Disallow | /en/tpm/guestinfo |
Disallow | /tpm/guestinfo |
Disallow | /en/tpm/checkin |
Disallow | /tpm/checkin |
Disallow | /en/tripreview |
Disallow | /tripreview |
Disallow | /dapenbun |
Disallow | /en/dapenbun |
Disallow | /test-result |
Disallow | /blog/wp-admin/admin-ajax.php |
Other Records
Field | Value |
---|---|
sitemap | http://www.travelio.com/sitemaps/landmark/sitemap.xml |
sitemap | http://www.travelio.com/sitemaps/city/sitemap.xml |
sitemap | http://www.travelio.com/sitemaps/area/sitemap.xml |
sitemap | http://www.travelio.com/sitemaps/property/sitemap.xml |
sitemap | http://www.travelio.com/sitemaps/propertyforsale/sitemap.xml |
sitemap | http://www.travelio.com/sitemaps/building/sitemap.xml |
sitemap | http://www.travelio.com/sitemaps/sitemap-static.xml |