travelio.co.id
robots.txt

Robots Exclusion Standard data for travelio.co.id

Resource Scan

Scan Details

Site Domain travelio.co.id
Base Domain travelio.co.id
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-01-20T02:58:44+00:00
Next Scan 2025-04-20T02:58:44+00:00

Last Successful Scan

Scanned2024-09-16T02:34:53+00:00
URL https://travelio.co.id/robots.txt
Redirect https://www.travelio.co.id/robots.txt
Redirect Domain www.travelio.co.id
Redirect Base travelio.co.id
Domain IPs 104.26.2.116, 104.26.3.116, 172.67.74.245, 2606:4700:20::681a:274, 2606:4700:20::681a:374, 2606:4700:20::ac43:4af5
Redirect IPs 104.26.2.116, 104.26.3.116, 172.67.74.245, 2606:4700:20::681a:274, 2606:4700:20::681a:374, 2606:4700:20::ac43:4af5
Response IP 104.26.3.116
Found Yes
Hash 5711aa7be6cbc6ed36e44d270245de15b75fb00b6eb31c4faea257ca2c5e3b3f
SimHash 4404c4444053

Groups

*

Rule Path
Allow /
Disallow /cdn-cgi/
Disallow /en/welcome
Disallow /welcome
Disallow /en/tpm/guestinfo
Disallow /tpm/guestinfo
Disallow /en/tpm/checkin
Disallow /tpm/checkin
Disallow /en/tripreview
Disallow /tripreview
Disallow /dapenbun
Disallow /en/dapenbun
Disallow /test-result
Disallow /blog/wp-admin/admin-ajax.php

Other Records

Field Value
sitemap http://www.travelio.com/sitemaps/landmark/sitemap.xml
sitemap http://www.travelio.com/sitemaps/city/sitemap.xml
sitemap http://www.travelio.com/sitemaps/area/sitemap.xml
sitemap http://www.travelio.com/sitemaps/property/sitemap.xml
sitemap http://www.travelio.com/sitemaps/propertyforsale/sitemap.xml
sitemap http://www.travelio.com/sitemaps/building/sitemap.xml
sitemap http://www.travelio.com/sitemaps/sitemap-static.xml