in.goibibo.com
robots.txt

Robots Exclusion Standard data for in.goibibo.com

Resource Scan

Scan Details

Site Domain in.goibibo.com
Base Domain goibibo.com
Scan Status Ok
Last Scan2025-08-30T09:01:54+00:00
Next Scan 2025-09-29T09:01:54+00:00

Last Scan

Scanned2025-08-30T09:01:54+00:00
URL https://in.goibibo.com/robots.txt
Domain IPs 23.45.207.79, 23.45.207.83, 2600:1413:b000:1c::17d1:2ec5, 2600:1413:b000:1c::17d1:2ec6
Response IP 23.45.207.79
Found Yes
Hash fd3b88cc27f886ab7a783809b34cfedf1aee03bacc39a4dfddaa69a1d5609705
SimHash 1b1d25868eda

Groups

*

Rule Path
Disallow /static/others/Pay%40HotelsAddendum.pdf
Disallow /static/others/GoibiboAgreement.pdf
Disallow /static/others/TNC_Popup_Existing_Domestic_India.pdf
Disallow /static/others/TNC_Popup_Existing_Dubai.pdf
Disallow /static/others/TNC_Popup_Existing_Rest_of_the_World.pdf

Comments

  • Disallow indexing/crawling of specific PDF documents