trip101.com
robots.txt

Robots Exclusion Standard data for trip101.com

Resource Scan

Scan Details

Site Domain trip101.com
Base Domain trip101.com
Scan Status Ok
Last Scan2024-11-03T17:56:40+00:00
Next Scan 2024-11-10T17:56:40+00:00

Last Scan

Scanned2024-11-03T17:56:40+00:00
URL https://trip101.com/robots.txt
Domain IPs 104.26.4.31, 104.26.5.31, 172.67.71.15, 2606:4700:20::681a:41f, 2606:4700:20::681a:51f, 2606:4700:20::ac43:470f
Response IP 172.67.71.15
Found Yes
Hash e63831fd55009f181ffd916510e30dec6684bacf8b07102abcd4fd2e1877bc62
SimHash a9885b857785

Groups

*

Rule Path
Disallow /search*
Disallow /load-in-iframe*
Disallow /redirect-url*
Disallow /auth/*
Disallow /niche/*
Disallow /tags/*
Disallow /*/hotels$
Disallow /*/things-to-do$
Disallow /*/things-to-do/*
Disallow /*/airbnb-vacation-rentals$
Disallow /*/airbnb-vacation-rentals/*
Disallow /*/hotels$
Disallow /*/hotels/*
Disallow /*/vacation_rental_sbox$
Disallow /sbox*
Disallow /us/us-attractions*
Disallow /japan/japan-attractions*
Disallow /api/*
Disallow /plugins/*
Disallow /p/*
Disallow /packs/*

googlebot

Rule Path
Allow /.well-known/amphtml/apikey.pub
Disallow /search*
Disallow /load-in-iframe*
Disallow /redirect-url*
Disallow /auth/*
Disallow /niche/*
Disallow /tags/*
Disallow /*/hotels$
Disallow /*/things-to-do$
Disallow /*/things-to-do/*
Disallow /*/airbnb-vacation-rentals$
Disallow /*/airbnb-vacation-rentals/*
Disallow /*/hotels$
Disallow /*/hotels/*
Disallow /*/vacation_rental_sbox$
Disallow /sbox*
Disallow /us/us-attractions*
Disallow /japan/japan-attractions*
Disallow /api/*
Disallow /plugins/*
Disallow /p/*
Disallow /packs/*

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • disallow: /*/comments$
  • disallow: /*/2$
  • disallow: /*/3$
  • disallow: /*/4$
  • disallow: /*/5$
  • disallow: /*/6$
  • disallow: /*/7$
  • disallow: /*/8$
  • disallow: /*/9$
  • disallow: /*/10$
  • disallow: /*/11$
  • disallow: /*/12$
  • disallow: /*/13$
  • disallow: /*/14$
  • disallow: /*/15$
  • disallow: /*/16$
  • disallow: /*/17$
  • disallow: /*/18$
  • disallow: /*/19$
  • disallow: /*/20$
  • disallow: /custom-paragraph/*
  • disallow: /*/1000$
  • disallow: /*/comments$
  • disallow: /*/2$
  • disallow: /*/3$
  • disallow: /*/4$
  • disallow: /*/5$
  • disallow: /*/6$
  • disallow: /*/7$
  • disallow: /*/8$
  • disallow: /*/9$
  • disallow: /*/10$
  • disallow: /*/13$
  • disallow: /*/14$
  • disallow: /*/15$
  • disallow: /*/16$
  • disallow: /*/17$
  • disallow: /*/18$
  • disallow: /*/19$
  • disallow: /*/20$
  • disallow: /custom-paragraph/*
  • disallow: /*/1000$