tours4fun.com
robots.txt

Robots Exclusion Standard data for tours4fun.com

Resource Scan

Scan Details

Site Domain tours4fun.com
Base Domain tours4fun.com
Scan Status Ok
Last Scan2025-05-05T11:43:21+00:00
Next Scan 2025-06-04T11:43:21+00:00

Last Scan

Scanned2025-05-05T11:43:21+00:00
URL https://tours4fun.com/robots.txt
Redirect https://www.tours4fun.com/robots.txt
Redirect Domain www.tours4fun.com
Redirect Base tours4fun.com
Domain IPs 35.244.197.177
Redirect IPs 104.18.40.102, 172.64.147.154, 2606:4700:4400::6812:2866, 2606:4700:4400::ac40:939a
Response IP 104.18.40.102
Found Yes
Hash 0c1d2e28fd372c6c08667bf41bd54b2f54c236f5357c2020b0ba281e1917598f
SimHash 236a2fc3adfc

Groups

*

Rule Path
Disallow /admin/
Disallow /download/
Disallow /includes/
Disallow /temp/
Disallow /pub/
Disallow /templates/
Disallow /urchin/
Disallow /cache/
Disallow /tmp/
Disallow /spiffyCal/
Disallow /ajaxtabs/
Disallow /image/
Disallow /gwo/
Disallow /links.php
Disallow /account.html
Disallow /account_edit.html
Disallow /account_history.html
Disallow /account_history_info.html
Disallow /account_password.html
Disallow /address_book.html
Disallow /address_book_process.html
Disallow /checkout_confirmation.html
Disallow /checkout_confirmation_old.html
Disallow /checkout_payment.html
Disallow /checkout_payment_old.html
Disallow /checkout_payment_address.html
Disallow /checkout_process.html
Disallow /shopping_cart.html
Disallow /checkout_shipping.php
Disallow /checkout_shipping_address.php
Disallow /checkout_success.php
Disallow /cookie_usage.php
Disallow /create_account.php
Disallow /create_account_success.php
Disallow /ipn.php
Disallow /login.html
Disallow /logoff.html
Disallow /password_forgotten.php
Disallow /paypal_notify.php
Disallow /redirect.php
Disallow /shipping_estimator_popup.php
Disallow /ssl_check.php
Disallow /vvc_display.php
Disallow /wpcallback.php
Disallow /travel_companion_profile.html?profile_user_id=44980
Disallow /travel_companion_profile.html?profile_user_id=33659
Disallow /travel_companion_profile.html?profile_user_id=31241
Disallow /travel_companion_profile.html?profile_user_id=58287
Disallow /traveler_photo_votes_detail.php
Disallow /maps.php
Disallow /landing/customer-study-survey.html
Disallow /landing/estudio-de-cliente-encuesta.html
Disallow /landing/affiliate-tonight-program.html
Disallow /affiliate-blog.html?category_id=13
Disallow /popular-s/wall-street/*

bubing

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://www.tours4fun.com/sitemap.xml
sitemap https://www.tours4fun.com/sitemap-new.xml

Comments

  • Generated Robots.txt
  • Robot Exclusion File -- robots.txt
  • Author: Tours4Fun
  • Last Updated : Nov 11th 2016
  • Block BUbiNG bot:
  • Block Internet Archive bot:
  • For the bots that supports it, specify that succesive requests must wait at least 30 seconds: