pettravel.com
robots.txt

Robots Exclusion Standard data for pettravel.com

Resource Scan

Scan Details

Site Domain pettravel.com
Base Domain pettravel.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-02T22:31:46+00:00
Next Scan 2024-12-02T22:31:46+00:00

Last Successful Scan

Scanned2024-10-04T22:19:20+00:00
URL https://www.pettravel.com/robots.txt
Domain IPs 103.26.143.176
Response IP 103.26.143.176
Found Yes
Hash 8508cbe363a2012a59ef868827a18104afa0ae7ac4f7c77c77047c1b7cde8819
SimHash 7123f860d371

Groups

*

Rule Path
Disallow /0001213.cfmm
Disallow /pet-friendly-hotels-search.cfm
Disallow /forum/showthread.php/5675-Flying-with-a-dog-Avoid-%E2%80%98aia-pets%E2%80%99-at-all-costs
Disallow /test/
Disallow /mpa/
Disallow /travel.html
Disallow /pet-links/
Disallow /pet_links.cfm
Disallow /pet_links_a.cfm
Disallow /aspnet_client/
Disallow /phpmyadmin/
Disallow /store/
Disallow /Suppliers/
Disallow /suppliers/
Disallow /db/
Disallow /cgi-bin/
Disallow /supp-ad/
Disallow /bin/
Disallow /hotel/
Disallow /assets/
Disallow /ccount/
Disallow /chk/
Disallow /cp/
Disallow /scripts/
Disallow /SearchDemo/
Disallow /fonts/
Disallow /logs/
Disallow /mm/
Disallow /ssl/
Disallow /cfNew_MiniSearchMs1_responsive.cfm
Disallow /airline_pet_rules/images/
Disallow /airline_pet_rules/assets/
Disallow /airline_pet_rules/Backup/
Disallow /cruiseship_ferry/assets/
Disallow /cruiseship_ferry/images/
Disallow /destinations/assets/
Disallow /destinations/images/
Disallow /destinations/maps/
Disallow /destinations/
Disallow /destinationsTest/
Disallow /forum/member/
Disallow /forum/privatemessage/
Disallow /forum/memberlist/
Disallow /forum/filedata/
Disallow /forum/advanced_search/
Disallow /immigration/assets/
Disallow /immigration/Backup/
Disallow /immigration/Flags/
Disallow /immigration/images/
Disallow /blog/xmlrpc.php
Disallow /regions/Suppliers/
Disallow /regions/assets/
Disallow /regions/images/
Disallow /Adv_Order_Form.cfm
Disallow /Ad_Samp_City.cfm
Disallow /View_Supplier_Free_Template.cfm
Disallow /NullStateUpdater_GB.cfm
Disallow /NullStateUpdater_FR.cfm
Disallow /NullStateUpdater.cfm
Disallow /cfNullStateUpdater_GB.cfm
Disallow /cfNullStateUpdater_FR.cfm
Disallow /cfNullStateUpdater.cfm
Disallow /ResSystem.cfm
Disallow /cfResSystem.cfm
Disallow /PetResTutorial16.cfm
Disallow /PetResTutorial15.cfm
Disallow /PetResTutorial14.cfm
Disallow /PetResTutorial13.cfm
Disallow /PetResTutorial12.cfm
Disallow /PetResTutorial11.cfm
Disallow /PetResTutorial10.cfm
Disallow /PetResTutorial9.cfm
Disallow /PetResTutorial8.cfm
Disallow /PetResTutorial7.cfm
Disallow /PetResTutorial6.cfm
Disallow /PetResTutorial5.cfm
Disallow /PetResTutorial4.cfm
Disallow /PetResTutorial3.cfm
Disallow /PetResTutorial2.cfm
Disallow /PetResTutorial.cfm
Disallow /cfPetResTutorial16.cfm
Disallow /cfPetResTutorial15.cfm
Disallow /cfPetResTutorial14.cfm
Disallow /cfPetResTutorial13.cfm
Disallow /cfPetResTutorial12.cfm
Disallow /cfPetResTutorial11.cfm
Disallow /cfPetResTutorial10.cfm
Disallow /cfPetResTutorial9.cfm
Disallow /cfPetResTutorial8.cfm
Disallow /cfPetResTutorial7.cfm
Disallow /cfPetResTutorial6.cfm
Disallow /cfPetResTutorial5.cfm
Disallow /cfPetResTutorial4.cfm
Disallow /cfPetResTutorial3.cfm
Disallow /cfPetResTutorial2.cfm
Disallow /cfPetResTutorial.cfm
Disallow /cfPetResMemberView.cfm
Disallow /cfPetResBanner4.cfm
Disallow /cfPetResBanner3.cfm
Disallow /cfPetResBanner2.cfm
Disallow /cfPetResBanner.cfm
Disallow /cfNew_MiniSearchMs1_responsive.cfm
Disallow /cfNew_MiniSearchMs.cfm
Disallow /mstr-2011-destination.html
Disallow /mstr-3col-2011.html
Disallow /mstr-2col-2011.html
Disallow /mstr-3col-2011-index.html
Disallow /mstr-2011-destination.dwt
Disallow /mstr-3col-2011.dwt
Disallow /mstr-2col-2011.dwt
Disallow /mstr-3col-2011-index.dwt
Disallow /mstr-2col-2011-admin.dwt
Disallow /mstr-2col-2011-admin.html
Disallow /site-map-country-pages.cfm
Disallow /site-map-city-pages-Canada.cfm
Disallow /site-map-city-pages-United-States.cfm
Disallow /site-map-pet-friendly-airline-rules-regulations-old.cfm
Disallow /site-map-petpassport-immigration-rules-regulations.cfm
Disallow /site-map-state-pages-United-States.cfm
Disallow /View_Supplier_FreeTemplate.cfm?pl=1
Allow /

Other Records

Field Value
sitemap http://a149035.sitemaphosting.com/4059956/sitemap.xml

Warnings

  • 1 invalid line.