dreamsunlimitedtravel.com
robots.txt

Robots Exclusion Standard data for dreamsunlimitedtravel.com

Resource Scan

Scan Details

Site Domain dreamsunlimitedtravel.com
Base Domain dreamsunlimitedtravel.com
Scan Status Ok
Last Scan2024-09-19T21:45:00+00:00
Next Scan 2024-10-19T21:45:00+00:00

Last Scan

Scanned2024-09-19T21:45:00+00:00
URL https://dreamsunlimitedtravel.com/robots.txt
Domain IPs 108.166.45.240
Response IP 108.166.45.240
Found Yes
Hash 0278e42b5f76f67e320c789fbd9ceafa6d7d17c079bbe491f4b028f70af986ed
SimHash 788069cc5471

Groups

*

Rule Path
Disallow /adm-bv
Disallow /adm-cu
Disallow /adm-cy
Disallow /adm-dolphin
Disallow /adm-hr
Disallow /adm-pb
Disallow /adm-sd
Disallow /adm-svv
Disallow /adm-svr
Disallow /admin
Disallow /bwplaza
Disallow /cgi-bin
Disallow /dcruise/holland/
Disallow /dlreports
Disallow /himge/
Disallow /log
Disallow /media
Disallow /newsreleases/
Disallow /process
Disallow /p1305
Disallow /p3105
Disallow /ramada/
Disallow /rescenter
Disallow /RadissonPrkwy/info.htm
Disallow /tour2000
Disallow /tour2000
Disallow /travelodge
Disallow /celebration
Disallow /category/
Disallow /tag/
Disallow /type/
Disallow /test
Disallow /author
Disallow /blog/
Disallow /sample
Disallow /2013/
Disallow /2014/
Disallow /beautiful-gallery-post/
Disallow /audio-without-image/
Disallow /standard-post-with-no-featured-image/
Disallow /reservations/PCC6_02.cfm
Disallow /courtyard/

Comments

  • /robots.txt file for http://webcrawler.com/
  • mail webmaster@webcrawler.com for constructive criticism