arewethere-yet.com
robots.txt

Robots Exclusion Standard data for arewethere-yet.com

Resource Scan

Scan Details

Site Domain arewethere-yet.com
Base Domain arewethere-yet.com
Scan Status Ok
Last Scan2024-10-05T08:33:04+00:00
Next Scan 2024-10-12T08:33:04+00:00

Last Scan

Scanned2024-10-05T08:33:04+00:00
URL https://arewethere-yet.com/robots.txt
Domain IPs 70.32.24.247
Response IP 70.32.24.247
Found Yes
Hash 84438caaa858b5139f6979fa8632e37161ba64090feee85dee2f9a1af001c1a4
SimHash 69ca8a454795

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /config/
Disallow /blog/config/
Disallow /monitor/
Disallow /monitor/config/
Disallow /WEB-INF/
Disallow /blog/pages/login/login.dhtml
Disallow /monitor/pages/login/login.dhtml
Disallow /wordyexplorers/monitor/
Disallow /wordyexplorers/cgi-bin/
Disallow /wordyexplorers/config/
Disallow /wordyexplorers/blog/config/
Disallow /wordyexplorers/monitor/config/
Disallow /wordyexplorers/WEB-INF/
Disallow /wordyexplorers/blog/pages/login/login.dhtml
Disallow /wordyexplorers/monitor/pages/login/login.dhtml
Disallow /wordyexplorers/blog/search/search.dhtml
Disallow /wordyexplorers/blog/search/searchresults.dhtml
Disallow /wordyexplorers/blog/curate_flipboard.rss
Disallow /wordyexplorers/blog/curate_flipboard_camping.rss
Disallow /wordyexplorers/blog/curate_flipboard_cruises.rss
Disallow /wordyexplorers/blog/curate_flipboard_destinations.rss
Disallow /wordyexplorers/blog/curate_flipboard_planning.rss
Disallow /wordyexplorers/blog/curate_pinterest.rss
Disallow /*.pho$

Other Records

Field Value
sitemap http://arewethere-yet.com/wordyexplorers/sitemap.xml