venuedirectory.com
robots.txt

Robots Exclusion Standard data for venuedirectory.com

Resource Scan

Scan Details

Site Domain venuedirectory.com
Base Domain venuedirectory.com
Scan Status Ok
Last Scan2024-10-09T08:38:32+00:00
Next Scan 2024-11-08T08:38:32+00:00

Last Scan

Scanned2024-10-09T08:38:32+00:00
URL https://venuedirectory.com/robots.txt
Redirect https://www.venuedirectory.com/robots.txt
Redirect Domain www.venuedirectory.com
Redirect Base venuedirectory.com
Domain IPs 13.107.253.59
Redirect IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.70
Found Yes
Hash 839163ce2acf0ae074144f4e37bd98f55955ad5bd29ea39a49aa744608b969f6
SimHash b30a59634ff0

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /aspnet_client/
Disallow /bin/
Disallow /config/
Disallow /css/
Disallow /data/
Disallow /install/
Disallow /masterpages/
Disallow /python/
Disallow /scripts/
Disallow /umbraco/
Disallow /umbraco_client/
Disallow /usercontrols/
Disallow /xslt/
Disallow /blogs/tags/
Disallow /find-venue-map
Disallow /forgot-password
Allow /

mj12bot
spbot
ccbot
domain re-animator bot
linguee bot
bdcbot
screaming frog seo spider
dotbot

Rule Path
Disallow /

Comments

  • robots.txt for Umbraco