Log In Sign Up

aagbi.org
robots.txt

Robots Exclusion Standard data for aagbi.org

Resource Scan

Scan Details

Site Domain aagbi.org
Base Domain aagbi.org
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-09-16T21:03:54+00:00
Next Scan 2025-10-16T21:03:54+00:00

Last Successful Scan

Scanned2025-07-26T18:59:39+00:00
URL http://aagbi.org/robots.txt
Redirect https://anaesthetists.org/robots.txt
Redirect Domain anaesthetists.org
Redirect Base anaesthetists.org
Domain IPs 134.213.21.185
Redirect IPs 104.26.8.131, 104.26.9.131, 172.67.73.156, 2606:4700:20::681a:883, 2606:4700:20::681a:983, 2606:4700:20::ac43:499c
Response IP 104.26.9.131
Found Yes
Hash b254c595f8136b932b6b41e381bc2be6f4db83aec58c237030f510d9f4bc5ffa
SimHash 330d1555c5c5

Groups

*

Rule Path Comment
Disallow /admin/ -
Disallow /App_Browsers/ -
Disallow /App_Code/ -
Disallow /App_Data/ -
Disallow /App_GlobalResources/ -
Disallow /bin/ -
Disallow /Components/ -
Disallow /Config/ -
Disallow /contest/ -
Disallow /controls/ -
Disallow /DesktopModules/ -
Disallow /Documentation/ -
Disallow /HttpModules/ -
Disallow /images/ -
Disallow /Install/ -
Disallow /js/ -
Disallow /Portals/ -
Disallow /Providers/ -
Disallow /Resources/ContentRotator/ -
Disallow /Resources/ControlPanel/ -
Disallow /Resources/Dashboard/ -
Disallow /Resources/FeedBrowser/ -
Disallow /Resources/OpenForceAd/ -
Disallow /Resources/Search/ -
Disallow /Resources/Shared/ -
Disallow /Resources/SkinWidgets/ -
Disallow /Resources/TabStrip/ -
Disallow /Resources/Widgets/ -
Disallow /Activity-Feed/userId/ Do not index user profiles

msnbot

Rule Path Comment
Disallow /admin/ -
Disallow /App_Browsers/ -
Disallow /App_Code/ -
Disallow /App_Data/ -
Disallow /App_GlobalResources/ -
Disallow /bin/ -
Disallow /Components/ -
Disallow /Config/ -
Disallow /contest/ -
Disallow /controls/ -
Disallow /DesktopModules/ -
Disallow /Documentation/ -
Disallow /HttpModules/ -
Disallow /images/ -
Disallow /Install/ -
Disallow /js/ -
Disallow /Portals/ -
Disallow /Providers/ -
Disallow /Resources/ContentRotator/ -
Disallow /Resources/ControlPanel/ -
Disallow /Resources/Dashboard/ -
Disallow /Resources/FeedBrowser/ -
Disallow /Resources/OpenForceAd/ -
Disallow /Resources/Search/ -
Disallow /Resources/Shared/ -
Disallow /Resources/SkinWidgets/ -
Disallow /Resources/TabStrip/ -
Disallow /Resources/Widgets/ -
Disallow /Activity-Feed/userId/ Do not index user profiles

Other Records

Field Value
crawl-delay 5

slurp

Rule Path Comment
Disallow /*/ctl/ Slurp permits *
Disallow /admin/ -
Disallow /App_Browsers/ -
Disallow /App_Code/ -
Disallow /App_Data/ -
Disallow /App_GlobalResources/ -
Disallow /bin/ -
Disallow /Components/ -
Disallow /Config/ -
Disallow /contest/ -
Disallow /controls/ -
Disallow /DesktopModules/ -
Disallow /Documentation/ -
Disallow /HttpModules/ -
Disallow /images/ -
Disallow /Install/ -
Disallow /js/ -
Disallow /Portals/ -
Disallow /Providers/ -
Disallow /Resources/ContentRotator/ -
Disallow /Resources/ControlPanel/ -
Disallow /Resources/Dashboard/ -
Disallow /Resources/FeedBrowser/ -
Disallow /Resources/OpenForceAd/ -
Disallow /Resources/Search/ -
Disallow /Resources/Shared/ -
Disallow /Resources/SkinWidgets/ -
Disallow /Resources/TabStrip/ -
Disallow /Resources/Widgets/ -
Disallow /Activity-Feed/userId/ Do not index user profiles

Other Records

Field Value
crawl-delay 5

googlebot

Rule Path Comment
Disallow /*/ctl/ Googlebot permits *
Disallow /admin/ -
Disallow /App_Browsers/ -
Disallow /App_Code/ -
Disallow /App_Data/ -
Disallow /App_GlobalResources/ -
Disallow /bin/ -
Disallow /Components/ -
Disallow /Config/ -
Disallow /contest/ -
Disallow /controls/ -
Disallow /DesktopModules/ -
Disallow /Documentation/ -
Disallow /HttpModules/ -
Disallow /images/ -
Disallow /Install/ -
Disallow /js/ -
Disallow /Portals/ -
Disallow /Providers/ -
Disallow /Resources/ContentRotator/ -
Disallow /Resources/ControlPanel/ -
Disallow /Resources/Dashboard/ -
Disallow /Resources/FeedBrowser/ -
Disallow /Resources/OpenForceAd/ -
Disallow /Resources/Search/ -
Disallow /Resources/Shared/ -
Disallow /Resources/SkinWidgets/ -
Disallow /Resources/TabStrip/ -
Disallow /Resources/Widgets/ -
Disallow /Activity-Feed/userId/ Do not index user profiles

yahoo pipes 1.0

Rule Path Comment
Disallow /admin/ -
Disallow /App_Browsers/ -
Disallow /App_Code/ -
Disallow /App_Data/ -
Disallow /App_GlobalResources/ -
Disallow /bin/ -
Disallow /Components/ -
Disallow /Config/ -
Disallow /contest/ -
Disallow /controls/ -
Disallow /DesktopModules/ -
Disallow /Documentation/ -
Disallow /HttpModules/ -
Disallow /images/ -
Disallow /Install/ -
Disallow /js/ -
Disallow /Portals/ -
Disallow /Providers/ -
Disallow /Resources/ContentRotator/ -
Disallow /Resources/ControlPanel/ -
Disallow /Resources/Dashboard/ -
Disallow /Resources/FeedBrowser/ -
Disallow /Resources/OpenForceAd/ -
Disallow /Resources/Search/ -
Disallow /Resources/Shared/ -
Disallow /Resources/SkinWidgets/ -
Disallow /Resources/TabStrip/ -
Disallow /Resources/Widgets/ -
Disallow /Activity-Feed/userId/ Do not index user profiles
Back to top

Comments

  • Begin robots.txt file
  • /-----------------------------------------------\
  • | In single portal/domain situations, uncomment the sitmap line and enter domain name
  • \-----------------------------------------------/
  • Sitemap: http://www.DomainNamehere.com/sitemap.aspx
  • End of robots.txt file
Back to top