archstl.org
robots.txt

Robots Exclusion Standard data for archstl.org

Resource Scan

Scan Details

Site Domain archstl.org
Base Domain archstl.org
Scan Status Ok
Last Scan2024-06-03T08:46:00+00:00
Next Scan 2024-07-03T08:46:00+00:00

Last Scan

Scanned2024-06-03T08:46:00+00:00
URL https://archstl.org/robots.txt
Redirect https://www.archstl.org/robots.txt
Redirect Domain www.archstl.org
Redirect Base archstl.org
Domain IPs 104.26.4.226, 104.26.5.226, 172.67.73.226, 2606:4700:20::681a:4e2, 2606:4700:20::681a:5e2, 2606:4700:20::ac43:49e2
Redirect IPs 104.26.4.226, 104.26.5.226, 172.67.73.226, 2606:4700:20::681a:4e2, 2606:4700:20::681a:5e2, 2606:4700:20::ac43:49e2
Response IP 104.26.5.226
Found Yes
Hash a741968293c564cc7eb4662c677b485082c01cf3861c2f0c5d5c3b6adee9ea44
SimHash 3b004a07ed39

Groups

*

Rule Path
Allow /
Disallow /activityfeed/
Disallow /Activity-Feed/userID/
Disallow /ActivityFeed/MyProfile.aspx
Disallow /admin/
Disallow /Admin/
Disallow /App_Browser/
Disallow /App_Code/
Disallow /App_Data/
Disallow /App_GlobalResources/
Disallow /bin/
Disallow /Components/
Disallow /Config/
Disallow /Controls/
Disallow /controls/
Disallow /Documentation/
Disallow /HttpModules/
Disallow /Install/
Disallow /login.aspx
Disallow /Providers/
Disallow /register.aspx
Disallow /user-profile.aspx
Disallow /User-Profile.aspx
Disallow /UserID.aspx
Disallow /userid.aspx
Disallow /userprofile/
Disallow /UserProfile/
Disallow /Portals/0/Cache/
Disallow /Portals/0/Containers/
Disallow /Portals/0/DynamicForms_Exports/
Disallow /Portals/0/DynamicForms_Images/
Disallow /Portals/0/DynamicForms_Uploads/
Disallow /Portals/0/Templates/
Disallow /Portals/0/Users/
Disallow /?option
Disallow /search-results/search/

Other Records

Field Value
sitemap https://www.archstl.org/sitemap.xml