maryknollsisters.org
robots.txt

Robots Exclusion Standard data for maryknollsisters.org

Resource Scan

Scan Details

Site Domain maryknollsisters.org
Base Domain maryknollsisters.org
Scan Status Ok
Last Scan6/5/2025, 11:24:03 AM
Next Scan 7/5/2025, 11:24:03 AM

Last Scan

Scanned6/5/2025, 11:24:03 AM
URL https://maryknollsisters.org/robots.txt
Domain IPs 104.21.51.129, 172.67.180.156, 2606:4700:3030::ac43:b49c, 2606:4700:3037::6815:3381
Response IP 172.67.180.156
Found Yes
Hash c942ddbf0f5bb424c91c2aeaf621951f8e11358b5898147367810a56cfbd0049
SimHash 89010ba07aa3

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-login/

semrushbot

Rule Path
Allow /

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

custom/3063303980

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.maryknollsisters.org/sitemap_index.xml