methodistcollege.edu
robots.txt

Robots Exclusion Standard data for methodistcollege.edu

Resource Scan

Scan Details

Site Domain methodistcollege.edu
Base Domain methodistcollege.edu
Scan Status Ok
Last Scan2024-09-06T07:34:21+00:00
Next Scan 2024-10-06T07:34:21+00:00

Last Scan

Scanned2024-09-06T07:34:21+00:00
URL https://methodistcollege.edu/robots.txt
Redirect https://www.methodistcollege.edu/robots.txt
Redirect Domain www.methodistcollege.edu
Redirect Base methodistcollege.edu
Domain IPs 199.60.103.131, 199.60.103.31
Redirect IPs 199.60.103.227, 199.60.103.29, 2606:2c40::c73c:671d, 2606:2c40::c73c:67e3
Response IP 199.60.103.29
Found Yes
Hash e525260d2d9520c4902ada520ca5de6e0dc59ccf49de96205db76ec1d0fe2cba
SimHash 32ed6a28e5b1

Groups

*

Rule Path
Disallow /landing/
Disallow /confirmation-and-thanks-to-you-folder/
Disallow /hubfs/documents/
Disallow /hubfs/docs/
Disallow /hubfs/HACP_Files/
Disallow /hubfs/Projects-Attachments_Hubspot_/
Disallow /author/
Disallow /faculty/
Disallow /ppc/
Disallow /search-result
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*

Other Records

Field Value
sitemap https://www.methodistcollege.edu/sitemap.xml

Warnings

  • 1 invalid line.