methodistcollege.edu
robots.txt
Robots Exclusion Standard data for methodistcollege.edu
Resource Scan
Scan Details
Site Domain | methodistcollege.edu |
Base Domain | methodistcollege.edu |
Scan Status | Ok |
Last Scan | 2024-09-06T07:34:21+00:00 |
Next Scan | 2024-10-06T07:34:21+00:00 |
Last Scan
Scanned | 2024-09-06T07:34:21+00:00 |
URL | https://methodistcollege.edu/robots.txt |
Redirect | https://www.methodistcollege.edu/robots.txt |
Redirect Domain | www.methodistcollege.edu |
Redirect Base | methodistcollege.edu |
Domain IPs | 199.60.103.131, 199.60.103.31 |
Redirect IPs | 199.60.103.227, 199.60.103.29, 2606:2c40::c73c:671d, 2606:2c40::c73c:67e3 |
Response IP | 199.60.103.29 |
Found | Yes |
Hash | e525260d2d9520c4902ada520ca5de6e0dc59ccf49de96205db76ec1d0fe2cba |
SimHash | 32ed6a28e5b1 |
Groups
*
Rule | Path |
---|---|
Disallow | /landing/ |
Disallow | /confirmation-and-thanks-to-you-folder/ |
Disallow | /hubfs/documents/ |
Disallow | /hubfs/docs/ |
Disallow | /hubfs/HACP_Files/ |
Disallow | /hubfs/Projects-Attachments_Hubspot_/ |
Disallow | /author/ |
Disallow | /faculty/ |
Disallow | /ppc/ |
Disallow | /search-result |
Disallow | /_hcms/preview/ |
Disallow | /hs/manage-preferences/ |
Disallow | /hs/preferences-center/ |
Disallow | /*?*hs_preview=* |
Disallow | /*?*hsCacheBuster=* |
Other Records
Field | Value |
---|---|
sitemap | https://www.methodistcollege.edu/sitemap.xml |
Warnings
- 1 invalid line.