fairwaymc.com
robots.txt

Robots Exclusion Standard data for fairwaymc.com

Resource Scan

Scan Details

Site Domain fairwaymc.com
Base Domain fairwaymc.com
Scan Status Ok
Last Scan2024-11-15T07:13:29+00:00
Next Scan 2024-12-15T07:13:29+00:00

Last Scan

Scanned2024-11-15T07:13:29+00:00
URL http://www.fairwaymc.com/robots.txt
Redirect https://www.fairway.com/robots.txt
Redirect Domain www.fairway.com
Redirect Base fairway.com
Domain IPs 13.107.246.59, 2620:1ec:bdf::59
Redirect IPs 52.197.0.54, 52.199.221.217, 54.178.223.218
Response IP 54.178.223.218
Found Yes
Hash 8b0579aa750ff77a6c790e7f87073d6d37c9743b94114c5f26832e7f7bc848f6
SimHash 601dc121ef92

Groups

googlebot
bingbot
slurp
duckduckbot
applebot
siteauditbot
mozilla

Rule Path
Allow /*

*

Rule Path
Disallow /affinity-program
Disallow /affinity-program/*
Disallow /teams
Disallow /teams/*

mj12bot
ahrefsbot
semrushbot
dotbot
mauibot
aspiegelbot
petalbot

Rule Path
Disallow /

*

Rule Path
Disallow /locations-locator
Disallow /application
Disallow /login

Other Records

Field Value
sitemap https://www.fairwayindependentmc.com/sitemap.xml
sitemap https://img.fairway.com/sitemap/sitemap-loan-officer-directory.xml
sitemap https://www.fairway.com/sitemap.xml