fairway.com
robots.txt

Robots Exclusion Standard data for fairway.com

Resource Scan

Scan Details

Site Domain fairway.com
Base Domain fairway.com
Scan Status Ok
Last Scan2024-10-24T16:50:59+00:00
Next Scan 2024-11-23T16:50:59+00:00

Last Scan

Scanned2024-10-24T16:50:59+00:00
URL https://fairway.com/robots.txt
Redirect https://www.fairway.com/robots.txt
Redirect Domain www.fairway.com
Redirect Base fairway.com
Domain IPs 75.2.70.75, 99.83.190.102
Redirect IPs 52.197.0.54, 52.199.221.217, 54.178.223.218
Response IP 13.54.180.169
Found Yes
Hash 8b0579aa750ff77a6c790e7f87073d6d37c9743b94114c5f26832e7f7bc848f6
SimHash 601dc121ef92

Groups

googlebot
bingbot
slurp
duckduckbot
applebot
siteauditbot
mozilla

Rule Path
Allow /*

*

Rule Path
Disallow /affinity-program
Disallow /affinity-program/*
Disallow /teams
Disallow /teams/*

mj12bot
ahrefsbot
semrushbot
dotbot
mauibot
aspiegelbot
petalbot

Rule Path
Disallow /

*

Rule Path
Disallow /locations-locator
Disallow /application
Disallow /login

Other Records

Field Value
sitemap https://www.fairwayindependentmc.com/sitemap.xml
sitemap https://img.fairway.com/sitemap/sitemap-loan-officer-directory.xml
sitemap https://www.fairway.com/sitemap.xml