fairway.com
robots.txt

Robots Exclusion Standard data for fairway.com

Resource Scan

Scan Details

Site Domain fairway.com
Base Domain fairway.com
Scan Status Ok
Last Scan2024-09-24T16:50:42+00:00
Next Scan 2024-10-24T16:50:42+00:00

Last Scan

Scanned2024-09-24T16:50:42+00:00
URL https://fairway.com/robots.txt
Redirect https://www.fairway.com/robots.txt
Redirect Domain www.fairway.com
Redirect Base fairway.com
Domain IPs 75.2.70.75, 99.83.190.102
Redirect IPs 13.200.123.229, 13.234.100.116, 65.0.79.182
Response IP 52.197.0.54
Found Yes
Hash 8b0579aa750ff77a6c790e7f87073d6d37c9743b94114c5f26832e7f7bc848f6
SimHash 601dc121ef92

Groups

googlebot
bingbot
slurp
duckduckbot
applebot
siteauditbot
mozilla

Rule Path
Allow /*

*

Rule Path
Disallow /affinity-program
Disallow /affinity-program/*
Disallow /teams
Disallow /teams/*

mj12bot
ahrefsbot
semrushbot
dotbot
mauibot
aspiegelbot
petalbot

Rule Path
Disallow /

*

Rule Path
Disallow /locations-locator
Disallow /application
Disallow /login

Other Records

Field Value
sitemap https://www.fairwayindependentmc.com/sitemap.xml
sitemap https://img.fairway.com/sitemap/sitemap-loan-officer-directory.xml
sitemap https://www.fairway.com/sitemap.xml