firstcoasthomes.com
robots.txt

Robots Exclusion Standard data for firstcoasthomes.com

Resource Scan

Scan Details

Site Domain firstcoasthomes.com
Base Domain firstcoasthomes.com
Scan Status Ok
Last Scan2025-06-18T07:51:21+00:00
Next Scan 2025-06-25T07:51:21+00:00

Last Scan

Scanned2025-06-18T07:51:21+00:00
URL http://firstcoasthomes.com/robots.txt
Redirect https://todd.florida-georgia-realty.com/robots.txt
Redirect Domain todd.florida-georgia-realty.com
Redirect Base florida-georgia-realty.com
Domain IPs 162.255.119.129
Redirect IPs 3.134.250.255
Response IP 3.134.250.255
Found Yes
Hash 6b4165334222512701463abf7c63890aae6cfac699dc2ba415b2658a655a0498
SimHash 6f765c7b8e10

Groups

*

Rule Path
Disallow /dashboard/
Disallow /myaccount/
Disallow /profile/
Disallow /signin/
Disallow /signout/
Disallow /ajax/
Disallow /api/
Disallow /cincapi/
Disallow /v0/cincapi/
Disallow /rss/
Disallow /error/
Disallow /preview/
Disallow /mls/
Disallow /account/
Disallow /forgot/
Disallow /m/
Disallow /content/
Disallow /scripts/
Disallow /CastleFramework/
Disallow /signalr/
Disallow /*.asp$
Disallow /*.php$

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mail.ru_bot/2.0

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

mail.ru_bot/2.0; +http://go.mail.ru/help/robots

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

sogou

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

semrush

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

crowdtanglebot

Rule Path
Disallow /

go-resty

Rule Path
Disallow /

researchscan

Rule Path
Disallow /

seekport

Rule Path
Disallow /

checkmarknetwork

Rule Path
Disallow /

indeedbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.florida-georgia-realty.com/sitemap.xml

Comments

  • MJ12bot
  • AhrefsBot
  • Mail.RU_Bot/2.0 Russia
  • Mail.RU Russia
  • Mail.Ru Russia
  • TurnitinBot
  • Yandex
  • Baidu
  • ZoomInfoBot
  • SeznamBot
  • MauiBot
  • TweetmemeBot
  • magpie-crawler
  • YisouSpider
  • Sogou
  • bytespider
  • semrush
  • BLEXbot
  • serpstatbot
  • CrowdTanglebot
  • go-resty
  • Researchscan
  • Seekport
  • CheckMarkNetwork
  • IndeedBot
  • 360Spider
  • Amazonbot
  • OpenAI
  • DataForSeoBot
  • Barkrowler/babbar.tech
  • Valen
  • SEOkicks
  • ClaudeAI

Warnings

  • 2 invalid lines.