socoastal.com
robots.txt

Robots Exclusion Standard data for socoastal.com

Resource Scan

Scan Details

Site Domain socoastal.com
Base Domain socoastal.com
Scan Status Ok
Last Scan2025-09-18T17:15:59+00:00
Next Scan 2025-09-25T17:15:59+00:00

Last Scan

Scanned2025-09-18T17:15:59+00:00
URL https://socoastal.com/robots.txt
Redirect https://www.socoastal.com/robots.txt
Redirect Domain www.socoastal.com
Redirect Base socoastal.com
Domain IPs 70.39.151.136
Redirect IPs 70.39.151.136
Response IP 70.39.151.136
Found Yes
Hash 01ca124c2771de113de9f8fe861692dbe6c3f91235afe6dc94dad0a6edea066a
SimHash 1d51cd78ceb3

Groups

*

Rule Path
Disallow /access/
Disallow /admin/
Disallow /account/
Disallow /install/
Disallow /api-condo-world/
Disallow /api-condolux/
Disallow /api-prista/
Disallow /api-mbv/
Disallow /api-alpxxx/
Disallow /app/
Disallow /stripe-php-3.4.0/
Disallow /ical-feed/
Disallow /listings/list-units/
Disallow /xfxkx/
Disallow /ics/
Disallow /booking/
Disallow /vr/

facebookexternalhit

Rule Path
Allow /vr/

bytespider

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

spbot

Rule Path
Disallow /

linkcheck by siteimprove.com

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot
semrushbot-sa

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

baiduspider
baiduspider
baiduspider+
baiduspider-video
baiduspider-image

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.socoastal.com/sitemap.xml

Comments

  • Disallow: /home/
  • Disallow: index.php?url=
  • Facebook Debugger Tool
  • Bytespider
  • netEstate NE Crawler
  • Crawler Soaking My Bandwidth.
  • No bien.
  • Sorry, Rand - Not happening.
  • No Rush
  • Crawler Soaking My Bandwidth.
  • Simon Sez No Thanks.
  • YanBlocked.
  • Eating Gilbert Grape
  • All Bark No Bite
  • The Name Says it All.
  • SISTRIX Crawler
  • PetalBot
  • NoGPT