bajabeachfronthomes.com
robots.txt

Robots Exclusion Standard data for bajabeachfronthomes.com

Resource Scan

Scan Details

Site Domain bajabeachfronthomes.com
Base Domain bajabeachfronthomes.com
Scan Status Ok
Last Scan2025-12-24T08:28:09+00:00
Next Scan 2026-01-23T08:28:09+00:00

Last Scan

Scanned2025-12-24T08:28:09+00:00
URL https://bajabeachfronthomes.com/robots.txt
Domain IPs 104.21.48.14, 172.67.175.183, 2606:4700:3036::6815:300e, 2606:4700:3037::ac43:afb7
Response IP 172.67.175.183
Found Yes
Hash d0673c3a5425a23de512d9a9ee28043d6b26ed927904f5cf584828defd9d1c9f
SimHash 68655c825812

Groups

*

Rule Path
Allow /wp-content/uploads/
Disallow /wp-content/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /cgi-bin/
Allow /feed/$
Disallow /feed
Disallow /comments/feed
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$
Disallow /?s=
Disallow /search
Disallow /*.php$
Disallow /*.js$
Disallow /*.inc$
Disallow /*.css$
Disallow /*.gz$
Disallow /*.wmv$
Disallow /*.cgi$
Disallow /*.xhtml$

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

claritybot

Rule Path
Disallow /

linguee bot

Rule Path
Disallow /

domain re-animator bot

Rule Path
Disallow /

mauibot (crawler.feedback+wc@gmail.com)

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://bajabeachfronthomes.com/sitemap_index.xml