offshorecorptalk.com
robots.txt

Robots Exclusion Standard data for offshorecorptalk.com

Resource Scan

Scan Details

Site Domain offshorecorptalk.com
Base Domain offshorecorptalk.com
Scan Status Ok
Last Scan2026-02-16T03:01:58+00:00
Next Scan 2026-03-18T03:01:58+00:00

Last Scan

Scanned2026-02-16T03:01:58+00:00
URL https://www.offshorecorptalk.com/robots.txt
Domain IPs 172.66.40.247, 172.66.43.9, 2606:4700:3108::ac42:28f7, 2606:4700:3108::ac42:2b09
Response IP 172.66.43.9
Found Yes
Hash 15e5a0903b61d0833dd7f873fbaccd3944aba56adc24a783a0f221cc202d1fcb
SimHash 203ac802c6b7

Groups

petalbot
aspiegelbot
dotbot
mauibot
mj12bot
ccbot
gptbot
bytespider
claudebot
facebot

Rule Path
Disallow /

*

Rule Path
Disallow /threads/*/post-
Disallow /account/
Disallow /admin.php
Disallow /attachments/
Disallow /conversations/
Disallow /editor/
Disallow /find-new/
Disallow /goto/
Disallow /help/
Disallow /inline-mod/
Disallow /login/
Disallow /lost-password/
Disallow /members/
Disallow /misc/
Disallow /misc/language
Disallow /misc/style
Disallow /online/
Disallow /posts/
Disallow /register/
Disallow /report/
Disallow /search/
Disallow /watched/
Disallow /whats-new/
Disallow /uix/
Disallow /threads/*/unread
Disallow /threads/*/latest
Disallow /*sam-item
Disallow /*track-view
Disallow /*page-*
Disallow /*.json$
Disallow /uix/
Disallow /*toggle*
Disallow /data/local/icons/

Other Records

Field Value
sitemap https://www.offshorecorptalk.com/sitemap.xml

Comments

  • Block specific bots (full deny)
  • General rules for all other bots
  • Block noisy thread variants
  • Block UIX JSON & toggle endpoints (not useful for search)
  • Block variant SVG noise
  • Sitemap location