optiboard.com
robots.txt

Robots Exclusion Standard data for optiboard.com

Resource Scan

Scan Details

Site Domain optiboard.com
Base Domain optiboard.com
Scan Status Ok
Last Scan2025-12-16T14:08:36+00:00
Next Scan 2026-01-15T14:08:36+00:00

Last Scan

Scanned2025-12-16T14:08:36+00:00
URL https://optiboard.com/robots.txt
Domain IPs 216.144.236.76
Response IP 216.144.236.76
Found Yes
Hash 84d00b56387a8e9d39f1347f9cb52026a33d6688d3096416a8542f53af1025a1
SimHash 545c8000ab00

Groups

amazonbot

Product Comment
amazonbot Amazon's user agent
Rule Path
Disallow /

npbot

Rule Path
Disallow /do-not-crawl/

yandex

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

seekport

Rule Path
Disallow /

amazonaws

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

dataforseo

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3600