fiberglassflyrodders.com
robots.txt
Robots Exclusion Standard data for fiberglassflyrodders.com
Resource Scan
Scan Details
| Site Domain | fiberglassflyrodders.com |
| Base Domain | fiberglassflyrodders.com |
| Scan Status | Ok |
| Last Scan | 2025-03-12T11:54:33+00:00 |
| Next Scan | 2025-04-11T11:54:33+00:00 |
Last Scan
| Scanned | 2025-03-12T11:54:33+00:00 |
| URL | https://fiberglassflyrodders.com/robots.txt |
| Domain IPs | 75.119.195.21 |
| Response IP | 75.119.195.21 |
| Found | Yes |
| Hash | 234414dac66d001521e258189cdd0290e47c0942475452a1d87a6a7933bdb51a |
| SimHash | 9e3a9d466ea2 |
Groups
acoon
ahrefsbot
amazonbot
amazonbot/0.1
baiduspider
baiduspider-video
baiduspider-image
barkrowler
blexbot
bytespider
claudebot
discobot
dotbot
ezooms
facebookexternalhit/1.1
grapeshot
keys-so-bot
liferea
magpie-crawler
mj12bot
openai
semrushbot
semrushbot-sa
seznambot
sistrix
sogou spider
xovibot
yodaobot
| Rule | Path |
|---|---|
| Disallow | / |
bytespider
claudebot
*
| Rule | Path |
|---|---|
| Disallow | /forum/chat/ |
| Disallow | /forum/faq.php |
| Disallow | /forum/feed.php |
| Disallow | /forum/mcp.php |
| Disallow | /forum/memberlist.php |
| Disallow | /forum/posting.php |
| Disallow | /forum/report.php |
| Disallow | /forum/search.php |
| Disallow | /forum/ucp.php |
| Disallow | /forum/viewonline.php |
| Disallow | /forum/*?f=26 |
| Disallow | /forum/*?f=29 |
| Disallow | /forum/*?p= |
| Disallow | /forum/*%26p%3D |
| Disallow | /forum/*?view= |
| Disallow | /forum/*%26view%3D |
| Disallow | /forum/*%26start%3D0 |