catalogfactory.org
robots.txt
Robots Exclusion Standard data for catalogfactory.org
Resource Scan
Scan Details
| Site Domain | catalogfactory.org |
| Base Domain | catalogfactory.org |
| Scan Status | Ok |
| Last Scan | 2026-01-08T00:15:02+00:00 |
| Next Scan | 2026-02-07T00:15:02+00:00 |
Last Scan
| Scanned | 2026-01-08T00:15:02+00:00 |
| URL | https://catalogfactory.org/robots.txt |
| Redirect | https://www.catalogfactory.org/robots.txt |
| Redirect Domain | www.catalogfactory.org |
| Redirect Base | catalogfactory.org |
| Domain IPs | 104.21.67.107, 172.67.221.96, 2606:4700:3035::6815:436b, 2606:4700:3035::ac43:dd60 |
| Redirect IPs | 104.21.67.107, 172.67.221.96, 2606:4700:3035::6815:436b, 2606:4700:3035::ac43:dd60 |
| Response IP | 104.21.67.107 |
| Found | Yes |
| Hash | d1b68014ca3fb1198adcea678896b00820e57141cc224dfbb55b294667990540 |
| SimHash | 407c0840e691 |
Groups
ahrefsbot
baiduspider
slurp
aport
teoma
scooter
ia_archiver
lycos
webalta
grapeshot
mj12bot
proximic
amazonbot
semrushbot
semrushbot-sa
bytespider
weborama-fetcher
gptbot
claudebot
smtbot
blexbot
dotbot
getintent
petalbot
dataforseobot
| Rule | Path |
|---|---|
| Disallow | / |
yandex
mail.ru
| Rule | Path |
|---|---|
| Disallow | /map/ |
| Disallow | /eng/ |
| Disallow | /js/ |
| Disallow | /stat/ |
| Disallow | /kcap.php |
| Disallow | /org_edit.php |
| Disallow | /menu.html |
| Disallow | /go.php |
| Disallow | /search.php |
| Disallow | /bot.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 0.5 |
*
| Rule | Path |
|---|---|
| Disallow | /map/ |
| Disallow | /js/ |
| Disallow | /stat/ |
| Disallow | /kcap.php |
| Disallow | /org_edit.php |
| Disallow | /menu.html |
| Disallow | /go.php |
| Disallow | /bot.php |
Warnings
- `host` is not a known field.