conchology.be
robots.txt
Robots Exclusion Standard data for conchology.be
Resource Scan
Scan Details
| Site Domain | conchology.be |
| Base Domain | conchology.be |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-09-26T06:41:22+00:00 |
| Next Scan | 2025-12-25T06:41:22+00:00 |
Last Successful Scan
| Scanned | 2025-05-06T21:33:31+00:00 |
| URL | https://conchology.be/robots.txt |
| Domain IPs | 104.26.12.124, 104.26.13.124, 172.67.73.15, 2606:4700:20::681a:c7c, 2606:4700:20::681a:d7c, 2606:4700:20::ac43:490f |
| Response IP | 104.26.13.124 |
| Found | Yes |
| Hash | 2dbe88925d20fa990de59348e3d40cf512188ba1c0b97ee338cdce21326e0ca3 |
| SimHash | 011d4454f9d9 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /post |
| Disallow | /classes |
| Disallow | /documents |
| Disallow | /gloriamaris |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 8 |
bingbot
| Rule | Path |
|---|---|
| Disallow | /post |
| Disallow | /classes |
| Disallow | /documents |
| Disallow | /gloriamaris |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 8 |
googlebot-image
| Rule | Path |
|---|---|
| Disallow | /post |
| Disallow | /classes |
| Disallow | /documents |
| Disallow | /gloriamaris |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 8 |
baiduspider
| Rule | Path |
|---|---|
| Disallow | /post |
| Disallow | /classes |
| Disallow | /documents |
| Disallow | /gloriamaris |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 8 |
duckduckbot
| Rule | Path |
|---|---|
| Disallow | /post |
| Disallow | /classes |
| Disallow | /documents |
| Disallow | /gloriamaris |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 8 |
facebookexternalhit
| Rule | Path |
|---|---|
| Disallow | /post |
| Disallow | /classes |
| Disallow | /documents |
| Disallow | /gloriamaris |
ahrefsbot
| Rule | Path |
|---|---|
| Disallow | /post |
| Disallow | /classes |
| Disallow | /documents |
| Disallow | /gloriamaris |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 8 |
semrushbot
| Rule | Path |
|---|---|
| Disallow | /post |
| Disallow | /classes |
| Disallow | /documents |
| Disallow | /gloriamaris |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 8 |
petalbot
| Rule | Path |
|---|---|
| Disallow | /post |
| Disallow | /classes |
| Disallow | /documents |
| Disallow | /gloriamaris |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 8 |
*
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.conchology.be/sitemap.txt |
| sitemap | https://www.conchology.be/sitemap2.txt |
| sitemap | https://www.conchology.be/sitemap3.txt |
| sitemap | https://www.conchology.be/sitemap4.txt |
| sitemap | https://www.conchology.be/sitemap5.txt |
| sitemap | https://www.conchology.be/sitemap6.txt |
| sitemap | https://www.conchology.be/sitemap7.txt |
| sitemap | https://www.conchology.be/sitemap8.txt |
| sitemap | https://www.conchology.be/sitemap9.txt |
| sitemap | https://www.conchology.be/sitemap10.txt |
| sitemap | https://www.conchology.be/sitemap11.txt |
| sitemap | https://www.conchology.be/sitemap12.txt |
| sitemap | https://www.conchology.be/sitemap13.txt |
| sitemap | https://www.conchology.be/sitemap14.txt |
| sitemap | https://www.conchology.be/sitemap15.txt |