caffenu.com
robots.txt
Robots Exclusion Standard data for caffenu.com
Resource Scan
Scan Details
| Site Domain | caffenu.com |
| Base Domain | caffenu.com |
| Scan Status | Ok |
| Last Scan | 2025-12-31T21:23:16+00:00 |
| Next Scan | 2026-01-30T21:23:16+00:00 |
Last Scan
| Scanned | 2025-12-31T21:23:16+00:00 |
| URL | https://caffenu.com/robots.txt |
| Domain IPs | 104.21.51.3, 172.67.215.123, 2606:4700:3031::6815:3303, 2606:4700:3037::ac43:d77b |
| Response IP | 172.67.215.123 |
| Found | Yes |
| Hash | ec3b54d8624ab40dd5e03f434d0eda4ab17dc44102e97fd610761c1193963f5d |
| SimHash | 62214b617b13 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | */utils/strings* |
| Disallow | */utils/common* |
| Disallow | */zlib/zstream* |
| Disallow | */zlib/constants* |
| Disallow | */zlib/constants* |
| Disallow | */zlib/gzheader* |
| Disallow | */zlib/deflate* |
| Disallow | */lib/deflate* |
| Disallow | */messages* |
| Disallow | */trees* |
| Disallow | */inftrees* |
| Disallow | */adler32* |
| Disallow | */crc32* |
| Disallow | */inffast* |
| Allow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://caffenu.com/sitemap_index.xml |