thecontentdecoder.com
robots.txt
Robots Exclusion Standard data for thecontentdecoder.com
Resource Scan
Scan Details
| Site Domain | thecontentdecoder.com |
| Base Domain | thecontentdecoder.com |
| Scan Status | Ok |
| Last Scan | 2025-09-28T08:59:10+00:00 |
| Next Scan | 2025-10-05T08:59:10+00:00 |
Last Scan
| Scanned | 2025-09-28T08:59:10+00:00 |
| URL | https://thecontentdecoder.com/robots.txt |
| Domain IPs | 104.21.2.212, 172.67.129.180, 2606:4700:3037::6815:2d4, 2606:4700:3037::ac43:81b4 |
| Response IP | 172.67.129.180 |
| Found | Yes |
| Hash | 190690cd4a7e2f6a73551d6c01f36af8e6447608508378aa98bda8892954e827 |
| SimHash | 5c1f0850e0b2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /af/* |
| Disallow | /am/* |
| Disallow | /hy/* |
| Disallow | /bn/* |
| Disallow | /ceb/* |
| Disallow | /ny/* |
| Disallow | /co/* |
| Disallow | /eo/* |
| Disallow | /fy/* |
| Disallow | /gu/* |
| Disallow | /ht/* |
| Disallow | /ha/* |
| Disallow | /ig/* |
| Disallow | /jv/* |
| Disallow | /kn/* |
| Disallow | /sq/* |
| Disallow | /az/* |
| Disallow | /eu/* |
| Disallow | /be/* |
| Disallow | /bs/* |
| Disallow | /gl/* |
| Disallow | /ga/* |
| Disallow | /kk/* |
| Disallow | /km/* |
| Disallow | /ku/* |
| Disallow | /ky/* |
| Disallow | /lo/* |
| Disallow | /la/* |
| Disallow | /lb/* |
| Disallow | /mk/* |
| Disallow | /mg/* |
| Disallow | /ml/* |
| Disallow | /mt/* |
| Disallow | /mi/* |
| Disallow | /mr/* |
| Disallow | /mn/* |
| Disallow | /my/* |
| Disallow | /ne/* |
| Disallow | /ps/* |
| Disallow | /pa/* |
| Disallow | /sm/* |
| Disallow | /gd/* |
| Disallow | /sn/* |
| Disallow | /sd/* |
| Disallow | /si/* |
| Disallow | /su/* |
| Disallow | /so/* |
| Disallow | /sw/* |
| Disallow | /tg/* |
| Disallow | /ta/* |
| Disallow | /te/* |
| Disallow | /ur/* |
| Disallow | /uz/* |
| Disallow | /cy/* |
| Disallow | /xh/* |
| Disallow | /yi/* |
| Disallow | /yo/* |
| Disallow | /zu/* |
| Disallow | /ar/* |
| Disallow | /bg/* |
| Disallow | /ca/* |
| Disallow | /zh-CN/* |
| Disallow | /zh-TW/* |
| Disallow | /hr/* |
| Disallow | /cs/* |
| Disallow | /da/* |
| Disallow | /et/* |
| Disallow | /tl/* |
| Disallow | /fi/* |
| Disallow | /fr/* |
| Disallow | /ka/* |
| Disallow | /de/* |
| Disallow | /el/* |
| Disallow | /haw/* |
| Disallow | /iw/* |
| Disallow | /hi/* |
| Disallow | /hmn/* |
| Disallow | /hu/* |
| Disallow | /is/* |
| Disallow | /id/* |
| Disallow | /it/* |
| Disallow | /ja/* |
| Disallow | /jw/* |
| Disallow | /ko/* |
| Disallow | /lv/* |
| Disallow | /lt/* |
| Disallow | /ms/* |
| Disallow | /no/* |
| Disallow | /fa/* |
| Disallow | /pl/* |
| Disallow | /pt/* |
| Disallow | /ro/* |
| Disallow | /ru/* |
| Disallow | /sr/* |
| Disallow | /st/* |
| Disallow | /sk/* |
| Disallow | /sl/* |
| Disallow | /es/* |
| Disallow | /sv/* |
| Disallow | /th/* |
| Disallow | /tr/* |
| Disallow | /uk/* |
| Disallow | /vi/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://thecontentdecoder.com/sitemap_index.xml |
Comments