asiauncensored.com
robots.txt
Robots Exclusion Standard data for asiauncensored.com
Resource Scan
Scan Details
| Site Domain | asiauncensored.com |
| Base Domain | asiauncensored.com |
| Scan Status | Ok |
| Last Scan | 2024-09-26T01:11:23+00:00 |
| Next Scan | 2024-10-26T01:11:23+00:00 |
Last Scan
| Scanned | 2024-09-26T01:11:23+00:00 |
| URL | https://asiauncensored.com/robots.txt |
| Domain IPs | 104.21.235.203, 104.21.235.204, 2606:4700:3038::6815:ebcb, 2606:4700:3038::6815:ebcc |
| Response IP | 104.21.235.203 |
| Found | Yes |
| Hash | e11182887903c5f1ec20b0eab7018c29e0e38e4cce4c3e9e097f38d46c914d6c |
| SimHash | 530d5e80c48a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /sex/ |
| Disallow | /japansexs/ |
| Disallow | /tokyosexs/ |
| Disallow | /asiasexs/ |
| Disallow | /koreasexs/ |
| Disallow | /review/ |
| Disallow | /access/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://asiauncensored.com/sitemap.xml |