51cg2.com
robots.txt
Robots Exclusion Standard data for 51cg2.com
Resource Scan
Scan Details
| Site Domain | 51cg2.com |
| Base Domain | 51cg2.com |
| Scan Status | Ok |
| Last Scan | 5/13/2025, 10:13:02 AM |
| Next Scan | 6/12/2025, 10:13:02 AM |
Last Scan
| Scanned | 5/13/2025, 10:13:02 AM |
| URL | https://51cg2.com/robots.txt |
| Redirect | https://www.51cg1.com/robots.txt |
| Redirect Domain | www.51cg1.com |
| Redirect Base | 51cg1.com |
| Domain IPs | 104.21.56.156, 172.67.152.241, 2606:4700:3032::6815:389c, 2606:4700:3037::ac43:98f1 |
| Redirect IPs | 2600:9000:2200:2c00:5:dbe0:5600:93a1, 2600:9000:2200:6e00:5:dbe0:5600:93a1, 2600:9000:2200:7000:5:dbe0:5600:93a1, 2600:9000:2200:8600:5:dbe0:5600:93a1, 2600:9000:2200:9a00:5:dbe0:5600:93a1, 2600:9000:2200:cc00:5:dbe0:5600:93a1, 2600:9000:2200:e200:5:dbe0:5600:93a1, 2600:9000:2200:ea00:5:dbe0:5600:93a1, 54.192.18.129, 54.192.18.61, 54.192.18.68, 54.192.18.97 |
| Response IP | 13.35.238.115 |
| Found | Yes |
| Hash | ed2db34944dca00f55f72fcb1268d0e78b2b5153e5f22053d203dc74d40d698f |
| SimHash | e005de11ef31 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin* |
| Disallow | /danmaku/* |
| Disallow | /feed/* |
| Disallow | /archives/*/comment-page-* |
| Disallow | /comment-page-*?replyTo=* |
| Disallow | /*.html/comment-page-* |
| Disallow | /upload*/xiao/* |
| Disallow | /tag/*xiaohaole.cc* |
| Disallow | /tag/*xiaohaola.com* |
| Disallow | /tag/*kaapm.com* |
| Disallow | /*?replyTo=* |
| Disallow | /*?ysclid=* |
| Disallow | /*?continueFlag=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.51cg1.com/sitemap.xml |