youngem.com
robots.txt
Robots Exclusion Standard data for youngem.com
Resource Scan
Scan Details
| Site Domain | youngem.com |
| Base Domain | youngem.com |
| Scan Status | Ok |
| Last Scan | 2024-09-24T05:20:25+00:00 |
| Next Scan | 2024-10-24T05:20:25+00:00 |
Last Scan
| Scanned | 2024-09-24T05:20:25+00:00 |
| URL | https://www.youngem.com/robots.txt |
| Domain IPs | 163.181.42.204, 163.181.42.239, 163.181.42.240, 163.181.42.241, 163.181.42.242, 163.181.42.243, 163.181.42.245, 163.181.42.246 |
| Response IP | 163.181.42.246 |
| Found | Yes |
| Hash | bbc0b458fa7dbe7729f683c37609df2db731ee474b6393f452be79f2620b168a |
| SimHash | 283ece2888b3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api/ |
| Disallow | /help |
| Disallow | /newest |
| Disallow | /chief |
| Disallow | /hot |
| Disallow | /free |
| Disallow | /recom |
| Disallow | /sort |
| Disallow | /author/* |
| Disallow | /?* |
| Disallow | /undefined |
| Disallow | category/16/21 |
| Disallow | category/4/28 |
| Disallow | category/1/54 |
| Disallow | category/1/4 |
| Disallow | mdetail |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.youngem.com/sitemap.xml |
| sitemap | https://www.youngem.com/sitemap1.xml |
Comments