cn-av.jav101.com
robots.txt
Robots Exclusion Standard data for cn-av.jav101.com
Resource Scan
Scan Details
Site Domain | cn-av.jav101.com |
Base Domain | jav101.com |
Scan Status | Ok |
Last Scan | 2024-11-12T00:47:54+00:00 |
Next Scan | 2024-11-26T00:47:54+00:00 |
Last Scan
Scanned | 2024-11-12T00:47:54+00:00 |
URL | https://cn-av.jav101.com/robots.txt |
Domain IPs | 108.156.133.108, 108.156.133.2, 108.156.133.31, 108.156.133.68, 2600:9000:2755:1200:14:c2fe:aa40:93a1, 2600:9000:2755:4600:14:c2fe:aa40:93a1, 2600:9000:2755:9c00:14:c2fe:aa40:93a1, 2600:9000:2755:be00:14:c2fe:aa40:93a1, 2600:9000:2755:c000:14:c2fe:aa40:93a1, 2600:9000:2755:dc00:14:c2fe:aa40:93a1, 2600:9000:2755:e00:14:c2fe:aa40:93a1, 2600:9000:2755:e600:14:c2fe:aa40:93a1 |
Response IP | 108.156.133.2 |
Found | Yes |
Hash | 98ae0f8ccebe1b17cd165419670775c8376e8d099118838b2662fdb7cf72bd1d |
SimHash | 717843446893 |
Groups
*
Rule | Path |
---|---|
Disallow | /play/embed/ |
Disallow | /maindex/ |
Disallow | /category/mosaic/ |
Disallow | /doLogin |
Disallow | /logout |
Disallow | /doLogout |
Disallow | /api |
Disallow | /*.m3u8 |
Disallow | /internal |
Disallow | /publisher/?pp= |
Disallow | /publisher/$ |
Disallow | /tag/?pp= |
Disallow | /tag/$ |
Disallow | /sitemap.xml |