jav101.com
robots.txt
Robots Exclusion Standard data for jav101.com
Resource Scan
Scan Details
Site Domain | jav101.com |
Base Domain | jav101.com |
Scan Status | Ok |
Last Scan | 2024-06-15T15:56:27+00:00 |
Next Scan | 2024-07-15T15:56:27+00:00 |
Last Scan
Scanned | 2024-06-15T15:56:27+00:00 |
URL | https://jav101.com/robots.txt |
Domain IPs | 108.156.133.108, 108.156.133.2, 108.156.133.31, 108.156.133.68, 2600:9000:2755:3e00:14:c2fe:aa40:93a1, 2600:9000:2755:5200:14:c2fe:aa40:93a1, 2600:9000:2755:7000:14:c2fe:aa40:93a1, 2600:9000:2755:800:14:c2fe:aa40:93a1, 2600:9000:2755:b200:14:c2fe:aa40:93a1, 2600:9000:2755:ec00:14:c2fe:aa40:93a1, 2600:9000:2755:f800:14:c2fe:aa40:93a1, 2600:9000:2755:fc00:14:c2fe:aa40:93a1 |
Response IP | 108.156.133.108 |
Found | Yes |
Hash | 98ae0f8ccebe1b17cd165419670775c8376e8d099118838b2662fdb7cf72bd1d |
SimHash | 717843446893 |
Groups
*
Rule | Path |
---|---|
Disallow | /play/embed/ |
Disallow | /maindex/ |
Disallow | /category/mosaic/ |
Disallow | /doLogin |
Disallow | /logout |
Disallow | /doLogout |
Disallow | /api |
Disallow | /*.m3u8 |
Disallow | /internal |
Disallow | /publisher/?pp= |
Disallow | /publisher/$ |
Disallow | /tag/?pp= |
Disallow | /tag/$ |
Disallow | /sitemap.xml |