pornlesbian.live
robots.txt
Robots Exclusion Standard data for pornlesbian.live
Resource Scan
Scan Details
Site Domain | pornlesbian.live |
Base Domain | pornlesbian.live |
Scan Status | Ok |
Last Scan | 2024-09-26T07:09:35+00:00 |
Next Scan | 2024-10-03T07:09:35+00:00 |
Last Scan
Scanned | 2024-09-26T07:09:35+00:00 |
URL | https://pornlesbian.live/robots.txt |
Redirect | https://www.pornlesbian.live/robots.txt |
Redirect Domain | www.pornlesbian.live |
Redirect Base | pornlesbian.live |
Domain IPs | 104.21.90.30, 172.67.193.197, 2606:4700:3033::6815:5a1e, 2606:4700:3036::ac43:c1c5 |
Redirect IPs | 104.21.90.30, 172.67.193.197, 2606:4700:3033::6815:5a1e, 2606:4700:3036::ac43:c1c5 |
Response IP | 104.21.90.30 |
Found | Yes |
Hash | c01feceda4792843910ec954a22473c9a88480d6faa7ca39c6d8ebe46ff5fd90 |
SimHash | 88086b00c316 |
Groups
*
Rule | Path |
---|---|
Disallow | */node/hit |
Disallow | */site/stat |
Disallow | */images/ |
Disallow | */m3u8 |
Disallow | */zh-hant/ |
Disallow | /website/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.pornlesbian.live/sitemap/index |