porntw.com
robots.txt
Robots Exclusion Standard data for porntw.com
Resource Scan
Scan Details
Site Domain | porntw.com |
Base Domain | porntw.com |
Scan Status | Ok |
Last Scan | 2024-11-18T06:08:25+00:00 |
Next Scan | 2024-11-25T06:08:25+00:00 |
Last Scan
Scanned | 2024-11-18T06:08:25+00:00 |
URL | https://porntw.com/robots.txt |
Redirect | https://www.porntw.com/robots.txt |
Redirect Domain | www.porntw.com |
Redirect Base | porntw.com |
Domain IPs | 104.21.43.133, 172.67.179.220, 2606:4700:3030::6815:2b85, 2606:4700:3034::ac43:b3dc |
Redirect IPs | 104.21.43.133, 172.67.179.220, 2606:4700:3030::6815:2b85, 2606:4700:3034::ac43:b3dc |
Response IP | 172.67.179.220 |
Found | Yes |
Hash | 58ee329f68266b8b2591a820d8df3125a0e48e5aeef7494b609429401e0ac5ba |
SimHash | a8486a42c316 |
Groups
*
Rule | Path |
---|---|
Disallow | */node/hit |
Disallow | */site/stat |
Disallow | */images/ |
Disallow | */m3u8 |
Disallow | */zh-hant/ |
Disallow | /website/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.porntw.com/sitemap/index |