porngrey.net
robots.txt
Robots Exclusion Standard data for porngrey.net
Resource Scan
Scan Details
Site Domain | porngrey.net |
Base Domain | porngrey.net |
Scan Status | Ok |
Last Scan | 5/19/2025, 3:55:33 AM |
Next Scan | 6/18/2025, 3:55:33 AM |
Last Scan
Scanned | 5/19/2025, 3:55:33 AM |
URL | https://porngrey.net/robots.txt |
Redirect | https://www.porngrey.net/robots.txt |
Redirect Domain | www.porngrey.net |
Redirect Base | porngrey.net |
Domain IPs | 104.21.47.39, 172.67.170.93, 2606:4700:3032::6815:2f27, 2606:4700:3034::ac43:aa5d |
Redirect IPs | 104.21.47.39, 172.67.170.93, 2606:4700:3032::6815:2f27, 2606:4700:3034::ac43:aa5d |
Response IP | 172.67.170.93 |
Found | Yes |
Hash | 20fc1a39c4b5e1220700d0953a016891604192a1b23efce3e5e17b54969ff39f |
SimHash | 29497425ef10 |
Groups
*
Rule | Path |
---|---|
Disallow | /logout/ |
Disallow | /login/ |
Disallow | /login-required/ |
Disallow | /signup/ |
Disallow | /embed/ |
Disallow | /tag/ |
Disallow | /tags/ |
Disallow | /get_file/* |
Disallow | /get_video_ok/* |
Disallow | /get_video/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.porngrey.net/sitemap.xml |
Warnings
- `host` is not a known field.