snapostnews.xyz
robots.txt
Robots Exclusion Standard data for snapostnews.xyz
Resource Scan
Scan Details
Site Domain | snapostnews.xyz |
Base Domain | snapostnews.xyz |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-05-25T22:08:11+00:00 |
Next Scan | 2024-08-23T22:08:11+00:00 |
Last Successful Scan
Scanned | 2023-07-31T21:44:10+00:00 |
URL | https://snapostnews.xyz/robots.txt |
Domain IPs | 104.21.32.121, 172.67.151.212, 2606:4700:3033::ac43:97d4, 2606:4700:3035::6815:2079 |
Response IP | 172.67.151.212 |
Found | Yes |
Hash | f92d7936361546c1e5cfb943253388bd2c41b554954ec5aa47eac3b42d0a295c |
SimHash | 6d08bcb02790 |
Groups
*
Rule | Path |
---|---|
Disallow | /src/ |
Disallow | /?page=* |
Disallow | /*?page=* |
Disallow | /*?page=*&s=* |
Disallow | /*?page=*&feed=* |
Disallow | /*/*?page=* |
Comments