snapostnews.xyz
robots.txt

Robots Exclusion Standard data for snapostnews.xyz

Resource Scan

Scan Details

Site Domain snapostnews.xyz
Base Domain snapostnews.xyz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-05-25T22:08:11+00:00
Next Scan 2024-08-23T22:08:11+00:00

Last Successful Scan

Scanned2023-07-31T21:44:10+00:00
URL https://snapostnews.xyz/robots.txt
Domain IPs 104.21.32.121, 172.67.151.212, 2606:4700:3033::ac43:97d4, 2606:4700:3035::6815:2079
Response IP 172.67.151.212
Found Yes
Hash f92d7936361546c1e5cfb943253388bd2c41b554954ec5aa47eac3b42d0a295c
SimHash 6d08bcb02790

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /src/
Disallow /?page=*
Disallow /*?page=*
Disallow /*?page=*&s=*
Disallow /*?page=*&feed=*
Disallow /*/*?page=*

Comments

  • Hello search engine
  • I am robots.txt
  • I am very happy to be crawled