yayponies.no
robots.txt

Robots Exclusion Standard data for yayponies.no

Resource Scan

Scan Details

Site Domain yayponies.no
Base Domain yayponies.no
Scan Status Ok
Last Scan2025-09-17T20:28:16+00:00
Next Scan 2025-10-17T20:28:16+00:00

Last Scan

Scanned2025-09-17T20:28:16+00:00
URL https://yayponies.no/robots.txt
Domain IPs 104.21.24.13, 172.67.216.71, 2606:4700:3031::ac43:d847, 2606:4700:3033::6815:180d
Response IP 104.21.24.13
Found Yes
Hash 17cb0b4422abb327d74c7d9b97a7b0b3cdf2f0d5305e5eea11ebb34d49e5a072
SimHash 445551845514

Groups

googlebot

Rule Path
Disallow /yaywoy/
Disallow /yaystar/
Disallow /yaysu/
Disallow /yayducks/

googlebot-*

Rule Path
Disallow /yaywoy/
Disallow /yaystar/
Disallow /yaysu/
Disallow /yayducks/

adsbot-google

Rule Path
Disallow /yaywoy/
Disallow /yaystar/
Disallow /yaysu/
Disallow /yayducks/

mediapartners-google

Rule Path
Disallow /yaywoy/
Disallow /yaystar/
Disallow /yaysu/
Disallow /yayducks/

bingbot

Rule Path
Disallow /yaywoy/
Disallow /yaystar/
Disallow /yaysu/
Disallow /yayducks/

msnbot

Rule Path
Disallow /yaywoy/
Disallow /yaystar/
Disallow /yaysu/
Disallow /yayducks/

slurp

Rule Path
Disallow /yaywoy/
Disallow /yaystar/
Disallow /yaysu/
Disallow /yayducks/

*

Rule Path
Disallow /nogit/
Disallow /.git/

*

Rule Path
Disallow /nogit/
Disallow /.git/