krowdz.net
robots.txt

Robots Exclusion Standard data for krowdz.net

Resource Scan

Scan Details

Site Domain krowdz.net
Base Domain krowdz.net
Scan Status Ok
Last Scan2025-12-02T03:55:57+00:00
Next Scan 2025-12-16T03:55:57+00:00

Last Scan

Scanned2025-12-02T03:55:57+00:00
URL https://krowdz.net/robots.txt
Domain IPs 104.21.67.42, 172.67.211.249, 2606:4700:3030::ac43:d3f9, 2606:4700:3031::6815:432a
Response IP 172.67.211.249
Found Yes
Hash 3b66375ef2fb94580d87a4f08d03a7b4080873e737469f09b057bbb561253d8a
SimHash c855d99653f5

Groups

facebookexternalhit

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

msnbot

Rule Path
Allow /

slurp

Rule Path
Allow /

twitterbot

Rule Path
Allow /

*

Rule Path
Disallow /
Disallow /img
Disallow /audio
Disallow /video
Disallow /hls
Disallow /pdf