rame.net
robots.txt

Robots Exclusion Standard data for rame.net

Resource Scan

Scan Details

Site Domain rame.net
Base Domain rame.net
Scan Status Ok
Last Scan2025-10-12T11:48:51+00:00
Next Scan 2025-11-11T11:48:51+00:00

Last Scan

Scanned2025-10-12T11:48:51+00:00
URL https://rame.net/robots.txt
Domain IPs 104.21.55.69, 172.67.170.158, 2606:4700:3035::ac43:aa9e, 2606:4700:3036::6815:3745
Response IP 172.67.170.158
Found Yes
Hash 494eb8de0906d83e102c7e7b9c7addc923ea70a6059a90bf02ddaa5e35d88449
SimHash 857478940150

Groups

ia_archiver

Rule Path
Disallow /

googlebot

Rule Path
Disallow

slurp

Rule Path
Disallow

teleport pro*

Rule Path
Disallow /

wget*

Rule Path
Disallow /

Comments

  • No sucking our stuff
  • No sucking our stuff