avaluer.org
robots.txt

Robots Exclusion Standard data for avaluer.org

Resource Scan

Scan Details

Site Domain avaluer.org
Base Domain avaluer.org
Scan Status Ok
Last Scan2025-10-16T23:18:59+00:00
Next Scan 2025-10-23T23:18:59+00:00

Last Scan

Scanned2025-10-16T23:18:59+00:00
URL https://avaluer.org/robots.txt
Domain IPs 104.21.52.146, 172.67.200.137, 2606:4700:3030::6815:3492, 2606:4700:3033::ac43:c889
Response IP 104.21.52.146
Found Yes
Hash 2cb8205919bbafa1f9134105cd7cd8d27be9da44022933176c2c785aeed5e30c
SimHash 0b7cc5c2ec98

Groups

mediapartners-google

Rule Path
Disallow /users/

*

Rule Path
Disallow /search
Disallow /itmloader.php

ia_archiver
scoutjet
dotbot
spbot
netseer
downscout
seznam
exabot
bender
discobot
valueclick
lucidmedia
snapbot
sosospider
weesee
ahrefsbot
megaindex.ru
cliqzbot
semrushbot
mj12bot
blexbot
zumbot
sogou web spider

Rule Path
Disallow /explore
Disallow /search
Disallow /category

Comments

  • always allow adsense
  • All robots Block
  • bot-specific