Log In Sign Up

av18.org
robots.txt

Robots Exclusion Standard data for av18.org

Resource Scan

Scan Details

Site Domain av18.org
Base Domain av18.org
Scan Status Ok
Last Scan2025-10-19T09:09:57+00:00
Next Scan 2025-10-26T09:09:57+00:00

Last Scan

Scanned2025-10-19T09:09:57+00:00
URL https://av18.org/robots.txt
Domain IPs 104.21.81.190, 172.67.145.245, 2606:4700:3031::6815:51be, 2606:4700:3031::ac43:91f5
Response IP 104.21.81.190
Found Yes
Hash a0225300dd4ad03d6f6138d48c23fe8de8091f6edd8642e4753b84e758b2b87c
SimHash 4b5056054bb6

Groups

duckduckbot

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

applebot

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

googlebot

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

bingbot

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

baiduspider

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

msnbot

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

yandexbot

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

sogou

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

facebookexternalhit

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

twitterbot

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

linkedinbot

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

embedly

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

quora link preview

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

showyoubot

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

outbrain

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

pinterest

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

developers.google.com

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

slackbot

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

vkshare

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

w3c_validator

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

whatsapp

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

flipboard

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

tumblr

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

bitlybot

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

skypeuripreview

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

nuzzel

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

discordbot

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

google page speed

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

google web preview

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

google-read-aloud

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

google favicon

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

google search console

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

google-structured-data-testing-tool

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

google-amp-cache

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

google-adwords

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

google-adwords-keyword-planner

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

mediapartners-google

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

adsbot-google

Rule Path
Disallow */node/hit
Disallow */site/stat
Disallow */magnet/
Disallow */images/
Disallow */torrent/

*

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://av18.org/sitemap/index
Back to top

Warnings

  • 6 invalid lines.
Back to top