Log In Sign Up

rayman4449.com
robots.txt

Robots Exclusion Standard data for rayman4449.com

Resource Scan

Scan Details

Site Domain rayman4449.com
Base Domain rayman4449.com
Scan Status Ok
Last Scan2025-05-24T17:11:06+00:00
Next Scan 2025-05-31T17:11:06+00:00

Last Scan

Scanned2025-05-24T17:11:06+00:00
URL https://rayman4449.com/robots.txt
Domain IPs 104.21.51.99, 172.67.178.136, 2606:4700:3033::6815:3363, 2606:4700:3035::ac43:b288
Response IP 172.67.178.136
Found Yes
Hash ac01db4e8c3336e1c37afec2b3150d2e9352250fb91dba73575e30d36ea1a77b
SimHash f339f1ff0307

Groups

*

Rule Path
Allow /.
Allow /

ia_archiver

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

yandex

Rule Path
Disallow /

proximic

Rule Path
Disallow /php/

almaden

Rule Path
Disallow /

anarchie

Rule Path
Disallow /

aspseek

Rule Path
Disallow /

attach

Rule Path
Disallow /

autoemailspider

Rule Path
Disallow /

backweb

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

bandit

Rule Path
Disallow /

batchftp

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

bot\ mailto:craftbot@yahoo.com

Rule Path
Disallow /

buddy

Rule Path
Disallow /

bumblebee

Rule Path
Disallow /

cherrypicker

Rule Path
Disallow /

chinaclaw

Rule Path
Disallow /

cicc

Rule Path
Disallow /

collector

Rule Path
Disallow /

copier

Rule Path
Disallow /

crescent

Rule Path
Disallow /

custo

Rule Path
Disallow /

da

Rule Path
Disallow /

diibot

Rule Path
Disallow /

disco

Rule Path
Disallow /

disco\ pump

Rule Path
Disallow /

download\ demon

Rule Path
Disallow /

download\ wonder

Rule Path
Disallow /

downloader

Rule Path
Disallow /

drip

Rule Path
Disallow /

dsurf15a

Rule Path
Disallow /

ecatch

Rule Path
Disallow /

easydl/2.99

Rule Path
Disallow /

eirgrabber

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

express\ webpictures

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

eyenetie

Rule Path
Disallow /

filehound

Rule Path
Disallow /

flashget

Rule Path
Disallow /

getright

Rule Path
Disallow /

getsmart

Rule Path
Disallow /

getweb!

Rule Path
Disallow /

gigabaz

Rule Path
Disallow /

go\!zilla

Rule Path
Disallow /

go!zilla

Rule Path
Disallow /

go-ahead-got-it

Rule Path
Disallow /

gotit

Rule Path
Disallow /

grabber

Rule Path
Disallow /

grabnet

Rule Path
Disallow /

grafula

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

hmview

Rule Path
Disallow /

httrack

Rule Path
Disallow /

httpdown

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

image\ stripper

Rule Path
Disallow /

image\ sucker

Rule Path
Disallow /

indy*library

Rule Path
Disallow /

interget

Rule Path
Disallow /

indy\ library

Rule Path
Disallow /

interget

Rule Path
Disallow /

internetlinkagent

Rule Path
Disallow /

internet\ ninja

Rule Path
Disallow /

internetseer.com

Rule Path
Disallow /

iria

Rule Path
Disallow /

jbh*agent

Rule Path
Disallow /

jetcar

Rule Path
Disallow /

joc\ web\ spider

Rule Path
Disallow /

justview

Rule Path
Disallow /

larbin

Rule Path
Disallow /

leechftp

Rule Path
Disallow /

lexibot

Rule Path
Disallow /

lftp

Rule Path
Disallow /

link*sleuth

Rule Path
Disallow /

likse

Rule Path
Disallow /

link

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

mag-net

Rule Path
Disallow /

magnet

Rule Path
Disallow /

mass\ downloader

Rule Path
Disallow /

memo

Rule Path
Disallow /

microsoft.url

Rule Path
Disallow /

midown\ tool

Rule Path
Disallow /

mirror

Rule Path
Disallow /

mister\ pix

Rule Path
Disallow /

mozilla.*indy

Rule Path
Disallow /

mozilla.*newt

Rule Path
Disallow /

mozilla*msiecrawler

Rule Path
Disallow /

ms\ frontpage*

Rule Path
Disallow /

msfrontpage

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

msproxy

Rule Path
Disallow /

navroad

Rule Path
Disallow /

nearsite

Rule Path
Disallow /

netants

Rule Path
Disallow /

netmechanic

Rule Path
Disallow /

netspider

Rule Path
Disallow /

net\ vampire

Rule Path
Disallow /

netzip

Rule Path
Disallow /

nicerspro

Rule Path
Disallow /

ninja

Rule Path
Disallow /

octopus

Rule Path
Disallow /

offline\ explorer

Rule Path
Disallow /

offline\ navigator

Rule Path
Disallow /

openfind

Rule Path
Disallow /

pagegrabber

Rule Path
Disallow /

papa\ foto

Rule Path
Disallow /

pavuk

Rule Path
Disallow /

pcbrowser

Rule Path
Disallow /

ping

Rule Path
Disallow /

pingalink

Rule Path
Disallow /

pockey

Rule Path
Disallow /

psbot

Rule Path
Disallow /

pump

Rule Path
Disallow /

qrva

Rule Path
Disallow /

realdownload

Rule Path
Disallow /

reaper

Rule Path
Disallow /

recorder

Rule Path
Disallow /

reget

Rule Path
Disallow /

scooter

Rule Path
Disallow /

seeker

Rule Path
Disallow /

siphon

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

slysearch

Rule Path
Disallow /

smartdownload

Rule Path
Disallow /

snake

Rule Path
Disallow /

spacebison

Rule Path
Disallow /

sproose

Rule Path
Disallow /

stripper

Rule Path
Disallow /

sucker

Rule Path
Disallow /

superbot

Rule Path
Disallow /

superhttp

Rule Path
Disallow /

surfbot

Rule Path
Disallow /

szukacz

Rule Path
Disallow /

takeout

Rule Path
Disallow /

teleport\ pro

Rule Path
Disallow /

urlspiderpro

Rule Path
Disallow /

vacuum

Rule Path
Disallow /

voideye

Rule Path
Disallow /

web\ image\ collector

Rule Path
Disallow /

web\ sucker

Rule Path
Disallow /

webauto

Rule Path
Disallow /

webcollage

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

web\ downloader

Rule Path
Disallow /

webemailextrac.*

Rule Path
Disallow /

webfetch

Rule Path
Disallow /

webgo\ is

Rule Path
Disallow /

webhook

Rule Path
Disallow /

webleacher

Rule Path
Disallow /

webminer

Rule Path
Disallow /

webmirror

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

websauger

Rule Path
Disallow /

website

Rule Path
Disallow /

website\ extractor

Rule Path
Disallow /

website\ quester

Rule Path
Disallow /

webster

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webwhacker

Rule Path
Disallow /

webzip

Rule Path
Disallow /

wget

Rule Path
Disallow /

whacker

Rule Path
Disallow /

widow

Rule Path
Disallow /

wwwoffle

Rule Path
Disallow /

x-tractor

Rule Path
Disallow /

xaldon\ webspider

Rule Path
Disallow /

xenu

Rule Path
Disallow /

zeus.*webster

Rule Path
Disallow /

zeus

Rule Path
Disallow /
Back to top

Comments

  • sistrix (IP 5.9.112.64 - 5.9.112.95)
  • Yandex bot - A rule breaker, just as Baidu spiders
  • proximic.com/info/spider.php
Back to top

Warnings

  • 2 invalid lines.
Back to top