Log In Sign Up

elreceton.com
robots.txt

Robots Exclusion Standard data for elreceton.com

Resource Scan

Scan Details

Site Domain elreceton.com
Base Domain elreceton.com
Scan Status Ok
Last Scan2025-04-07T06:32:50+00:00
Next Scan 2025-04-14T06:32:50+00:00

Last Scan

Scanned2025-04-07T06:32:50+00:00
URL https://elreceton.com/robots.txt
Domain IPs 104.21.37.55, 172.67.204.201, 2606:4700:3031::ac43:ccc9, 2606:4700:3037::6815:2537
Response IP 172.67.204.201
Found Yes
Hash 0b05b7250666004cec45a4c2d9d4efce72f8a9d4496376b867048ec836563787
SimHash f023c0ead7f3

Groups

*

Rule Path
Disallow /assets/avatar*
Disallow */web/*/*
Disallow /goto

rogerbot

Rule Path
Disallow /

noxtrumbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

url_spider_pro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

web image collector

Rule Path
Disallow /

xenu's link sleuth 1.1c

Rule Path
Disallow /

xenu's

Rule Path
Disallow /

zeus

Rule Path
Disallow /

zeus link scout

Rule Path
Disallow /

erocrawler

Rule Path
Disallow /

linkscan/8.1a unix

Rule Path
Disallow /

keyword density/0.9

Rule Path
Disallow /

webcopier v3.2a

Rule Path
Disallow /

webcapture 2.0

Rule Path
Disallow /

webcopier v.2.2

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

black hole

Rule Path
Disallow /

xenu\\\'s link sleuth 1.1c

Rule Path
Disallow /

xenu\\\'s

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /
Back to top

Comments

  • SPECIFIC BOTS
Back to top