xlr8yourmac.com
robots.txt

Robots Exclusion Standard data for xlr8yourmac.com

Resource Scan

Scan Details

Site Domain xlr8yourmac.com
Base Domain xlr8yourmac.com
Scan Status Ok
Last Scan2024-08-29T18:10:51+00:00
Next Scan 2024-09-28T18:10:51+00:00

Last Scan

Scanned2024-08-29T18:10:51+00:00
URL https://xlr8yourmac.com/robots.txt
Redirect https://www.xlr8yourmac.com/robots.txt
Redirect Domain www.xlr8yourmac.com
Redirect Base xlr8yourmac.com
Domain IPs 66.226.70.9
Redirect IPs 66.226.70.9
Response IP 66.226.70.9
Found Yes
Hash 1231c5bd97d6faa6ae200629aaaf555c7b1bc71e4a9ed308c6d4fa9c0e11a6ff
SimHash a65772c649a1

Groups

*

Rule Path
Disallow /images

ia_archiver

Rule Path
Disallow /
Disallow *

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webzip

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

web downloader

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

offline explorer pro

Rule Path
Disallow /

httrack website copier

Rule Path
Disallow /

offline commander

Rule Path
Disallow /

leech

Rule Path
Disallow /

websnake

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

http weazel

Rule Path
Disallow /

superbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

speedy

Rule Path
Disallow /

speedy_spider

Rule Path
Disallow /

speedybot

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

Comments

  • Exclude some robots