audeobox.com
robots.txt

Robots Exclusion Standard data for audeobox.com

Resource Scan

Scan Details

Site Domain audeobox.com
Base Domain audeobox.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-04T09:17:45+00:00
Next Scan 2024-10-02T09:17:45+00:00

Last Successful Scan

Scanned2023-05-12T18:23:39+00:00
URL https://audeobox.com/robots.txt
Redirect https://www.audeobox.com/robots.txt
Redirect Domain www.audeobox.com
Redirect Base audeobox.com
Domain IPs 104.21.21.199, 172.67.200.21, 2606:4700:3031::6815:15c7, 2606:4700:3037::ac43:c815
Redirect IPs 104.21.21.199, 172.67.200.21, 2606:4700:3031::6815:15c7, 2606:4700:3037::ac43:c815
Response IP 104.21.21.199
Found Yes
Hash 75d430f85785597ff73d26f0e34cf0a228d5041de6a15a839fdcbed3d1d7ebc8
SimHash aa3fc5caea19

Groups

*

Rule Path
Disallow /*blackhole
Disallow /?blackhole
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/
Disallow /trackback/
Disallow /index.php
Disallow /xmlrpc.com
Disallow /wp-login.php
Disallow /wp-content/plugins/
Disallow /comments/feed/
Disallow /administrator/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /components/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /modules/
Disallow /plugins/
Disallow /tmp/
Disallow /*add-to-cart%3D*
Disallow /cart/
Disallow /checkout/
Disallow /my-account/

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

slurp

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

neevabot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

liebaofast

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mauibot (crawler.feedback+wc@gmail.com)

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

mqqbrowser

Rule Path
Disallow /

nimbostratus-bot/v1.3.2

Rule Path
Disallow /

qwant-news

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sputnikbot/2.3

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

tinytestbot

Rule Path
Disallow /

ucbrowser

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /