artrabbit.com
robots.txt

Robots Exclusion Standard data for artrabbit.com

Resource Scan

Scan Details

Site Domain artrabbit.com
Base Domain artrabbit.com
Scan Status Ok
Last Scan2025-05-17T20:08:21+00:00
Next Scan 2025-05-31T20:08:21+00:00

Last Scan

Scanned2025-05-17T20:08:21+00:00
URL https://artrabbit.com/robots.txt
Redirect https://www.artrabbit.com/robots.txt
Redirect Domain www.artrabbit.com
Redirect Base artrabbit.com
Domain IPs 130.211.100.21
Redirect IPs 130.211.100.21
Response IP 130.211.100.21
Found Yes
Hash 77b69b7ec0b6990eaf2b324021730d5b4f32af1296765f9e706fb4d729e71a51
SimHash 41155c02cbb5

Groups

*

Rule Path
Disallow /matrix_engine/
Disallow /layout/*.tpl
Disallow /layout/*.xml
Disallow /downloads/
Disallow /docs/
Disallow /auto/
Disallow /ajax/*.tpl
Disallow /ajax/*.xml
Disallow /modal/
Disallow /settings/
Disallow /site/
Disallow /uploads/
Disallow /account/
Disallow /cache/*.log
Disallow /cache/*.scp
Disallow /cache/*.cache
Disallow /*.sql
Disallow /*.php

npbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

larbin

Rule Path
Disallow /

trendkite-akashic-crawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

superbot

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

henrythemiragorobot

Rule Path
Disallow /

bumblebee@relevare.com

Rule Path
Disallow /

true_robot/1.0ll

Rule Path
Disallow /

true_robot

Rule Path
Disallow /

szukacz/1.4

Rule Path
Disallow /

zeus

Rule Path
Disallow /

zeus 32297 webster pro v2.9 win32

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

voyager/1.0

Rule Path
Disallow /

mj12bot/v1.0.7 (http://majestic12.co.uk/bot.php?+) [^] [^]

Rule Path
Disallow /

aspider/0.09

Rule Path
Disallow /

appie 1.1 (www.walhello.com)

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.artrabbit.com/cache/sitemap_index.xml