Log In Sign Up

aruo.net
robots.txt

Robots Exclusion Standard data for aruo.net

Resource Scan

Scan Details

Site Domain aruo.net
Base Domain aruo.net
Scan Status Ok
Last Scan2024-05-04T02:40:55+00:00
Next Scan 2024-05-11T02:40:55+00:00

Last Scan

Scanned2024-05-04T02:40:55+00:00
URL https://aruo.net/robots.txt
Domain IPs 202.172.26.51
Response IP 202.172.26.51
Found Yes
Hash feb98784a3f6de366e62cf1ab9a793208e759c5399da60aa9a954ac5aec29873
SimHash 2354f4524c90

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

bingbot/2.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

archive.is

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bot/0.1

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

checkmarknetwork

Rule Path
Disallow /

clickagy intelligence bot

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

cloudservermarketspider

Rule Path
Disallow /

digincore.com/acrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

favicon downloader

Rule Path
Disallow /

fast-webcrawler

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

iltrovatore-setaccio

Rule Path
Disallow /

ips-agent

Rule Path
Disallow /

james bot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

lssrocketcrawler

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

mappy

Rule Path
Disallow /

maxpointcrawler

Rule Path
Disallow /

meanpathbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megalodon

Rule Path
Disallow /

metauri

Rule Path
Disallow /

microsearch.ru

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

nerdybot

Rule Path
Disallow /

netcraftsurveyagent

Rule Path
Disallow /

nettrack

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

rivalseek.com-bot

Rule Path
Disallow /

roboto

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

semanticbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seolyticscrawler

Rule Path
Disallow /

sheerboredom.experimental.robot

Rule Path
Disallow /

showyoubot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

sitetruth

Rule Path
Disallow /

smrjbot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

smtbot/1.0

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

webfuck

Rule Path
Disallow /

ycf_bot

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

yoozbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://aruo.net/sitemap.xml
Back to top