Log In Sign Up

arigato.es
robots.txt

Robots Exclusion Standard data for arigato.es

Resource Scan

Scan Details

Site Domain arigato.es
Base Domain arigato.es
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-12T04:46:39+00:00
Next Scan 2025-01-10T04:46:39+00:00

Last Successful Scan

Scanned2024-06-15T03:03:50+00:00
URL https://arigato.es/robots.txt
Domain IPs 52.68.165.211
Response IP 52.68.165.211
Found Yes
Hash e8f5976f32e1e2703b978f9465e033269c7abb6d9106e51b5ca3f99294286a5d
SimHash 3b18e906fa8a

Groups

barkrowler

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

proximic

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

mappy

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

bidswitchbot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

integralads

Rule Path
Disallow /

jet-bot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /
Back to top