rata.host
robots.txt
Robots Exclusion Standard data for rata.host
Resource Scan
Scan Details
| Site Domain | rata.host |
| Base Domain | rata.host |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2025-08-27T08:27:35+00:00 |
| Next Scan | 2025-11-25T08:27:35+00:00 |
Last Successful Scan
| Scanned | 2024-07-10T14:24:24+00:00 |
| URL | https://rata.host/robots.txt |
| Domain IPs | 65.108.4.175 |
| Response IP | 65.108.4.175 |
| Found | Yes |
| Hash | 445b54eccaf89567b72999a6e6409e31b2c2a6f53dfbc1cbb0092f8f0697962f |
| SimHash | 9369b62b0e2b |
Groups
larbin
voideye
ahrefsbot
ahrefsbot/5.1
webcopier
chinaclaw
papa foto
navroad
teleport pro
ecatch
web image collector
httrack
semrushbot/1.1~bl
go-ahead-got-it
wwwoffle
widow
flashget
bot [email="craftbot@yahoo.com"]mailto:craftbot@yahoo.com[/email]
mister pix
webwhacker
eyenetie
pcbrowser
webreaper
grabnet
xaldon webspider
webstripper
nearsite
custo
emailsiphon
web sucker
superbot
express webpictures
website quester
extractorpro
sitesnagger
jetcar
octopus
webauto
linkpadbot
hmview
gigabot
rogerbot
grafula
midown tool
webzip
internet ninja
getweb!
website extractor
surfbot
blackwidow
takeout
interget
getright
pavuk
offline explorer
zeus
netants
semrushbot
mj12bot
disco
realdownload
dotbot
webleacher
download demon
indy library
superhttp
exabot
go!zilla
mass downloader
smartdownload
reget
image sucker
netspider
websauger
webfetch
image stripper
leechftp
joc web spider
offline navigator
webgo is
emailwolf
eirgrabber
wget
netzip
pagegrabber
net vampire
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |