aruhana.dk
robots.txt
Robots Exclusion Standard data for aruhana.dk
Resource Scan
Scan Details
| Site Domain | aruhana.dk |
| Base Domain | aruhana.dk |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-04T15:50:25+00:00 |
| Next Scan | 2024-11-02T15:50:25+00:00 |
Last Successful Scan
| Scanned | 2023-10-09T18:12:51+00:00 |
| URL | https://aruhana.dk/robots.txt |
| Domain IPs | 104.21.61.69, 172.67.207.52, 2606:4700:3030::ac43:cf34, 2606:4700:3035::6815:3d45 |
| Response IP | 104.21.61.69 |
| Found | Yes |
| Hash | 67ef532ba2266cfd149b46f4d058894b143ea8ac8fe92461f6b80be1fa6e0348 |
| SimHash | 9e7be822dcb3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
*
| Rule | Path |
|---|---|
| Disallow | /*blackhole |
| Disallow | /?blackhole |
nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler
baiduspider
yahoo! slurp china
yandexbot
yandex
yandeximages
baiduspider-image
msiecrawler
webcopier
python-urllib
url_spider_pro
emailcollector
emailsiphon
webbandit
emailwolf
extractorpro
copyrightcheck
alexibot
web image collector
zeus
zeus link scout
erocrawler
linkscan/8.1a unix
keyword density/0.9
webcopier v3.2a
webcapture 2.0
webcopier v.2.2
etaospider
black hole
orthogaffe
ubicrawler
doc
zao
gsa-crawler
sitecheck.internetseer.com
zealbot
sitesnagger
webstripper
webcopier
fetch
offline explorer
teleport
teleportpro
webzip
linko
httrack
microsoft.url.control
xenu
larbin
libwww
zyborg
download ninja
wget
grub-client
k2spider
npbot
webreaper
cncdialer
maxthon
slurp
screaming frog seo spider
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow |
Other Records
| Field | Value |
|---|---|
| sitemap | https://aruhana.dk/sitemap_index.xml |
Comments