allesbroker.at
robots.txt
Robots Exclusion Standard data for allesbroker.at
Resource Scan
Scan Details
| Site Domain | allesbroker.at |
| Base Domain | allesbroker.at |
| Scan Status | Ok |
| Last Scan | 2024-10-25T20:28:48+00:00 |
| Next Scan | 2024-11-24T20:28:48+00:00 |
Last Scan
| Scanned | 2024-10-25T20:28:48+00:00 |
| URL | https://allesbroker.at/robots.txt |
| Domain IPs | 45.76.86.247 |
| Response IP | 45.76.86.247 |
| Found | Yes |
| Hash | de886ec9d154adfaf62421cd84c2ef8600157b2cd072e2c2bdda516a07a383a7 |
| SimHash | 2a3891706cf3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
gptbot
screaming frog seo spider
mj12bot
seobility
sistrix
majesticseo
xovi
xovibot
ahrefsbot
seokicks
seokicks-robot
backlinkcrawler
spbot
searchmetricsbot
search17
ia_archiver
turnitinbot
slysearch
findlinks
magpie-crawler
pixray-seeker
ezooms
lb-spider
wbsearchbot
psbot
huaweisymantecspider
ec2linkfinder
htdig
semrushbot
discobot
rogerbot
linkdex.com
seznambot
edisterbot
swebot
picmole
yeti
yeti-mobile
pagepeeker
catchbot
yacybot
netestatenecrawler
surveybot
comodosslchecker
comodo-certificates-spider
gonzo
schrein
afiliaswebminingtool
suggybot
bdbrandprotect
bpimagewalker
updownerbot
lex
contentcrawler
dcpbot
kaloogabot
mlbot
icjobs
obot
webmastercoffee
qualidator
webinator
scooter
thunderstone
larbin
opidoobot
ips-agent
tineye
unisterbot
unister
reverseget
dotbot
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.allesbroker.at/sitemap.xml |
Warnings
- 1 invalid line.