tvabend.de
robots.txt
Robots Exclusion Standard data for tvabend.de
Resource Scan
Scan Details
| Site Domain | tvabend.de |
| Base Domain | tvabend.de |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-21T12:08:54+00:00 |
| Next Scan | 2024-07-20T12:08:54+00:00 |
Last Successful Scan
| Scanned | 2024-03-23T11:45:47+00:00 |
| URL | https://tvabend.de/robots.txt |
| Redirect | https://www.tvabend.de/robots.txt |
| Redirect Domain | www.tvabend.de |
| Redirect Base | tvabend.de |
| Domain IPs | 104.21.52.68, 172.67.196.171, 2606:4700:3031::ac43:c4ab, 2606:4700:3036::6815:3444 |
| Redirect IPs | 104.21.52.68, 172.67.196.171, 2606:4700:3031::ac43:c4ab, 2606:4700:3036::6815:3444 |
| Response IP | 172.67.196.171 |
| Found | Yes |
| Hash | fa501adb1f8b1ab90eabde2b39db5654390e346d0caf72269e83dd4bd3639da0 |
| SimHash | fa1e48727d94 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /stats |
| Disallow | /notifications |
| Disallow | /features |
| Disallow | /metrics |
admantx
admantx-adform
adscanner
ahrefsbot
awariosmartbot
barkrowler
blexbot
buck
ccbot
demandbasesiteanalyzer
dotbot
linguee bot
ltx71 - (http://ltx71.com/)
mauibot
mazbot
mediatoolkitbot
megaindex
mj12bot
proximic
rogerbot
seekport crawler
seekportbot
serpstatbot
seznambot
sirdatabot
ttd-content
uipbot
uptimerobot
zoominfobot
| Rule | Path |
|---|---|
| Disallow | / |