androidliste.de
robots.txt

Robots Exclusion Standard data for androidliste.de

Resource Scan

Scan Details

Site Domain androidliste.de
Base Domain androidliste.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-06-22T07:51:46+00:00
Next Scan 2025-09-20T07:51:46+00:00

Last Successful Scan

Scanned2025-02-23T07:49:57+00:00
URL https://androidliste.de/robots.txt
Redirect https://www.androidliste.de/robots.txt
Redirect Domain www.androidliste.de
Redirect Base androidliste.de
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Redirect IPs 104.26.4.42, 104.26.5.42, 172.67.68.217, 2606:4700:20::681a:42a, 2606:4700:20::681a:52a, 2606:4700:20::ac43:44d9
Response IP 104.26.5.42
Found Yes
Hash 1e7518765790fd3d608d431cfc60ba816cdd2bdf73504c11bac4ba746acdf645
SimHash 4835992a4153

Groups

androidspider

Rule Path
Allow /

zaosite

Rule Path
Disallow /

yadirectbot

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

bingbot

Rule Path
Allow /

yandexbot

Rule Path
Disallow /

*

Rule Path
Disallow */next-download/
Disallow /last-downloads/
Disallow /deals/
Disallow /landbot-apps/
Disallow /stories/
Disallow /recommended-apps/
Disallow /s/
Disallow /uploads/
Disallow /description/
Disallow /permisos/
Disallow /item-images/
Disallow /coming-soon/
Disallow /page/eNoResults/
Disallow /qr/
Disallow /news/wp-admin/
Disallow /news/wp-login.php
Disallow /backend_contenido.php/
Disallow /backend.php/
Disallow /pic/
Disallow /regras/
Disallow /generate_email/
Disallow /newsletter/
Disallow /check-email/
Disallow /news/sareport/
Disallow /*?ModPagespeed=*
Disallow */download-mail/
Disallow /list/android-apps/cp/
Disallow /list/android-apps/zcp/
Disallow /mailer/
Disallow /user/
Disallow /az/
Disallow /user/home/
Disallow /user/reviews/
Disallow /user/questions/
Disallow /user/edit/
Disallow /user/change-password/
Disallow /user/installation/
Disallow /user/following/
Disallow /user/invite_friends/
Disallow /user/followers/
Disallow /forgot_password
Disallow /login
Disallow /login-manual
Disallow /registration
Disallow /ajax
Disallow /devices/
Disallow /item/devices/
Disallow /list/devices/
Disallow /navigation/
Disallow /cn/
Disallow /id/
Disallow /es/
Disallow /de/
Disallow /ko/
Disallow /ro/
Disallow /th/
Disallow /my/
Disallow /nl/
Disallow /fr/
Disallow /tr/
Disallow /jp/
Disallow /vn/
Disallow /en/
Disallow /br/
Disallow /it/
Disallow /ru/
Disallow /pl/
Disallow /gr/
Disallow /*?sort=*
Disallow */shared/src/locales