apfeltalk.de
robots.txt

Robots Exclusion Standard data for apfeltalk.de

Resource Scan

Scan Details

Site Domain apfeltalk.de
Base Domain apfeltalk.de
Scan Status Ok
Last Scan2024-09-25T19:52:24+00:00
Next Scan 2024-10-02T19:52:24+00:00

Last Scan

Scanned2024-09-25T19:52:24+00:00
URL https://apfeltalk.de/robots.txt
Domain IPs 104.26.12.96, 104.26.13.96, 172.67.71.154, 2606:4700:20::681a:c60, 2606:4700:20::681a:d60, 2606:4700:20::ac43:479a
Response IP 172.67.71.154
Found Yes
Hash df1d005ba422775f4559309c921620f4ed03d0fc6510e58a8435655833e78689
SimHash 284878808a52

Groups

*

Rule Path
Disallow /magazin/author
Disallow /redaktion
Disallow /go

webreaper
webcopier
offline explorer
httrack
microsoft.url.control
emailcollector
penthesilea

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.apfeltalk.de/community/sitemap.php

Comments

  • Disallow: /community/forums/magazin.263