magazin-touch.de
robots.txt

Robots Exclusion Standard data for magazin-touch.de

Resource Scan

Scan Details

Site Domain magazin-touch.de
Base Domain magazin-touch.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-21T02:21:43+00:00
Next Scan 2024-10-05T02:21:43+00:00

Last Successful Scan

Scanned2024-09-05T01:50:56+00:00
URL https://magazin-touch.de/robots.txt
Domain IPs 104.21.4.198, 172.67.132.97, 2606:4700:3030::6815:4c6, 2606:4700:3035::ac43:8461
Response IP 104.21.4.198
Found Yes
Hash e567e2352ac62db32a4ce78175bf64c3f35111d0481c2e52557056c39e7f88db
SimHash 5b7fdc00eeb9

Groups

ahrefsbot
aspiegelbot
blexbot
barkrowler
dotbot
mj12bot
mauibot
nimbostratus-bot
petalbot
semrushbot
seznambot
sogou
serpstatbot
trendiction
textbulkerbot

Rule Path
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 180

gptbot
google-extended

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://magazin-touch.de/sitemap_index.xml
sitemap https://magazin-touch.de/sitemap-news.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK

Warnings

  • 1 invalid line.