tag24.de
robots.txt

Robots Exclusion Standard data for tag24.de

Resource Scan

Scan Details

Site Domain tag24.de
Base Domain tag24.de
Scan Status Ok
Last Scan2024-11-02T06:48:13+00:00
Next Scan 2024-11-09T06:48:13+00:00

Last Scan

Scanned2024-11-02T06:48:13+00:00
URL https://tag24.de/robots.txt
Redirect https://www.tag24.de/robots.txt
Redirect Domain www.tag24.de
Redirect Base tag24.de
Domain IPs 104.18.28.155, 104.18.29.155, 2606:4700::6812:1c9b, 2606:4700::6812:1d9b
Redirect IPs 104.18.28.155, 104.18.29.155, 2606:4700::6812:1c9b, 2606:4700::6812:1d9b
Response IP 104.18.28.155
Found Yes
Hash 3ca8aec0208ad37cf1c53b0d0a17b91761830116d6e62ba93bd7962543e43e1a
SimHash 4240c0228f11

Groups

gptbot

Rule Path
Allow /unternehmen
Disallow /

*

Rule Path
Disallow /agency/
Disallow /api/

Other Records

Field Value
sitemap https://www.tag24.de/sitemap_tag24.xml
sitemap https://www.tag24.de/sitemap/googlenews
sitemap https://www.tag24.de/sitemap_tag24_d.xml

Warnings

  • `host` is not a known field.