tag24.de
robots.txt

Robots Exclusion Standard data for tag24.de

Resource Scan

Scan Details

Site Domain tag24.de
Base Domain tag24.de
Scan Status Ok
Last Scan2024-06-07T19:32:53+00:00
Next Scan 2024-06-14T19:32:53+00:00

Last Scan

Scanned2024-06-07T19:32:53+00:00
URL https://tag24.de/robots.txt
Redirect https://www.tag24.de/robots.txt
Redirect Domain www.tag24.de
Redirect Base tag24.de
Domain IPs 104.18.28.155, 104.18.29.155, 2606:4700::6812:1c9b, 2606:4700::6812:1d9b
Redirect IPs 104.18.28.155, 104.18.29.155, 2606:4700::6812:1c9b, 2606:4700::6812:1d9b
Response IP 104.18.28.155
Found Yes
Hash 0533e57226bd37102944ca1c83878927625ada8b889a789399cfe3baed19fea2
SimHash 4244d0408711

Groups

gptbot

Rule Path
Allow /unternehmen
Disallow /

*

Rule Path
Disallow /agency/

Other Records

Field Value
sitemap https://www.tag24.de/sitemap_tag24.xml
sitemap https://www.tag24.de/sitemap/googlenews
sitemap https://www.tag24.de/sitemap_tag24_d.xml

Warnings

  • `host` is not a known field.