tag24.com
robots.txt

Robots Exclusion Standard data for tag24.com

Resource Scan

Scan Details

Site Domain tag24.com
Base Domain tag24.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-29T23:52:08+00:00
Next Scan 2025-01-27T23:52:08+00:00

Last Successful Scan

Scanned2023-10-06T16:45:16+00:00
URL https://tag24.com/robots.txt
Redirect https://www.tag24.com/robots.txt
Redirect Domain www.tag24.com
Redirect Base tag24.com
Domain IPs 172.66.40.139, 172.66.43.117, 2606:4700:3108::ac42:288b, 2606:4700:3108::ac42:2b75
Redirect IPs 172.66.40.139, 172.66.43.117, 2606:4700:3108::ac42:288b, 2606:4700:3108::ac42:2b75
Response IP 172.66.40.139
Found Yes
Hash d79588bcabac0e856dfd71c5fe776e735882102407bc5521aeb231315e8b9f09
SimHash 6108da41c133

Groups

gptbot

Rule Path
Allow /company
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.tag24.com/sitemap_tag24.xml
sitemap https://www.tag24.com/sitemap/googlenews

Warnings

  • `host` is not a known field.