todayheadliners.com
robots.txt

Robots Exclusion Standard data for todayheadliners.com

Resource Scan

Scan Details

Site Domain todayheadliners.com
Base Domain todayheadliners.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-21T11:52:16+00:00
Next Scan 2026-02-19T11:52:16+00:00

Last Successful Scan

Scanned2025-07-25T07:36:40+00:00
URL https://todayheadliners.com/robots.txt
Domain IPs 2a02:4780:15:df76:3ca2:7879:6b8f:454d, 2a02:4780:38:5e43:8297:4cb1:cfa0:3c50, 77.37.115.170, 91.108.100.2
Response IP 77.37.75.117
Found Yes
Hash c6c03c0121c3bbfec49e7ee40fa4f03bd1923c8f2f71a7d87480e55c823a6cf5
SimHash 61014c400db2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://todayheadliners.com/sitemap_index.xml