dailyfrontpage.com
robots.txt

Robots Exclusion Standard data for dailyfrontpage.com

Resource Scan

Scan Details

Site Domain dailyfrontpage.com
Base Domain dailyfrontpage.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-07-16T20:08:09+00:00
Next Scan 2024-10-14T20:08:09+00:00

Last Successful Scan

Scanned2023-06-23T20:06:08+00:00
URL https://dailyfrontpage.com/robots.txt
Domain IPs 104.21.10.139, 172.67.190.104, 2606:4700:3031::6815:a8b, 2606:4700:3031::ac43:be68
Response IP 104.21.10.139
Found Yes
Hash 20737812cb28b073d4ce052872019cb9739be4e23677eb8aa2ab8e50e5f2acf2
SimHash 410118000bb3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://dailyfrontpage.com/sitemap_index.xml