en.news.directexpose.com
robots.txt

Robots Exclusion Standard data for en.news.directexpose.com

Resource Scan

Scan Details

Site Domain en.news.directexpose.com
Base Domain directexpose.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-11T22:23:38+00:00
Next Scan 2024-06-09T22:23:38+00:00

Last Successful Scan

Scanned2023-05-11T08:53:07+00:00
URL https://en.news.directexpose.com/robots.txt
Domain IPs 104.17.173.102, 104.17.71.67
Response IP 104.17.173.102
Found Yes
Hash 133f9dae8651ce7ccaf73b4e190fe1c6ee2971d8b257dde3d4edbfe5d9407a3d
SimHash 01009b628733

Groups

adsbot-google

Rule Path
Disallow

grapeshot

Rule Path
Disallow

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.news.directexpose.com/sitemap.xml