pt.news.directexpose.com
robots.txt

Robots Exclusion Standard data for pt.news.directexpose.com

Resource Scan

Scan Details

Site Domain pt.news.directexpose.com
Base Domain directexpose.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-12T16:29:42+00:00
Next Scan 2024-06-10T16:29:42+00:00

Last Successful Scan

Scanned2023-05-15T21:07:50+00:00
URL https://pt.news.directexpose.com/robots.txt
Domain IPs 104.17.173.102, 104.17.71.67
Response IP 104.17.71.67
Found Yes
Hash 133f9dae8651ce7ccaf73b4e190fe1c6ee2971d8b257dde3d4edbfe5d9407a3d
SimHash 01009b628733

Groups

adsbot-google

Rule Path
Disallow

grapeshot

Rule Path
Disallow

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.news.directexpose.com/sitemap.xml