dworkinreport.com
robots.txt

Robots Exclusion Standard data for dworkinreport.com

Resource Scan

Scan Details

Site Domain dworkinreport.com
Base Domain dworkinreport.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-11-08T14:18:24+00:00
Next Scan 2025-02-06T14:18:24+00:00

Last Successful Scan

Scanned2024-07-18T14:16:51+00:00
URL https://dworkinreport.com/robots.txt
Domain IPs 151.101.130.207, 151.101.194.207, 151.101.2.207, 151.101.66.207
Response IP 151.101.66.207
Found Yes
Hash eee1aa90feca4669136a8fb62184b12ee65bb3e8a49b35c4d4102e66988071c1
SimHash 4328c2c68e33

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

majestic

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

yandex

Rule Path
Disallow /

proximic

Rule Path
Disallow /

spbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://dworkinreport.com/sitemap.xml

Comments

  • WPCYCLE WordPress Robots txt