embeds.thedmn.com
robots.txt

Robots Exclusion Standard data for embeds.thedmn.com

Resource Scan

Scan Details

Site Domain embeds.thedmn.com
Base Domain thedmn.com
Scan Status Ok
Last Scan2025-03-16T08:34:38+00:00
Next Scan 2025-04-15T08:34:38+00:00

Last Scan

Scanned2025-03-16T08:34:38+00:00
URL https://embeds.thedmn.com/robots.txt
Domain IPs 23.209.46.87, 23.209.46.93, 2600:1413:b000:13::b857:c18e, 2600:1413:b000:13::b857:c19b
Response IP 23.209.46.87
Found Yes
Hash 1055b7d4e12496d93613a48da14dd2a4eebec9d8990f7a6a55db268c3c382f34
SimHash 290cd840e393

Groups

*

Rule Path
Allow /

magnetbot

Rule Path
Allow /

*

Rule Path
Disallow /help/thank*
Disallow /checkout/*
Disallow /offers*
Allow /subscribe/join/
Disallow /subscribe*

magnetbot

Rule Path
Disallow /checkout/*
Disallow /offers*
Disallow /subscribe*

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.dallasnews.com/arc/outboundfeeds/sitemap-index/?outputType=xml