ntdtv.com
robots.txt

Robots Exclusion Standard data for ntdtv.com

Resource Scan

Scan Details

Site Domain ntdtv.com
Base Domain ntdtv.com
Scan Status Ok
Last Scan2024-09-22T02:27:30+00:00
Next Scan 2024-09-29T02:27:30+00:00

Last Scan

Scanned2024-09-22T02:27:30+00:00
URL https://ntdtv.com/robots.txt
Redirect https://www.ntdtv.com/robots.txt
Redirect Domain www.ntdtv.com
Redirect Base ntdtv.com
Domain IPs 130.211.15.150
Redirect IPs 104.18.28.4, 104.18.29.4, 2606:4700::6812:1c04, 2606:4700::6812:1d04
Response IP 104.18.29.4
Found Yes
Hash 8075a737270e0f225810c68dd8e8d99f06dc03d7a43a82951a228b58e6fc6b98
SimHash bc14d514e364

Groups

*

Rule Path
Disallow */uncategorized/*
Disallow /wp-includes/*
Disallow /wp-admin/*
Disallow /wp-content/plugins/*
Disallow /assets/plugins/*
Disallow /feedback/*
Disallow /*?ref

twitterbot

Rule Path
Allow /*?*utm_

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

polecatbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

universalfeedparser

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.ntdtv.com/assets/uploads/sitemap/sitemap.xml.gz
sitemap https://www.ntdtv.com/assets/uploads/sitemap/sitemap_pages_gb.xml.gz
sitemap https://www.ntdtv.com/assets/uploads/sitemap/sitemap_pages_b5.xml.gz
sitemap https://www.ntdtv.com/assets/uploads/sitemap/sitemap_news_gb.xml.gz
sitemap https://www.ntdtv.com/assets/uploads/sitemap/sitemap_news_b5.xml.gz
sitemap https://www.ntdtv.com/assets/uploads/sitemap/sitemap_terms_gb.xml.gz
sitemap https://www.ntdtv.com/assets/uploads/sitemap/sitemap_terms_b5.xml.gz