epochtimes.com
robots.txt

Robots Exclusion Standard data for epochtimes.com

Resource Scan

Scan Details

Site Domain epochtimes.com
Base Domain epochtimes.com
Scan Status Ok
Last Scan2024-11-10T20:01:58+00:00
Next Scan 2024-11-17T20:01:58+00:00

Last Scan

Scanned2024-11-10T20:01:58+00:00
URL https://epochtimes.com/robots.txt
Redirect https://www.epochtimes.com/robots.txt
Redirect Domain www.epochtimes.com
Redirect Base epochtimes.com
Domain IPs 130.211.7.151
Redirect IPs 130.211.7.151
Response IP 130.211.7.151
Found Yes
Hash 5dd12f21ce9e38a75cc3f48e46882520b3f2d3d0e5790df439cbeb9bd0de6305
SimHash b95e5b50aaa2

Groups

*

Rule Path
Disallow */uncategorized/*
Disallow /wp-includes/*
Disallow /wp-admin/*
Disallow /wp-content/plugins/*
Disallow /assets/plugins/*
Disallow /search/*
Disallow /feedback/*
Disallow /*?q=*
Disallow /*?p=*
Disallow /*?ref
Disallow *utm_

twitterbot

Rule Path
Allow /*?*utm_

facebookexternalhit

Rule Path
Allow /*?*utm_

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

polecatbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.epochtimes.com/sitemap/zh-tw/sitemap.xml.gz
sitemap https://www.epochtimes.com/sitemap/zh-tw/sitemap_news.xml.gz
sitemap https://www.epochtimes.com/sitemap/zh-tw/sitemap_category.xml.gz
sitemap https://www.epochtimes.com/sitemap/zh-tw/sitemap_pages.xml
sitemap https://www.epochtimes.com/sitemap/zh-cn/sitemap.xml.gz
sitemap https://www.epochtimes.com/sitemap/zh-cn/sitemap_news.xml.gz
sitemap https://www.epochtimes.com/sitemap/zh-cn/sitemap_category.xml.gz
sitemap https://www.epochtimes.com/sitemap/zh-cn/sitemap_pages.xml

Comments

  • Directories