etnews.co
robots.txt

Robots Exclusion Standard data for etnews.co

Resource Scan

Scan Details

Site Domain etnews.co
Base Domain etnews.co
Scan Status Ok
Last Scan2024-06-01T16:53:51+00:00
Next Scan 2024-06-08T16:53:51+00:00

Last Scan

Scanned2024-06-01T16:53:51+00:00
URL http://etnews.co/robots.txt
Redirect https://www.ettoday.net/robots.txt
Redirect Domain www.ettoday.net
Redirect Base ettoday.net
Domain IPs 219.85.79.131
Redirect IPs 219.85.79.131
Response IP 219.85.79.131
Found Yes
Hash de232ced8832c20df1449169020360ea8e57e01dbb41b4a58b366c75196160b0
SimHash a87c6c4df4d2

Groups

*

Rule Path
Disallow /album/
Disallow /bob/
Disallow /check/
Disallow /config/
Disallow /changeCharset.php
Disallow /changeReadType.php
Disallow /changeReadType_ii.php
Disallow /et_comments.php7
Disallow /events/_cloud/
Disallow /events/_demo/
Disallow /events/_wayne/
Disallow /events/ad-book/
Disallow /events/ad-preview/
Disallow /events/ad-samples/
Disallow /events/ad-source/
Disallow /events/ad-spec/
Disallow /events/ad-test/
Disallow /events/amp/
Disallow /events/campaign/
Disallow /events/election2012/
Disallow /events/election2014/
Disallow /events/election2016/
Disallow /events/election2019/
Disallow /events/fbia/
Disallow /events/news-express/
Disallow /fbapp/
Disallow /game/
Disallow /news/demo/
Disallow /news/hot-tag.htm
Disallow /news_search/
Disallow /player/
Disallow /redir/
Disallow /source/
Disallow /tools/player/
Disallow /warrant/

Other Records

Field Value
sitemap https://www.ettoday.net/news-sitemap.xml
sitemap https://www.ettoday.net/sitemap.xml
sitemap https://www.ettoday.net/sitemap-lemon.xml

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • sitemap