finance.mingpao.com
robots.txt

Robots Exclusion Standard data for finance.mingpao.com

Resource Scan

Scan Details

Site Domain finance.mingpao.com
Base Domain mingpao.com
Scan Status Ok
Last Scan2024-04-28T02:19:31+00:00
Next Scan 2024-05-28T02:19:31+00:00

Last Scan

Scanned2024-04-28T02:19:31+00:00
URL https://finance.mingpao.com/robots.txt
Domain IPs 202.80.6.222
Response IP 202.80.6.222
Found Yes
Hash 0941aaa420022d11c615fbb217fe8f39e23df6897d028ec626df7600deb54e1a
SimHash 0d0d0945dd15

Groups

trade desk ads.txt & sellers.json crawler

Rule Path
Disallow

grapeshot

Rule Path
Disallow

*

Rule Path
Disallow /php/class/
Disallow /php/manage/
Disallow /php/nocache/
Disallow /php/redirect1.php
Disallow dummy%3Dtrue$
Disallow /dat/
Disallow /htm/dummy/

Other Records

Field Value
sitemap https://finance.mingpao.com/sitemap/fin.xml