bigdatafinance.tw
robots.txt

Robots Exclusion Standard data for bigdatafinance.tw

Resource Scan

Scan Details

Site Domain bigdatafinance.tw
Base Domain bigdatafinance.tw
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-03T02:40:05+00:00
Next Scan 2025-10-17T02:40:05+00:00

Last Successful Scan

Scanned2025-08-25T20:06:39+00:00
URL https://bigdatafinance.tw/robots.txt
Domain IPs 103.17.8.43
Response IP 103.17.8.43
Found Yes
Hash befaca0cf2dfb3d2e0ac3452ca8f1f62907228be34e5528b0c971cb69b74e9c1
SimHash 4309c401c233

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://bigdatafinance.tw/sitemap.xml
sitemap https://bigdatafinance.tw/sitemap/news-688.xml
sitemap https://bigdatafinance.tw/sitemap/object-687.xml
sitemap https://bigdatafinance.tw/sitemap/label-686.xml
sitemap https://bigdatafinance.tw/sitemap/thread-685.xml
sitemap https://bigdatafinance.tw/sitemap/ranking-684.xml