mintnews.tw
robots.txt

Robots Exclusion Standard data for mintnews.tw

Resource Scan

Scan Details

Site Domain mintnews.tw
Base Domain mintnews.tw
Scan Status Ok
Last Scan2024-09-17T19:10:15+00:00
Next Scan 2024-09-24T19:10:15+00:00

Last Scan

Scanned2024-09-17T19:10:15+00:00
URL https://mintnews.tw/robots.txt
Domain IPs 220.128.121.252
Response IP 220.128.121.252
Found Yes
Hash 6887dc3fc917ae8afc710a4e8123034e3a66204875128735e6d626b2230390fa
SimHash 6718c951e535

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0.1

Other Records

Field Value Comment
sitemap https://Mintnews.tw/sitemap/index.asp Added by Grayden
sitemap https://Mintnews.tw/sitemap/sitemap_content.asp Added by Grayden
sitemap https://Mintnews.tw/sitemap/sitemap_lightbox.asp -
sitemap https://Mintnews.tw/sitemap/sitemap.xml Added by Grayden
sitemap https://Mintnews.tw/sitemap/sitemap_content.xml Added by Grayden
sitemap https://Mintnews.tw/sitemap/sitemap_lightbox.xml Added by Grayden