manufacturers.com.tw
robots.txt

Robots Exclusion Standard data for manufacturers.com.tw

Resource Scan

Scan Details

Site Domain manufacturers.com.tw
Base Domain manufacturers.com.tw
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-06T16:02:06+00:00
Next Scan 2025-04-20T16:02:06+00:00

Last Successful Scan

Scanned2025-03-22T15:39:08+00:00
URL https://manufacturers.com.tw/robots.txt
Redirect https://www.manufacturers.com.tw/robots.txt
Redirect Domain www.manufacturers.com.tw
Redirect Base manufacturers.com.tw
Domain IPs 104.21.29.98, 172.67.148.189, 2606:4700:3031::ac43:94bd, 2606:4700:3036::6815:1d62
Redirect IPs 104.21.29.98, 172.67.148.189, 2606:4700:3031::ac43:94bd, 2606:4700:3036::6815:1d62
Response IP 104.21.29.98
Found Yes
Hash ac7ae57cabfd4af5a155af74fb9855c56a4ed8620221b9f2f32c17df45a1c827
SimHash 6002dc4ee191

Groups

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1000

yahoo! slurp china

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1000

*

Rule Path
Disallow /directory/
Disallow /company-categories/
Disallow /basic-data.php
Disallow /images/
Disallow /recommend.php
Disallow /inquiry.php
Disallow /inquiry-c.php
Disallow /ident.php
Disallow /zh-tw/showroom
Disallow /ctd_adclicks.php
Disallow /contact-c.php
Disallow /buyer_showroom.php
Disallow /tradeshow_list/
Disallow /tradeshow_sub/
Disallow /trades.php
Disallow /trades_htm.php
Disallow /machinetools/5993/vertical-machining-center.html
Disallow /machinery/Machine-Tools-Manufacturers.html
Disallow /machinery/Grinding-Machine.html
Disallow /machinery/Engraving-Machines.html
Disallow /trades_taipeishow.php
Disallow /search_keyword.php

Other Records

Field Value
crawl-delay 10

Comments

  • http://search.help.cn.yahoo.com/h4_5.html
  • Yahoo! Slurp China
  • User-agent: 008
  • Disallow: /