xsw.tw
robots.txt

Robots Exclusion Standard data for xsw.tw

Resource Scan

Scan Details

Site Domain xsw.tw
Base Domain xsw.tw
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-11-05T21:31:55+00:00
Next Scan 2024-11-19T21:31:55+00:00

Last Successful Scan

Scanned2024-10-21T21:31:09+00:00
URL https://xsw.tw/robots.txt
Domain IPs 13.33.88.127, 13.33.88.35, 13.33.88.79, 13.33.88.88, 2600:9000:223b:4000:19:34df:8d80:93a1, 2600:9000:223b:6600:19:34df:8d80:93a1, 2600:9000:223b:7000:19:34df:8d80:93a1, 2600:9000:223b:9800:19:34df:8d80:93a1, 2600:9000:223b:a800:19:34df:8d80:93a1, 2600:9000:223b:c200:19:34df:8d80:93a1, 2600:9000:223b:ce00:19:34df:8d80:93a1, 2600:9000:223b:d800:19:34df:8d80:93a1
Response IP 13.33.88.35
Found Yes
Hash f3aefb3355feedd65ab8a0d323c6b6cb545f39edaeb65ed894138d984a2b8e04
SimHash 2050c18357b4

Groups

*

Rule Path
Allow /ads.txt
Disallow /ads

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

slurp

Rule Path
Disallow

teoma

Rule Path
Disallow

ia_archiver

Rule Path
Disallow

twiceler

Rule Path
Disallow

msnbot

Rule Path
Disallow

scrubby

Rule Path
Disallow

robozilla

Rule Path
Disallow

gigabot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

psbot

Rule Path
Disallow