talesinfo.com
robots.txt

Robots Exclusion Standard data for talesinfo.com

Resource Scan

Scan Details

Site Domain talesinfo.com
Base Domain talesinfo.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-14T23:49:21+00:00
Next Scan 2024-12-13T23:49:21+00:00

Last Successful Scan

Scanned2022-09-07T11:54:49+00:00
URL http://talesinfo.com/robots.txt
Redirect http://www.talesinfo.com/robots.txt
Redirect Domain www.talesinfo.com
Redirect Base talesinfo.com
Response IP 172.120.157.156
Found Yes
Hash 0e054582b1f407adc6f4a85118e0db86efc090a0084bf350ddf7ead558aec98b
SimHash cc74ddb62b0b

Groups

baiduspider

Rule Path
Disallow

baiduspider-image

Rule Path
Disallow

haosouspider

Rule Path
Disallow

yisouspider

Rule Path
Disallow

googlebot

Rule Path
Disallow

sogou web spider

Rule Path
Disallow

sogou inst spider

Rule Path
Disallow

sogou spider2

Rule Path
Disallow

sogou blog

Rule Path
Disallow

sogou news spider

Rule Path
Disallow

sogou orion spider

Rule Path
Disallow

sosospider

Rule Path
Disallow

*

Rule Path
Disallow /

Warnings

  • 2 invalid lines.