zhtwnet.com
robots.txt

Robots Exclusion Standard data for zhtwnet.com

Resource Scan

Scan Details

Site Domain zhtwnet.com
Base Domain zhtwnet.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-06T10:28:29+00:00
Next Scan 2024-11-04T10:28:29+00:00

Last Successful Scan

Scanned2024-04-09T10:25:21+00:00
URL https://zhtwnet.com/robots.txt
Domain IPs 104.21.4.209, 172.67.132.114, 2606:4700:3031::ac43:8472, 2606:4700:3037::6815:4d1
Response IP 172.67.132.114
Found Yes
Hash 5357da8a7d009a3048c0199d40e999c1ff586a019d50b77b6c943086bcf7b315
SimHash ee0ccc728a7b

Groups

*

Rule Path
Allow /ads/preferences/
Allow /gpt/
Allow /pagead/show_ads.js
Allow /pagead/js/adsbygoogle.js
Allow /pagead/js/*/show_ads_impl.js
Allow /static/glade.js
Allow /static/glade/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /xmlrpc.php

ahrefsbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 500

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexcalendar

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /