zhtwnet.com
robots.txt

Robots Exclusion Standard data for zhtwnet.com

Resource Scan

Scan Details

Site Domain zhtwnet.com
Base Domain zhtwnet.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-12T10:29:22+00:00
Next Scan 2024-11-19T10:29:22+00:00

Last Successful Scan

Scanned2024-11-04T10:28:34+00:00
URL https://zhtwnet.com/robots.txt
Domain IPs 104.21.4.209, 172.67.132.114
Response IP 172.67.132.114
Found Yes
Hash a6bff361da6c9e0edbe5a30964c60988660b4d8d603225543439e5a00a9d6dbb
SimHash 662cde9ef4b1

Groups

petalbot
baiduspider
mj12bot
archive.org_bot

Rule Path
Disallow /
Disallow /?s=*
Disallow /*/?s=*%5C
Disallow /search_gcse/
Disallow /search/

*
googlebot
googlebot-image
googlebot-news
googlebot-video
storebot-google
google-inspectiontool
googleother
google-extended
apis-google
adsbot-google-mobile
adsbot-google
mediapartners-google
feedfetcher-google
googleproducer
google-site-verification
googlebot-mobile
facebookcatalog
facebookexternalhit
twitterbot
yahoo
bingbot
adidxbot
bingpreview
microsoftpreview
facebot
line-poker
ahrefsbot
wordpress.com

Rule Path
Disallow /wp-admin/
Disallow /client-portal/
Disallow /wp-content/
Disallow /wp-includes/
Disallow /search_gcse/
Disallow /xmlrpc.php*
Disallow /wp-includes/
Disallow /cgi-bin*
Disallow /public_html*
Disallow /trackback/
Disallow /*?replytocom=*
Disallow /*/comment-page*
Allow /?s=*
Allow /*/?s=*%5C
Allow /search/
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/
Allow /*?utm_medium=*
Allow *.js*
Allow *.css*
Allow *.ajax*
Allow *.ttf*
Allow *.woff*
Allow *.woff2*
Allow /wp-content/*.js*
Allow /wp-content/*.css*
Allow /wp-content/*.ajax*
Allow /wp-content/*.ttf*
Allow /wp-content/*.woff*
Allow /wp-content/*.woff2*
Allow /wp-includes/*.js*
Allow /wp-includes/*.css*
Allow /wp-includes/*.ajax*
Allow /wp-includes/*.ttf*
Allow /wp-includes/*.woff*
Allow /wp-includes/*.woff2*
Allow /wp-content/plugins/*.css*
Allow /wp-content/plugins/*.js*
Allow /wp-content/plugins/*.ajax*
Allow /wp-content/plugins/*.ttf*
Allow /wp-content/plugins/*.woff*
Allow /wp-content/plugins/*.woff2*
Allow /wp-content/themes/*.css*
Allow /wp-content/themes/*.js*
Allow /wp-content/themes/*.ajax*
Allow /wp-content/themes/*.ttf*
Allow /wp-content/themes/*.woff*
Allow /wp-content/themes/*.woff2*
Allow /ads/preferences/
Allow /gpt/
Allow /pagead/show_ads.js
Allow /pagead/js/adsbygoogle.js
Allow /pagead/js/*/show_ads_impl.js
Allow /static/glade.js
Allow /static/glade/

Other Records

Field Value
sitemap https://zhtwnet.com/sitemap.xml
sitemap https://zhtwnet.com/sitemap-post-type-post.xml
sitemap https://zhtwnet.com/sitemap-post-type-post-2.xml
sitemap https://zhtwnet.com/sitemap-post-type-page.xml
sitemap https://zhtwnet.com/sitemap-taxonomy-category.xml
sitemap https://zhtwnet.com/sitemap-taxonomy-post_tag.xml
sitemap https://zhtwnet.com/sitemap-taxonomy-post_tag-2.xml
sitemap https://zhtwnet.com/sitemap-taxonomy-post_tag-3.xml
sitemap https://zhtwnet.com/sitemap-taxonomy-post_tag.xml

Comments

  • This virtual robots.txt file was created by the Virtual Robots.txt WordPress plugin: https://www.wordpress.org/plugins/pc-robotstxt/

Warnings

  • 1 invalid line.