huaglad.com
robots.txt

Robots Exclusion Standard data for huaglad.com

Resource Scan

Scan Details

Site Domain huaglad.com
Base Domain huaglad.com
Scan Status Ok
Last Scan2024-09-15T15:32:53+00:00
Next Scan 2024-09-22T15:32:53+00:00

Last Scan

Scanned2024-09-15T15:32:53+00:00
URL https://huaglad.com/robots.txt
Redirect https://www.huaglad.com/robots.txt
Redirect Domain www.huaglad.com
Redirect Base huaglad.com
Domain IPs 104.21.234.88, 104.21.234.89, 2606:4700:3038::6815:ea58, 2606:4700:3038::6815:ea59
Redirect IPs 104.21.234.88, 104.21.234.89, 2606:4700:3038::6815:ea58, 2606:4700:3038::6815:ea59
Response IP 104.21.234.88
Found Yes
Hash 744210d2256966cca769bbe8aee073980e82b03f532242c2663ed2f7b3acee49
SimHash 4072db2e6e67

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Allow /
Disallow /wp-admin/
Disallow /author/
Disallow /wp-login.php
Disallow /cgi-bin/
Disallow /index.php
Disallow /xmlrpc.php
Disallow /*/comment-page-*
Disallow /*?replytocom=*
Disallow /*?variant=*
Disallow /*/trackback/
Disallow /*/feed/
Disallow /*wpmp_switcher%3D*
Disallow /?p=*
Disallow /page/
Disallow /*/page/
Disallow /wp-content/plugins/wp-postviews-plus/
Disallow /wp-content/plugins/down-as-pdf/cache/
Disallow *.html/$
Disallow *000$
Disallow *variant%3Dzh-tw$
Disallow /*?__shortid__=*
Disallow /feed/
Disallow */feed/
Disallow */trackback/
Disallow /download/news.php
Disallow /af/
Disallow /sq/
Disallow /am/
Disallow /ar/
Disallow /hy/
Disallow /az/
Disallow /eu/
Disallow /be/
Disallow /bn/
Disallow /bs/
Disallow /bg/
Disallow /ca/
Disallow /ceb/
Disallow /ny/
Disallow /co/
Disallow /hr/
Disallow /cs/
Disallow /da/
Disallow /nl/
Disallow /en/
Disallow /eo/
Disallow /et/
Disallow /tl/
Disallow /fi/
Disallow /fr/
Disallow /fy/
Disallow /gl/
Disallow /ka/
Disallow /de/
Disallow /el/
Disallow /gu/
Disallow /ht/
Disallow /ha/
Disallow /haw/
Disallow /iw/
Disallow /hi/
Disallow /hmn/
Disallow /hu/
Disallow /is/
Disallow /ig/
Disallow /id/
Disallow /ga/
Disallow /it/
Disallow /ja/
Disallow /jw/
Disallow /kn/
Disallow /kk/
Disallow /km/
Disallow /ko/
Disallow /ku/
Disallow /ky/
Disallow /lo/
Disallow /la/
Disallow /lv/
Disallow /lt/
Disallow /lb/
Disallow /mk/
Disallow /mg/
Disallow /ms/
Disallow /ml/
Disallow /mt/
Disallow /mi/
Disallow /mr/
Disallow /mn/
Disallow /my/
Disallow /ne/
Disallow /no/
Disallow /ps/
Disallow /fa/
Disallow /pl/
Disallow /pt/
Disallow /pa/
Disallow /ro/
Disallow /ru/
Disallow /sm/
Disallow /gd/
Disallow /sr/
Disallow /st/
Disallow /sn/
Disallow /sd/
Disallow /si/
Disallow /sk/
Disallow /sl/
Disallow /so/
Disallow /es/
Disallow /su/
Disallow /sw/
Disallow /sv/
Disallow /tg/
Disallow /ta/
Disallow /te/
Disallow /th/
Disallow /tr/
Disallow /uk/
Disallow /ur/
Disallow /uz/
Disallow /vi/
Disallow /cy/
Disallow /xh/
Disallow /yi/
Disallow /yo/
Disallow /zu/

Other Records

Field Value
crawl-delay 10

yeti

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

wsearch

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

docomo

Rule Path
Disallow /

discobot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sogou

Rule Path
Disallow /

blexbot

Rule Path
Disallow /