huaglad.com
robots.txt
Robots Exclusion Standard data for huaglad.com
Resource Scan
Scan Details
Site Domain | huaglad.com |
Base Domain | huaglad.com |
Scan Status | Ok |
Last Scan | 2024-09-15T15:32:53+00:00 |
Next Scan | 2024-09-22T15:32:53+00:00 |
Last Scan
Scanned | 2024-09-15T15:32:53+00:00 |
URL | https://huaglad.com/robots.txt |
Redirect | https://www.huaglad.com/robots.txt |
Redirect Domain | www.huaglad.com |
Redirect Base | huaglad.com |
Domain IPs | 104.21.234.88, 104.21.234.89, 2606:4700:3038::6815:ea58, 2606:4700:3038::6815:ea59 |
Redirect IPs | 104.21.234.88, 104.21.234.89, 2606:4700:3038::6815:ea58, 2606:4700:3038::6815:ea59 |
Response IP | 104.21.234.88 |
Found | Yes |
Hash | 744210d2256966cca769bbe8aee073980e82b03f532242c2663ed2f7b3acee49 |
SimHash | 4072db2e6e67 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /wp-admin/ |
Disallow | /author/ |
Disallow | /wp-login.php |
Disallow | /cgi-bin/ |
Disallow | /index.php |
Disallow | /xmlrpc.php |
Disallow | /*/comment-page-* |
Disallow | /*?replytocom=* |
Disallow | /*?variant=* |
Disallow | /*/trackback/ |
Disallow | /*/feed/ |
Disallow | /*wpmp_switcher%3D* |
Disallow | /?p=* |
Disallow | /page/ |
Disallow | /*/page/ |
Disallow | /wp-content/plugins/wp-postviews-plus/ |
Disallow | /wp-content/plugins/down-as-pdf/cache/ |
Disallow | *.html/$ |
Disallow | *000$ |
Disallow | *variant%3Dzh-tw$ |
Disallow | /*?__shortid__=* |
Disallow | /feed/ |
Disallow | */feed/ |
Disallow | */trackback/ |
Disallow | /download/news.php |
Disallow | /af/ |
Disallow | /sq/ |
Disallow | /am/ |
Disallow | /ar/ |
Disallow | /hy/ |
Disallow | /az/ |
Disallow | /eu/ |
Disallow | /be/ |
Disallow | /bn/ |
Disallow | /bs/ |
Disallow | /bg/ |
Disallow | /ca/ |
Disallow | /ceb/ |
Disallow | /ny/ |
Disallow | /co/ |
Disallow | /hr/ |
Disallow | /cs/ |
Disallow | /da/ |
Disallow | /nl/ |
Disallow | /en/ |
Disallow | /eo/ |
Disallow | /et/ |
Disallow | /tl/ |
Disallow | /fi/ |
Disallow | /fr/ |
Disallow | /fy/ |
Disallow | /gl/ |
Disallow | /ka/ |
Disallow | /de/ |
Disallow | /el/ |
Disallow | /gu/ |
Disallow | /ht/ |
Disallow | /ha/ |
Disallow | /haw/ |
Disallow | /iw/ |
Disallow | /hi/ |
Disallow | /hmn/ |
Disallow | /hu/ |
Disallow | /is/ |
Disallow | /ig/ |
Disallow | /id/ |
Disallow | /ga/ |
Disallow | /it/ |
Disallow | /ja/ |
Disallow | /jw/ |
Disallow | /kn/ |
Disallow | /kk/ |
Disallow | /km/ |
Disallow | /ko/ |
Disallow | /ku/ |
Disallow | /ky/ |
Disallow | /lo/ |
Disallow | /la/ |
Disallow | /lv/ |
Disallow | /lt/ |
Disallow | /lb/ |
Disallow | /mk/ |
Disallow | /mg/ |
Disallow | /ms/ |
Disallow | /ml/ |
Disallow | /mt/ |
Disallow | /mi/ |
Disallow | /mr/ |
Disallow | /mn/ |
Disallow | /my/ |
Disallow | /ne/ |
Disallow | /no/ |
Disallow | /ps/ |
Disallow | /fa/ |
Disallow | /pl/ |
Disallow | /pt/ |
Disallow | /pa/ |
Disallow | /ro/ |
Disallow | /ru/ |
Disallow | /sm/ |
Disallow | /gd/ |
Disallow | /sr/ |
Disallow | /st/ |
Disallow | /sn/ |
Disallow | /sd/ |
Disallow | /si/ |
Disallow | /sk/ |
Disallow | /sl/ |
Disallow | /so/ |
Disallow | /es/ |
Disallow | /su/ |
Disallow | /sw/ |
Disallow | /sv/ |
Disallow | /tg/ |
Disallow | /ta/ |
Disallow | /te/ |
Disallow | /th/ |
Disallow | /tr/ |
Disallow | /uk/ |
Disallow | /ur/ |
Disallow | /uz/ |
Disallow | /vi/ |
Disallow | /cy/ |
Disallow | /xh/ |
Disallow | /yi/ |
Disallow | /yo/ |
Disallow | /zu/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |