douguo.com
robots.txt

Robots Exclusion Standard data for douguo.com

Resource Scan

Scan Details

Site Domain douguo.com
Base Domain douguo.com
Scan Status Ok
Last Scan2024-05-31T03:46:04+00:00
Next Scan 2024-06-07T03:46:04+00:00

Last Scan

Scanned2024-05-31T03:46:04+00:00
URL https://douguo.com/robots.txt
Redirect https://www.douguo.com/robots.txt
Redirect Domain www.douguo.com
Redirect Base douguo.com
Domain IPs 119.254.81.86
Redirect IPs 138.113.112.211, 163.171.210.28
Response IP 163.171.210.28
Found Yes
Hash 7196253f359b3adc9ff9f3ed9d5a68c4edc4874640a4712e6a603afd68c8d36f
SimHash 6b1650d5cf15

Groups

*

Rule Path
Disallow /app/
Disallow /zhcn/
Disallow /calory/
Disallow /slimstat/
Disallow /special/moon/
Disallow /memcache.php
Disallow /printcook/*
Disallow /ajax/getCommentsList*
Disallow /uajax/getMoreDiet*
Disallow /uajax/ajaxReQuestion*
Disallow /uajax/getMoreStoreDiet*
Disallow /ask/*

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.douguo.com/sitemap.xml