qidiantu.com
robots.txt

Robots Exclusion Standard data for qidiantu.com

Resource Scan

Scan Details

Site Domain qidiantu.com
Base Domain qidiantu.com
Scan Status Ok
Last Scan2025-12-23T00:10:02+00:00
Next Scan 2025-12-30T00:10:02+00:00

Last Scan

Scanned2025-12-23T00:10:02+00:00
URL https://qidiantu.com/robots.txt
Redirect https://www.qidiantu.com/robots.txt
Redirect Domain www.qidiantu.com
Redirect Base qidiantu.com
Domain IPs 43.174.246.25, 43.174.247.25
Redirect IPs 43.174.246.25, 43.174.247.25
Response IP 43.174.247.25
Found Yes
Hash a2dfcd86d02b0891b86664b8b77765a500acc5ea89286a2aa7de06cabd318b3c
SimHash 4a7ecc766e68

Groups

dotbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

*

Rule Path
Disallow /info/*/d$
Disallow /bang/10*
Disallow /bang/11*
Disallow /bang/12*
Disallow /bang/13*
Disallow /bang/14*
Disallow /bang/15*
Disallow /bang/16*
Disallow /bang/17*
Disallow /bang/18*
Disallow /bang/19*
Disallow /bang/2*
Disallow /bang/3*
Disallow /bang/4*
Disallow /bang/5*
Disallow /bang/6*
Disallow /bang/7*
Disallow /bang/8*
Disallow /bang/9*

Other Records

Field Value
crawl-delay 10