doku303qiu.com
robots.txt

Robots Exclusion Standard data for doku303qiu.com

Resource Scan

Scan Details

Site Domain doku303qiu.com
Base Domain doku303qiu.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-04-13T02:56:25+00:00
Next Scan 2025-05-13T02:56:25+00:00

Last Successful Scan

Scanned2025-02-20T02:06:43+00:00
URL https://doku303qiu.com/robots.txt
Redirect https://doku303klik.com/robots.txt
Redirect Domain doku303klik.com
Redirect Base doku303klik.com
Domain IPs 104.21.72.132, 172.67.185.32, 2606:4700:3030::6815:4884, 2606:4700:3031::ac43:b920
Redirect IPs 104.21.42.150, 172.67.163.10, 2606:4700:3031::ac43:a30a, 2606:4700:3036::6815:2a96
Response IP 172.67.163.10
Found Yes
Hash a0dfaabcc0b6da6d42deec276222727922d0464b42eb68d2118645ef0da1c365
SimHash 605155124783

Groups

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

msnbot

Rule Path
Allow /

slurp

Rule Path
Allow /

teoma

Rule Path
Allow /

gigabot

Rule Path
Allow /

robozilla

Rule Path
Allow /

nutch

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

baiduspider

Rule Path
Allow /

naverbot

Rule Path
Allow /

yeti

Rule Path
Allow /

yahoo-mmcrawler

Rule Path
Allow /

psbot

Rule Path
Allow /

yahoo-blogs/v3.9

Rule Path
Allow /

*

Rule Path
Allow /
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://doku303klik.com/sitemap.xml