adituek.net
robots.txt

Robots Exclusion Standard data for adituek.net

Resource Scan

Scan Details

Site Domain adituek.net
Base Domain adituek.net
Scan Status Ok
Last Scan2024-09-26T21:41:29+00:00
Next Scan 2024-10-03T21:41:29+00:00

Last Scan

Scanned2024-09-26T21:41:29+00:00
URL https://adituek.net/robots.txt
Redirect https://www.adituek.net/robots.txt
Redirect Domain www.adituek.net
Redirect Base adituek.net
Domain IPs 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Redirect IPs 2404:6800:4003:c11::79, 64.233.170.121
Response IP 64.233.170.121
Found Yes
Hash df57b48ab1bdcd0822a6fef9e8bc85688a966a9d08879d1178596ee8f492ed8c
SimHash 4b445b944411

Groups

mediapartners

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot

Rule Path
Allow /

slurp

Rule Path
Allow /

bingbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

baiduspider-image

Rule Path
Allow /

youdaobot

Rule Path
Allow /

sogou web spider

Rule Path
Allow /

*

Rule Path
Disallow /search?updated-min=
Disallow /search?updated-max=
Disallow /search/label/*?updated-min=
Disallow /search/label/*?updated-max=
Allow /

Other Records

Field Value
sitemap http://www.adian_2014.blogspot.com/feeds/posts/default?orderby=updated