cdn-awdev.blogspot.com
robots.txt

Robots Exclusion Standard data for cdn-awdev.blogspot.com

Resource Scan

Scan Details

Site Domain cdn-awdev.blogspot.com
Base Domain cdn-awdev.blogspot.com
Scan Status Ok
Last Scan2026-03-28T07:31:17+00:00
Next Scan 2026-04-04T07:31:17+00:00

Last Scan

Scanned2026-03-28T07:31:17+00:00
URL https://cdn-awdev.blogspot.com/robots.txt
Domain IPs 2404:6800:4003:c11::84, 74.125.200.132
Response IP 74.125.130.132
Found Yes
Hash 73aa3770f0d2d3d499e7814621d1ab0cd4638a996f5f1de95e53f6d08bd411a4
SimHash 6f04d6f15513

Groups

mediapartners-google

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

googlebot

Rule Path
Disallow
Allow /

bing

Rule Path
Disallow
Allow /

yahoo

Rule Path
Disallow
Allow /

yandex

Rule Path
Disallow
Allow /

news

Rule Path
Disallow
Allow /

googlebot-mobile

Rule Path
Disallow
Allow /

googlebot-image

Rule Path
Disallow
Allow /

msnbot

Rule Path
Disallow
Allow /

slurp

Rule Path
Disallow
Allow /

*

Rule Path
Disallow /search
Allow /

googlebot-news

Rule Path
Allow /news/
Disallow /

Other Records

Field Value
sitemap cdn-awdev.blogspot.com/sitemap.xml
sitemap http://cdn-awdev.blogspot.com/sitemap.xml
sitemap https://cdn-awdev.blogspot.com/sitemap.xml
sitemap https://cdn-awdev.blogspot.com/rss.xml
sitemap https://www.cdn-awdev.blogspot.com/sitemap.xml
sitemap https://www.cdn-awdev.blogspot.com/sitemap.xml