cloud.google.com
robots.txt

Robots Exclusion Standard data for cloud.google.com

Resource Scan

Scan Details

Site Domain cloud.google.com
Base Domain google.com
Scan Status Ok
Last Scan2024-05-01T13:19:11+00:00
Next Scan 2024-05-31T13:19:11+00:00

Last Scan

Scanned2024-05-01T13:19:11+00:00
URL https://cloud.google.com/robots.txt
Domain IPs 142.251.12.100, 142.251.12.101, 142.251.12.102, 142.251.12.113, 142.251.12.138, 142.251.12.139, 2404:6800:4003:c03::65, 2404:6800:4003:c03::66, 2404:6800:4003:c03::71, 2404:6800:4003:c03::8b
Response IP 74.125.68.139
Found Yes
Hash 775ad62c1a36b5f0ad92a2a332ca80ffb2e518d986bc4199a9c12bf554dfe2b0
SimHash c300e420c3db

Groups

*

Rule Path
Disallow /console?*getstarted=*
Disallow /landing/
Disallow /walkthroughs/
Disallow /terms/looker/legal/sccs/
Disallow /terms/looker/legal/customers/mobile-governing-agreement
Disallow /terms/looker/legal/customers/aup
Disallow /terms/looker/dpst
Disallow /terms/looker/legal/eu-modelclauses-nov16
Disallow /terms/looker/legal/suppliers/supplier-code-of-conduct
Disallow /terms/looker/legal/suppliers/partner-assignment-faq
Disallow /terms/looker/legal/rapid-deployment-terms
Disallow /terms/looker/legal/partner-success-services-agreement
Disallow /terms/looker/additional-product-terms
Disallow /log?*
Disallow /partners/resources/gartner-dbms-mq-report
Disallow /partners/resources/forrester-dsp-wave-report

google-devrel

Rule Path
Allow /

Other Records

Field Value
sitemap https://cloud.google.com/sitemap.xml
sitemap https://cloud.google.com/sitemapindex.xml
sitemap https://cloud.google.com/cgc/sitemapindex.xml
sitemap https://cloud.google.com/transform/sitemapsummarylanding/cloudblog
sitemap https://cloud.google.com/transform/sitemapsummary/cloudblog
sitemap https://cloud.google.com/transform/sitemapsummary/transform