Log In Sign Up

drive.com.au
robots.txt

Robots Exclusion Standard data for drive.com.au

Resource Scan

Scan Details

Site Domain drive.com.au
Base Domain drive.com.au
Scan Status Ok
Last Scan2024-10-31T04:53:51+00:00
Next Scan 2024-11-07T04:53:51+00:00

Last Scan

Scanned2024-10-31T04:53:51+00:00
URL https://drive.com.au/robots.txt
Redirect https://www.drive.com.au/robots.txt
Redirect Domain www.drive.com.au
Redirect Base drive.com.au
Domain IPs 104.19.150.51, 104.19.151.51, 2606:4700::6813:9633, 2606:4700::6813:9733
Redirect IPs 104.19.150.51, 104.19.151.51, 2606:4700::6813:9633, 2606:4700::6813:9733
Response IP 104.19.151.51
Found Yes
Hash 0b2a1f43d18e862c80aa45358a37cfc94545ac44ad62509909e8834bd68f067a
SimHash 6259535bcb23

Groups

*

Rule Path
Disallow /cdn-cgi/rum
Disallow /vehicles/
Disallow /affiliate/

anthropic-ai

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

google-cloudvertexbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

flamingo_searchengine

Rule Path
Disallow /

nutch

Rule Path
Disallow /

admantx

Rule Path
Disallow /

grapeshot

Rule Path
Allow /

carsnipbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.drive.com.au/sitemap_index.xml
Back to top

Comments

  • Drive expressly prohibits the use of any Drive
  • content or data, including associated metadata, for any machine
  • learning and/or artificial intelligence including for the purposes
  • of training or development of AI technology, tools and machine
  • learning language models.
  • view our terms of use - https://www.drive.com.au/about-drive/terms-conditions/
Back to top