dropbox.com
robots.txt

Robots Exclusion Standard data for dropbox.com

Resource Scan

Scan Details

Site Domain dropbox.com
Base Domain dropbox.com
Scan Status Ok
Last Scan2025-03-10T18:16:28+00:00
Next Scan 2025-03-24T18:16:28+00:00

Last Scan

Scanned2025-03-10T18:16:28+00:00
URL https://dropbox.com/robots.txt
Redirect https://www.dropbox.com/robots.txt
Redirect Domain www.dropbox.com
Redirect Base dropbox.com
Domain IPs 162.125.248.18, 2620:100:6040:18::a27d:f812
Redirect IPs 162.125.81.18, 2620:100:6031:18::a27d:5112
Response IP 162.125.85.18
Found Yes
Hash e9a9d442a0a9dfdec736c3dbcd660ccb6ec0d22ab23521134f74daa2606d0fc9
SimHash d02153ffc175

Groups

twitterbot

Rule Path
Disallow

facebookexternalhit

Rule Path
Allow /s/
Allow /sh/
Allow /scl/

*

Rule Path
Allow /static/css/
Allow /static/images/
Allow /static/js/
Disallow /static/
Disallow /password_expired
Disallow /help/sl
Disallow /help/vodafone
Disallow /home*
Disallow /package_files_uploaded_via_chrome
Disallow /photos/app_store_link/
Disallow /recover*
Disallow /sharing/*
Disallow /sharing/folders*
Disallow /sharing/files*
Disallow /requests*
Disallow /account*
Disallow /referrals*
Disallow /downgrade*
Disallow /developers-v1
Disallow /developers/downloads/sdks/
Disallow /developers/whats_new
Disallow /reengageoptout/*
Disallow /preview/
Disallow /s/
Disallow /sh/
Disallow /scl/

Other Records

Field Value
sitemap https://www.dropbox.com/sitemapindex.xml