tumblr.net
robots.txt
Robots Exclusion Standard data for tumblr.net
Resource Scan
Scan Details
| Site Domain | tumblr.net |
| Base Domain | tumblr.net |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't establish SSL connection. |
| Last Scan | 2024-09-14T05:31:53+00:00 |
| Next Scan | 2024-09-28T05:31:53+00:00 |
Last Successful Scan
| Scanned | 2024-08-30T05:31:17+00:00 |
| URL | https://tumblr.net/robots.txt |
| Redirect | https://www.tumblr.com/robots.txt |
| Redirect Domain | www.tumblr.com |
| Redirect Base | tumblr.com |
| Domain IPs | 74.114.154.18, 74.114.154.22 |
| Redirect IPs | 192.0.77.40 |
| Response IP | 192.0.77.40 |
| Found | Yes |
| Hash | 4072a8569d099446dc7334b17996688fbc5ad049cc35314a7d2d8f279fe9f089 |
| SimHash | 3abcd2038004 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /radar |
| Disallow | /audio_file |
| Disallow | /video_file |
| Disallow | /dashboard |
| Disallow | /x |
| Disallow | /svc/account |
| Disallow | /dashboard/notes |
| Disallow | /customize |
| Disallow | /impixu |
| Disallow | /liked |
| Disallow | /search/* |
| Disallow | /tagged/*%2B* |
| Disallow | /tagged/*?before=* |
| Disallow | /tagged/*?language=* |
| Disallow | /open |
| Disallow | /link_to |
| Disallow | /sticky-ad-iframe.html |
| Disallow | /privacy/consent |
slurp
| Rule | Path |
|---|---|
| Disallow | /radar |
| Disallow | /audio_file |
| Disallow | /video_file |
| Disallow | /dashboard |
| Disallow | /x |
| Disallow | /svc/account |
| Disallow | /dashboard/notes |
| Disallow | /customize |
| Disallow | /impixu |
| Disallow | /liked |
| Disallow | /search/* |
| Disallow | /tagged/*%2B* |
| Disallow | /tagged/*?before=* |
| Disallow | /tagged/*?language=* |
| Disallow | /open |
| Disallow | /link_to |
| Disallow | /sticky-ad-iframe.html |
| Disallow | /privacy/consent |
yandex
| Rule | Path |
|---|---|
| Disallow | /radar |
| Disallow | /audio_file |
| Disallow | /video_file |
| Disallow | /dashboard |
| Disallow | /x |
| Disallow | /svc/account |
| Disallow | /dashboard/notes |
| Disallow | /customize |
| Disallow | /impixu |
| Disallow | /liked |
| Disallow | /search/* |
| Disallow | /tagged/*%2B* |
| Disallow | /tagged/*?before=* |
| Disallow | /tagged/*?language=* |
| Disallow | /open |
| Disallow | /link_to |
| Disallow | /sticky-ad-iframe.html |
| Disallow | /privacy/consent |
msnbot
| Rule | Path |
|---|---|
| Disallow | /radar |
| Disallow | /audio_file |
| Disallow | /video_file |
| Disallow | /dashboard |
| Disallow | /x |
| Disallow | /svc/account |
| Disallow | /dashboard/notes |
| Disallow | /customize |
| Disallow | /impixu |
| Disallow | /liked |
| Disallow | /search/* |
| Disallow | /tagged/*%2B* |
| Disallow | /tagged/*?before=* |
| Disallow | /tagged/*?language=* |
| Disallow | /open |
| Disallow | /link_to |
| Disallow | /sticky-ad-iframe.html |
| Disallow | /privacy/consent |
*
| Rule | Path |
|---|---|
| Disallow | /radar |
| Disallow | /audio_file |
| Disallow | /video_file |
| Disallow | /dashboard |
| Disallow | /x |
| Disallow | /svc/account |
| Disallow | /dashboard/notes |
| Disallow | /customize |
| Disallow | /impixu |
| Disallow | /liked |
| Disallow | /search/* |
| Disallow | /tagged/*%2B* |
| Disallow | /tagged/*?before=* |
| Disallow | /tagged/*?language=* |
| Disallow | /open |
| Disallow | /link_to |
| Disallow | /sticky-ad-iframe.html |
| Disallow | /privacy/consent |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Comments