protvdigital.com
robots.txt
Robots Exclusion Standard data for protvdigital.com
Resource Scan
Scan Details
| Site Domain | protvdigital.com |
| Base Domain | protvdigital.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-08-11T11:32:03+00:00 |
| Next Scan | 2024-10-10T11:32:03+00:00 |
Last Successful Scan
| Scanned | 2024-06-13T11:07:20+00:00 |
| URL | https://protvdigital.com/robots.txt |
| Domain IPs | 200.58.111.14, 2800:6c0:2::4a |
| Response IP | 200.58.111.14 |
| Found | Yes |
| Hash | f5545f59a83e136323a6745beb2e335417402f68042991239bf88a198f1127b7 |
| SimHash | 6a7070fc4a64 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /cgi-bin/ |
| Disallow | /admin/ |
| Disallow | /*.sql$ |
| Disallow | /*? |
| Disallow | /?s= |
| Disallow | /search |
| Disallow | /trackback |
| Disallow | /*trackback |
| Disallow | /*trackback* |
| Disallow | /*/trackback |
Other Records
| Field | Value | Comment |
|---|---|---|
| crawl-delay | 60 | 60 segundos entre cada request |
googlebot
| Rule | Path |
|---|---|
| Allow | /*.js$ |
| Allow | /*.css$ |
| Disallow | /xmlrpc.php |
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /wp-content/plugins/ |
| Disallow | /wp-content/cache/ |
| Disallow | /wp-content/themes/ |
| Disallow | /*/xmlrpc.php |
| Disallow | /*/wp-admin/ |
| Disallow | /*/wp-includes/ |
| Disallow | /*/wp-content/plugins/ |
| Disallow | /*/wp-content/cache/ |
| Disallow | /*/wp-content/themes/ |
| Disallow | /administrator/ |
| Disallow | /bin/ |
| Disallow | /cache/ |
| Disallow | /cli/ |
| Disallow | /components/ |
| Disallow | /images/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /layouts/ |
| Disallow | /libraries/ |
| Disallow | /logs/ |
| Disallow | /media/ |
| Disallow | /modules/ |
| Disallow | /plugins/ |
| Disallow | /templates/ |
| Disallow | /tmp/ |
| Disallow | /*/administrator/ |
| Disallow | /*/bin/ |
| Disallow | /*/cache/ |
| Disallow | /*/cli/ |
| Disallow | /*/components/ |
| Disallow | /*/images/ |
| Disallow | /*/includes/ |
| Disallow | /*/installation/ |
| Disallow | /*/language/ |
| Disallow | /*/layouts/ |
| Disallow | /*/libraries/ |
| Disallow | /*/logs/ |
| Disallow | /*/media/ |
| Disallow | /*/modules/ |
| Disallow | /*/plugins/ |
| Disallow | /*/templates/ |
| Disallow | /*/tmp/ |
| Disallow | /caroline/web/ |
| Disallow | /caroline/module/ |
| Disallow | /caroline/tmp/ |
| Disallow | /caroline/platform/ |
| Disallow | /caroline/courses/ |
| Disallow | /caroline/claroline/ |
| Disallow | /drupal/includes/ |
| Disallow | /drupal/misc/ |
| Disallow | /drupal/modules/ |
| Disallow | /drupal/profiles/ |
| Disallow | /drupal/scripts/ |
| Disallow | /drupal/themes/ |
| Disallow | /drupal/CHANGELOG.txt/ |
| Disallow | /drupal/cron.php/ |
| Disallow | /drupal/INSTALL.mysql.txt/ |
| Disallow | /drupal/INSTALL.pgsql.txt/ |
| Disallow | /drupal/INSTALL.sqlite.txt/ |
| Disallow | /drupal/install.php/ |
| Disallow | /drupal/INSTALL.txt/ |
| Disallow | /drupal/LICENSE.txt/ |
| Disallow | /drupal/MAINTAINERS.txt/ |
| Disallow | /drupal/update.php/ |
| Disallow | /drupal/UPGRADE.txt/ |
| Disallow | /drupal/xmlrpc.php/ |
| Disallow | /drupal/admin/ |
| Disallow | /drupal/comment/reply/ |
| Disallow | /drupal/filter/tips/ |
| Disallow | /drupal/node/add/ |
| Disallow | /drupal/search/ |
| Disallow | /drupal/user/register/ |
| Disallow | /drupal/user/password/ |
| Disallow | /drupal/user/login/ |
| Disallow | /drupal/user/logout/ |
| Disallow | /drupal/?q=admin%2F |
| Disallow | /drupal/?q=comment%2Freply%2F |
| Disallow | /drupal/?q=filter%2Ftips%2F |
| Disallow | /drupal/?q=node%2Fadd%2F |
| Disallow | /drupal/?q=search%2F |
| Disallow | /drupal/?q=user%2Fpassword%2F |
| Disallow | /drupal/?q=user%2Fregister%2F |
| Disallow | /drupal/?q=user%2Flogin%2F |
Warnings
- `request-rate` is not a known field.
- `visit-time` is not a known field.
Comments