90minutos.co
robots.txt
Robots Exclusion Standard data for 90minutos.co
Resource Scan
Scan Details
| Site Domain | 90minutos.co |
| Base Domain | 90minutos.co |
| Scan Status | Ok |
| Last Scan | 2024-11-11T06:02:04+00:00 |
| Next Scan | 2024-11-18T06:02:04+00:00 |
Last Scan
| Scanned | 2024-11-11T06:02:04+00:00 |
| URL | https://90minutos.co/robots.txt |
| Domain IPs | 104.24.0.39, 104.24.1.39, 172.67.82.71, 2606:4700:20::6818:127, 2606:4700:20::6818:27, 2606:4700:20::ac43:5247 |
| Response IP | 172.67.82.71 |
| Found | Yes |
| Hash | 65f7c27b62850f3d70dc0293d0067c26c73b2b0c123326691c370d6feba9c4a2 |
| SimHash | a1195090ca75 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /*.css$ |
| Allow | /*.js$ |
| Allow | /wp-content/uploads/* |
| Allow | /wp-content/*.js |
| Allow | /wp-content/*.css |
| Allow | /wp-includes/*.js |
| Allow | /wp-includes/*.css |
| Disallow | /xmlrpc.php |
| Disallow | /comments/feed/ |
| Disallow | /trackback |
| Disallow | /*trackback |
| Disallow | /*/trackback |
| Disallow | /comments/ |
| Disallow | /xmlrpc.php |
| Disallow | /?attachment_id* |
| Disallow | /cgi-bin |
| Disallow | /wp-admin/ |
| Disallow | /error_log.txt |
| Disallow | /error_log |
| Disallow | /cron.php |
| Disallow | /cron.sh |
| Disallow | /install.php |
| Disallow | /LICENSE.html |
| Disallow | /LICENSE.txt |
| Disallow | /LICENSE_AFL.txt |
| Disallow | /STATUS.txt |
| Disallow | /error_log.txt |
| Disallow | /wp-includes/ |
| Disallow | /*/attachment/ |
| Disallow | /tag/*/page/ |
| Disallow | /tag/*/feed/ |
| Disallow | /page/ |
| Disallow | /*/page/ |
| Disallow | /?s= |
| Disallow | /search |
| Disallow | /digitalteam |
| Disallow | *.pdf$ |
| Disallow | /search |
| Disallow | /*/*/*/feed/$ |
| Disallow | /*/*/*/feed/rss2/$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://90minutos.co/sitemap_index.xml |
| sitemap | https://90minutos.co/category-sitemap.xml |
| sitemap | https://90minutos.co/video-sitemap.xml |
| sitemap | https://90minutos.co/news-sitemap.xml |
Comments