robotics.news
robots.txt
Robots Exclusion Standard data for robotics.news
Resource Scan
Scan Details
| Site Domain | robotics.news |
| Base Domain | robotics.news |
| Scan Status | Ok |
| Last Scan | 2026-03-06T09:08:13+00:00 |
| Next Scan | 2026-04-05T09:08:13+00:00 |
Last Scan
| Scanned | 2026-03-06T09:08:13+00:00 |
| URL | https://robotics.news/robots.txt |
| Domain IPs | 104.21.68.8, 172.67.184.31, 2606:4700:3031::6815:4408, 2606:4700:3036::ac43:b81f |
| Response IP | 104.21.68.8 |
| Found | Yes |
| Hash | e319506ae5620173461412a270bb1522e632500bff29485018c6e41e9bf2e057 |
| SimHash | 7c1451ca4a98 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/mu-plugins |
| Disallow | /wp-content/updraft |
| Disallow | /wp-content/upgrade |
| Disallow | /trackback/ |
| Disallow | /feed/ |
| Disallow | /readme.html |
| Disallow | /phpinfo.php |
| Disallow | /wp-activate.php |
| Disallow | /wp-config.php |
| Disallow | /wp-config.php.bak |
| Disallow | /wp-cron.php |
| Disallow | /wp-links-opml.php |
| Disallow | /wp-load.php |
| Disallow | /wp-login.php |
| Disallow | /wp-mail.php |
| Disallow | /wp-settings.php |
| Disallow | /wp-signup.php |
| Disallow | /wp-trackback.php |
| Disallow | /xmlrpc.php |
Comments