skeptic.com
robots.txt
Robots Exclusion Standard data for skeptic.com
Resource Scan
Scan Details
| Site Domain | skeptic.com |
| Base Domain | skeptic.com |
| Scan Status | Ok |
| Last Scan | 2024-05-23T10:46:51+00:00 |
| Next Scan | 2024-06-22T10:46:51+00:00 |
Last Scan
| Scanned | 2024-05-23T10:46:51+00:00 |
| URL | https://skeptic.com/robots.txt |
| Redirect | https://www.skeptic.com/robots.txt |
| Redirect Domain | www.skeptic.com |
| Redirect Base | skeptic.com |
| Domain IPs | 104.23.128.76, 104.23.129.76, 2606:4700:11::6817:804c, 2606:4700:11::6817:814c |
| Redirect IPs | 104.23.128.76, 104.23.129.76, 2606:4700:11::6817:804c, 2606:4700:11::6817:814c |
| Response IP | 104.23.128.76 |
| Found | Yes |
| Hash | d543202f9958d649dbe87cbfddfd7da4509d0bac9eefa360447be65ac1d6e37b |
| SimHash | e00409d0f3b6 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /wordpress/wp-admin |
| Disallow | /wordpress/wp-includes |
| Disallow | /wordpress/wp-content/plugins |
| Disallow | /wordpress/wp-content/cache |
| Disallow | /wordpress/wp-content/themes |
| Disallow | /wordpress/trackback |
| Disallow | /wordpress*/trackback |
| Disallow | /wordpress*/comments |
| Disallow | /wordpress/*?* |
| Disallow | /wordpress/*? |
Comments