opednews.com
robots.txt
Robots Exclusion Standard data for opednews.com
Resource Scan
Scan Details
| Site Domain | opednews.com |
| Base Domain | opednews.com |
| Scan Status | Ok |
| Last Scan | 2024-11-11T20:04:47+00:00 |
| Next Scan | 2024-11-18T20:04:47+00:00 |
Last Scan
| Scanned | 2024-11-11T20:04:47+00:00 |
| URL | https://opednews.com/robots.txt |
| Redirect | https://www.opednews.com/robots.txt |
| Redirect Domain | www.opednews.com |
| Redirect Base | opednews.com |
| Domain IPs | 162.253.128.66 |
| Redirect IPs | 162.253.128.66 |
| Response IP | 162.253.128.66 |
| Found | Yes |
| Hash | d7053e1cbf964827a677c6a744cdbb823019565a21a5e6838bd39d2077600f97 |
| SimHash | 7401f4126691 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /populum/js/ |
| Disallow | /populum/editors/ |
| Disallow | /img/ |
| Disallow | /imgs/ |
| Disallow | /maxwrite/ |
| Disallow | /populum/cachecomments/ |
| Disallow | /populum/cache/ |
| Disallow | /populum/caches/ |
| Disallow | /populum/cachespl/ |
| Disallow | /populum/cachetwitter/ |
| Disallow | /populum/volunteer.php |
| Disallow | /populum/ajax-popularity.php |
| Disallow | /populum/showtags.php |
| Disallow | /populum/showlevels.php |
| Disallow | /populum/pagesimple.php |
| Disallow | /populum/messagesend.php |
| Disallow | /populum/twsimple.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.opednews.com/sitemap.xml |