newsify.co
robots.txt
Robots Exclusion Standard data for newsify.co
Resource Scan
Scan Details
| Site Domain | newsify.co |
| Base Domain | newsify.co |
| Scan Status | Ok |
| Last Scan | 2024-11-15T13:20:59+00:00 |
| Next Scan | 2024-11-22T13:20:59+00:00 |
Last Scan
| Scanned | 2024-11-15T13:20:59+00:00 |
| URL | https://newsify.co/robots.txt |
| Domain IPs | 162.251.61.82 |
| Response IP | 162.251.61.82 |
| Found | Yes |
| Hash | 33e4e48f28a5d23197b2987bf5a7bf86aa80a6ec37043eb1661ee87ab9bf2da9 |
| SimHash | 0570c100cd53 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /reader |
| Disallow | /rss_feeds |
| Disallow | /classifier |
| Disallow | /analyzer |
| Disallow | /profile |
| Disallow | /import |
| Disallow | /media |