omonaijanews.com.ng
robots.txt
Robots Exclusion Standard data for omonaijanews.com.ng
Resource Scan
Scan Details
| Site Domain | omonaijanews.com.ng |
| Base Domain | omonaijanews.com.ng |
| Scan Status | Ok |
| Last Scan | 2024-11-13T09:44:43+00:00 |
| Next Scan | 2024-11-20T09:44:43+00:00 |
Last Scan
| Scanned | 2024-11-13T09:44:43+00:00 |
| URL | https://omonaijanews.com.ng/robots.txt |
| Redirect | https://www.omonaijanews.com.ng/robots.txt |
| Redirect Domain | www.omonaijanews.com.ng |
| Redirect Base | omonaijanews.com.ng |
| Domain IPs | 216.239.32.21 |
| Redirect IPs | 142.251.10.121, 2404:6800:4003:c1c::79 |
| Response IP | 172.253.118.121 |
| Found | Yes |
| Hash | 1d090d086dc5b62ef24b58de5e9088f468b5f478a5283760ed9ce351edfcb8ac |
| SimHash | 3030e511c597 |
Groups
*
| Product | Comment |
|---|---|
| * | to select all crawling bots and search engines |
| Rule | Path | Comment |
|---|---|---|
| Disallow | /search* | to block all user generated query item within the website. |
| Disallow | /20* | this line will disallow archieve section of Blogger. |
| Disallow | /feeds* | this line will disallow feeds. Read instruction below |
| Allow | /*.html | allow all post and pages of the blog |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.omonaijanews.com.ng/sitemap.xml |