omonaijanews.blogspot.com
robots.txt
Robots Exclusion Standard data for omonaijanews.blogspot.com
Resource Scan
Scan Details
| Site Domain | omonaijanews.blogspot.com |
| Base Domain | omonaijanews.blogspot.com |
| Scan Status | Ok |
| Last Scan | 2024-11-13T08:27:24+00:00 |
| Next Scan | 2024-11-20T08:27:24+00:00 |
Last Scan
| Scanned | 2024-11-13T08:27:24+00:00 |
| URL | https://omonaijanews.blogspot.com/robots.txt |
| Redirect | https://www.omonaijanews.com.ng/robots.txt |
| Redirect Domain | www.omonaijanews.com.ng |
| Redirect Base | omonaijanews.com.ng |
| Domain IPs | 142.251.12.132, 2404:6800:4003:c05::84 |
| Redirect IPs | 2404:6800:4003:c1a::79, 64.233.170.121 |
| Response IP | 64.233.170.121 |
| Found | Yes |
| Hash | 1d090d086dc5b62ef24b58de5e9088f468b5f478a5283760ed9ce351edfcb8ac |
| SimHash | 3030e511c597 |
Groups
*
| Product | Comment |
|---|---|
| * | to select all crawling bots and search engines |
| Rule | Path | Comment |
|---|---|---|
| Disallow | /search* | to block all user generated query item within the website. |
| Disallow | /20* | this line will disallow archieve section of Blogger. |
| Disallow | /feeds* | this line will disallow feeds. Read instruction below |
| Allow | /*.html | allow all post and pages of the blog |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.omonaijanews.com.ng/sitemap.xml |