amarkobita4u.com
robots.txt
Robots Exclusion Standard data for amarkobita4u.com
Resource Scan
Scan Details
| Site Domain | amarkobita4u.com |
| Base Domain | amarkobita4u.com |
| Scan Status | Ok |
| Last Scan | 2025-04-13T07:15:24+00:00 |
| Next Scan | 2025-04-20T07:15:24+00:00 |
Last Scan
| Scanned | 2025-04-13T07:15:24+00:00 |
| URL | https://amarkobita4u.com/robots.txt |
| Redirect | https://www.amarkobita4u.com/robots.txt |
| Redirect Domain | www.amarkobita4u.com |
| Redirect Base | amarkobita4u.com |
| Domain IPs | 104.21.7.160, 172.67.136.242, 2606:4700:3030::6815:7a0, 2606:4700:3037::ac43:88f2 |
| Redirect IPs | 104.21.7.160, 172.67.136.242, 2606:4700:3030::6815:7a0, 2606:4700:3037::ac43:88f2 |
| Response IP | 172.67.136.242 |
| Found | Yes |
| Hash | ebd16a98a730d5a62f829c333d0ce57c21a59b9c1488a3f0d32204d31b148056 |
| SimHash | 3830e7b0c7a3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Allow | / |
| Disallow |
*
| Product | Comment |
|---|---|
| * | to select all crawling bots and search engines |
| Rule | Path | Comment |
|---|---|---|
| Disallow | /search* | to block all user generated query item within the website. |
| Disallow | /20* | this line will disallow archieve section of Blogger. |
| Disallow | /feeds* | this line will disallow feeds. Read instruction below |
| Allow | /*.html | allow all post and pages of the blog |
Other Records
| Field | Value |
|---|---|
| sitemap | User-agent: Googlebot |
| sitemap | https://www.amarkobita4u.com/sitemap.xml |
| sitemap | https://www.amarkobita4u.com/sitemap-pages.xml |
| sitemap | https://www.amarkobita4u.com/atom.xml?redirect=false&start-index=501&max-results=500 |
Comments