shayarsmehfil.blogspot.com
robots.txt
Robots Exclusion Standard data for shayarsmehfil.blogspot.com
Resource Scan
Scan Details
| Site Domain | shayarsmehfil.blogspot.com |
| Base Domain | shayarsmehfil.blogspot.com |
| Scan Status | Ok |
| Last Scan | 2025-08-28T08:03:03+00:00 |
| Next Scan | 2025-09-04T08:03:03+00:00 |
Last Scan
| Scanned | 2025-08-28T08:03:03+00:00 |
| URL | https://shayarsmehfil.blogspot.com/robots.txt |
| Domain IPs | 2404:6800:4003:c06::84, 64.233.170.132 |
| Response IP | 142.250.4.132 |
| Found | Yes |
| Hash | 1aee87539933027dd0a0d72bf5712a55ef012e202276cbbe39510a3b6b8192e1 |
| SimHash | c504d69127b9 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?m=1 |
| Disallow | /*?*&m=1 |
| Disallow | /comments |
| Disallow | /category/ |
| Disallow | /tag/ |
| Disallow | /*?zx= |
| Disallow | /*?*&zx= |
| Disallow | /search |
| Allow | /search$ |
| Allow | /search/label/ |
| Allow | /$ |
| Allow | /*.html |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://shayarsmehfil.blogspot.com/sitemap.xml |
| sitemap | https://shayarsmehfil.blogspot.com/sitemap-pages.xml |
| sitemap | https://shayarsmehfil.blogspot.com/atom.xml?redirect=false&start-index=1&max-results=500 |
Comments