shayaribooks.com
robots.txt
Robots Exclusion Standard data for shayaribooks.com
Resource Scan
Scan Details
| Site Domain | shayaribooks.com |
| Base Domain | shayaribooks.com |
| Scan Status | Ok |
| Last Scan | 2025-12-12T21:18:13+00:00 |
| Next Scan | 2025-12-19T21:18:13+00:00 |
Last Scan
| Scanned | 2025-12-12T21:18:13+00:00 |
| URL | https://shayaribooks.com/robots.txt |
| Redirect | https://www.shayaribooks.com/robots.txt |
| Redirect Domain | www.shayaribooks.com |
| Redirect Base | shayaribooks.com |
| Domain IPs | 139.59.9.206 |
| Redirect IPs | 139.59.9.206 |
| Response IP | 139.59.9.206 |
| Found | Yes |
| Hash | 17239820d2d3f51943eff833864407bb12b3b22719b709fae98ca93d677ccd2c |
| SimHash | 03185c288791 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /404/ |
| Disallow | /webdraw/ |
| Disallow | /facebook/ |
| Disallow | /cgi-bin/ |
| Disallow | /fck_files/ |
| Disallow | /fckeditor/ |
| Disallow | /herbalife-popup/ |
| Disallow | /images/ |
| Disallow | /includes/ |
| Disallow | /itf_ajax/ |
| Disallow | /itf_public/ |
| Disallow | /itfbox/ |
| Disallow | /side-menu/ |
| Disallow | /itfbox/ |
| Disallow | /itfbox/ |
| Disallow | /index.html/ |
| Disallow | /verify-email.php/ |
| Disallow | /webpageload.php/ |
| Disallow | /pageload.php/ |
| Disallow | /itfconfig.php/ |
| Disallow | /windex.php/ |
| Disallow | /fb-callback.php/ |
| Disallow | /cms/p/disclaimer.html/ |
| Disallow | /cms/p/terms-conditions.html |
| Disallow | /cms/p/privacy-policy.html |
*
| Rule | Path |
|---|---|
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.shayaribooks.com/sitemap.xml |
| sitemap | https://www.shayaribooks.com/sitemap-index.xml |
Comments