dev.muslimbazaar.us
robots.txt
Robots Exclusion Standard data for dev.muslimbazaar.us
Resource Scan
Scan Details
| Site Domain | dev.muslimbazaar.us |
| Base Domain | muslimbazaar.us |
| Scan Status | Ok |
| Last Scan | 2025-10-28T10:55:44+00:00 |
| Next Scan | 2025-11-11T10:55:44+00:00 |
Last Scan
| Scanned | 2025-10-28T10:55:44+00:00 |
| URL | https://dev.muslimbazaar.us/robots.txt |
| Domain IPs | 72.167.33.14 |
| Response IP | 72.167.33.14 |
| Found | Yes |
| Hash | 55b1e05c5d304c4c8b082e4dbfdb1e30f8d3714bb63c3c49445cab8571d1cf7a |
| SimHash | 4d02cce0e2b3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /app/ |
| Disallow | /store_closed.html |
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |