set.ir
robots.txt
Robots Exclusion Standard data for set.ir
Resource Scan
Scan Details
| Site Domain | set.ir |
| Base Domain | set.ir |
| Scan Status | Ok |
| Last Scan | 2025-12-30T11:16:10+00:00 |
| Next Scan | 2026-01-29T11:16:10+00:00 |
Last Scan
| Scanned | 2025-12-30T11:16:10+00:00 |
| URL | https://set.ir/robots.txt |
| Domain IPs | 79.143.86.168 |
| Response IP | 79.143.86.168 |
| Found | Yes |
| Hash | 0bcfd62cc95084a34f2b0296d2e860fa5d298fbe3cdf7c2389c4fbe5c90e6c70 |
| SimHash | 69257d5049d3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /dashboard |
| Disallow | /basket |
| Disallow | /api |
| Disallow | /filter |
| Disallow | /content |
| Disallow | /searchkeyword |
| Disallow | /search |
| Disallow | /course |
| Disallow | /*.php$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://set.ir/sitemap.xml |