divar.ir
robots.txt
Robots Exclusion Standard data for divar.ir
Resource Scan
Scan Details
| Site Domain | divar.ir |
| Base Domain | divar.ir |
| Scan Status | Ok |
| Last Scan | 2024-10-26T11:47:40+00:00 |
| Next Scan | 2024-11-09T11:47:40+00:00 |
Last Scan
| Scanned | 2024-10-26T11:47:40+00:00 |
| URL | https://divar.ir/robots.txt |
| Domain IPs | 185.166.104.3, 185.166.104.4 |
| Response IP | 185.166.104.4 |
| Found | Yes |
| Hash | 799db46f263c0163a483e6e6f06c6c52c3bedf1a46dfa799aa537bfefad742a7 |
| SimHash | 88488c04ef52 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /my-divar/* |
| Disallow | /manage/* |
| Disallow | /new |
| Disallow | /s/*/*?*q=* |