cafebazaar.ir
robots.txt
Robots Exclusion Standard data for cafebazaar.ir
Resource Scan
Scan Details
| Site Domain | cafebazaar.ir |
| Base Domain | cafebazaar.ir |
| Scan Status | Ok |
| Last Scan | 2024-11-05T02:27:50+00:00 |
| Next Scan | 2024-11-19T02:27:50+00:00 |
Last Scan
| Scanned | 2024-11-05T02:27:50+00:00 |
| URL | https://cafebazaar.ir/robots.txt |
| Domain IPs | 185.166.104.3, 185.166.104.4 |
| Response IP | 185.166.104.4 |
| Found | Yes |
| Hash | da9d64273891aebd27528ef85157e371c32d823b1fff36e5909c1ca01d888cb7 |
| SimHash | 4811f2047752 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /download/* |
| Disallow | /json/* |
| Disallow | /api/* |
| Disallow | /s?q=* |
| Disallow | /login |
| Disallow | /video* |
| Disallow | /signin?* |
| Allow | /signin?l=en |