bigdev.ir
robots.txt
Robots Exclusion Standard data for bigdev.ir
Resource Scan
Scan Details
| Site Domain | bigdev.ir |
| Base Domain | bigdev.ir |
| Scan Status | Ok |
| Last Scan | 2025-10-07T04:31:11+00:00 |
| Next Scan | 2025-11-06T04:31:11+00:00 |
Last Scan
| Scanned | 2025-10-07T04:31:11+00:00 |
| URL | https://bigdev.ir/robots.txt |
| Domain IPs | 104.21.21.202, 172.67.200.25, 2606:4700:3030::6815:15ca, 2606:4700:3036::ac43:c819 |
| Response IP | 104.21.21.202 |
| Found | Yes |
| Hash | 01c41795f1fd3fa2abfc0065534852f80b844d087253e52dbc335882c0ffca9f |
| SimHash | ac49dd701131 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /vote |
| Disallow | /User/ |
| Disallow | /user/ |
| Disallow | /Polls/ |
| Disallow | /rating/ |
| Disallow | /Forum/User/* |
| Disallow | /Forum/Add/* |
| Disallow | /Forum/Tanks/* |
| Disallow | /Forum/Thanks/* |
| Disallow | /Forum/New_Post* |
| Disallow | /Forum/New/Answer/* |
| Disallow | /Quote/* |
| Disallow | /include/captcha/ |
| Disallow | /*?backurl= |
| Disallow | /*?ajax= |
| Disallow | /Forum/Catgory/*/Quote/* |
| Disallow | /Forum/Catgory/*/Replay/* |
| Disallow | /Forum/Register/* |
| Disallow | /Register/* |
| Disallow | /archive |
Other Records
| Field | Value |
|---|---|
| sitemap | https://bigdev.ir/sitemap.xml |
| sitemap | https://bigdev.ir/sitemap/post.xml |