mostajaab.com
robots.txt
Robots Exclusion Standard data for mostajaab.com
Resource Scan
Scan Details
| Site Domain | mostajaab.com |
| Base Domain | mostajaab.com |
| Scan Status | Ok |
| Last Scan | 2024-09-18T17:18:09+00:00 |
| Next Scan | 2024-09-25T17:18:09+00:00 |
Last Scan
| Scanned | 2024-09-18T17:18:09+00:00 |
| URL | https://mostajaab.com/robots.txt |
| Domain IPs | 104.21.39.153, 172.67.146.109, 2606:4700:3032::6815:2799, 2606:4700:3034::ac43:926d |
| Response IP | 104.21.39.153 |
| Found | Yes |
| Hash | 58c010fdc39aafdd84642a02b41d5b831d5db9a275551330dfcf03fcf772d0a1 |
| SimHash | 6805baea5be0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /resubscribePage |
| Disallow | /apiPages/* |
| Disallow | /cdn-cgi/* |
| Disallow | /search |
| Disallow | /api/* |
| Disallow | /api/v1/* |
| Allow | / |
Warnings
- 2 invalid lines.