infomigrants.net
robots.txt
Robots Exclusion Standard data for infomigrants.net
Resource Scan
Scan Details
Site Domain | infomigrants.net |
Base Domain | infomigrants.net |
Scan Status | Ok |
Last Scan | 2024-06-13T09:49:27+00:00 |
Next Scan | 2024-07-13T09:49:27+00:00 |
Last Scan
Scanned | 2024-06-13T09:49:27+00:00 |
URL | https://infomigrants.net/robots.txt |
Redirect | https://www.infomigrants.net/robots.txt |
Redirect Domain | www.infomigrants.net |
Redirect Base | infomigrants.net |
Domain IPs | 217.70.184.55 |
Redirect IPs | 23.41.70.79, 2600:1413:a000:4a6::2737, 2600:1413:a000:4bf::2737 |
Response IP | 23.50.17.218 |
Found | Yes |
Hash | 0f8bb8c47c543ec02183fc46d23dfac9e4399771932c3428d83f8eee513e48db |
SimHash | 765a52600707 |
Groups
*
Rule | Path |
---|---|
Disallow | /fr/search?q= |
Disallow | /en/search?q= |
Disallow | /ar/search?q= |
Disallow | /ps/search?q= |
Disallow | /prs/search?q= |
Warnings
- 6 invalid lines.
Comments