devchallenge.hu
robots.txt
Robots Exclusion Standard data for devchallenge.hu
Resource Scan
Scan Details
Site Domain | devchallenge.hu |
Base Domain | devchallenge.hu |
Scan Status | Ok |
Last Scan | 2025-10-15T17:18:22+00:00 |
Next Scan | 2025-10-22T17:18:22+00:00 |
Last Scan
Scanned | 2025-10-15T17:18:22+00:00 |
URL | https://devchallenge.hu/robots.txt |
Domain IPs | 104.21.74.109, 172.67.157.111, 2606:4700:3033::ac43:9d6f, 2606:4700:3034::6815:4a6d |
Response IP | 104.21.74.109 |
Found | Yes |
Hash | 7989a0c7da8ae3b0ec1d03526a1ecc1d9c832c52d6584c77016fbca98960a543 |
SimHash | a81021842952 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin |
Disallow | /en/admin |
Disallow | /hu/admin |
Disallow | /dashboard |
Disallow | /en/dashboard |
Disallow | /hu/dashboard |
Disallow | /profile |
Disallow | /en/profile |
Disallow | /hu/profile |
Disallow | /login |
Disallow | /en/login |
Disallow | /hu/login |
Disallow | /manager-login |
Disallow | /en/manager-login |
Disallow | /hu/manager-login |
Disallow | /version-history.txt |
Disallow | /humans.txt |
Disallow | /hu/job/bonusz-brigad/recepcios-munkatars-1 |
Disallow | /en/job/bonusz-brigad/recepcios-munkatars-1 |
Disallow | /docs |
Disallow | /*?tag=* |
Disallow | /css |
Disallow | /images |
Disallow | /favicons |
Disallow | /webfonts |
Disallow | /vendor |
Disallow | /count-new-jobs |
Disallow | /cdn-cgi |