freelancehunt.com
robots.txt
Robots Exclusion Standard data for freelancehunt.com
Resource Scan
Scan Details
| Site Domain | freelancehunt.com |
| Base Domain | freelancehunt.com |
| Scan Status | Ok |
| Last Scan | 2024-06-28T20:47:23+00:00 |
| Next Scan | 2024-07-12T20:47:23+00:00 |
Last Scan
| Scanned | 2024-06-28T20:47:23+00:00 |
| URL | https://freelancehunt.com/robots.txt |
| Domain IPs | 104.22.34.189, 104.22.35.189, 172.67.31.26 |
| Response IP | 172.67.31.26 |
| Found | Yes |
| Hash | dae1590be7bf9ed43d78ab91f4176c105f102d2f9c78a0da1d47015114fb7d66 |
| SimHash | 854a084e55c9 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cdn-cgi/ |
| Disallow | *cf_chl_captcha_tk |
| Disallow | */?q= |
| Disallow | */profile/login?to= |
| Disallow | *?utm_source= |
| Disallow | */job/add/ |
| Disallow | */project/add/ |
| Disallow | */contest/add/ |
| Disallow | */?tags= |
| Disallow | *%26page%3D |
| Disallow | *page%3D%26 |
| Disallow | /register/ |
| Disallow | */static/dist/components/ |
| Disallow | */profile/register |
| Disallow | */profile/login |
| Disallow | */profile/lostpassword |
| Disallow | */profile/changepassword |
| Disallow | */out/ |
| Disallow | *?only_my_skills= |
| Disallow | *?only_few_bids= |
| Disallow | *?country= |
| Disallow | *?quickjump |
| Disallow | *?query= |
| Disallow | */city/ |
| Disallow | */country/ |
| Disallow | */currency/ |
| Disallow | */applicant/ |
| Disallow | */applicants/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://freelancehunt.com/sitemap.xml |
| sitemap | https://freelancehunt.com/sitemap-ua.xml |
| sitemap | https://freelancehunt.com/sitemap-en.xml |
| sitemap | https://freelancehunt.com/sitemap-pl.xml |