freelancer.co.uk
robots.txt
Robots Exclusion Standard data for freelancer.co.uk
Resource Scan
Scan Details
| Site Domain | freelancer.co.uk |
| Base Domain | freelancer.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-10-20T06:06:10+00:00 |
| Next Scan | 2024-11-03T06:06:10+00:00 |
Last Scan
| Scanned | 2024-10-20T06:06:10+00:00 |
| URL | https://freelancer.co.uk/robots.txt |
| Redirect | https://www.freelancer.co.uk/robots.txt |
| Redirect Domain | www.freelancer.co.uk |
| Redirect Base | freelancer.co.uk |
| Domain IPs | 18.210.69.250, 3.227.56.181, 52.44.116.28 |
| Redirect IPs | 151.101.130.114, 151.101.194.114, 151.101.2.114, 151.101.66.114 |
| Response IP | 199.232.46.114 |
| Found | Yes |
| Hash | ce7ca1fdb302e3d04b4b7b2f20d1ee48fbadd06aecefbacf24b57bbd398e4687 |
| SimHash | ca15cc2eaf96 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /sellers/placebid.php* |
| Disallow | /buyers/repost.php* |
| Disallow | /ajax/ |
| Allow | /ajax/project/getBids.php |
| Allow | /ajax/pinky/footer.php |
| Allow | /ajax/count-24h.php |
| Allow | /ajax/_general_vars.php |
| Allow | /ajax/skill-bundle.php |
| Disallow | /users/login-fast.php* |
| Disallow | /users/login-faster.php* |
| Disallow | /users/login-instant.php* |
| Disallow | /users/login-quick.php* |
| Disallow | /bl-email/* |
| Disallow | /users/onUpdateOnlineStatus.php* |
| Disallow | /online-count/* |
| Disallow | /report/violation* |
| Disallow | /widgets$ |
| Disallow | /widgets/* |
| Disallow | /admin$ |
| Disallow | /admin/* |
| Disallow | /payments$ |
| Disallow | /payments/* |
| Disallow | /deloitte/* |
| Disallow | /saml_sso/* |
| Disallow | /pmi/* |
| Disallow | /jobs/?* |
| Disallow | /campaign/* |
| Disallow | /work/* |
| Disallow | /find/* |
| Disallow | /assets$ |
| Disallow | /projects/php-asp/dating-sites/* |
| Disallow | /projects/php-asp/dating-sites?* |
| Disallow | /projects/php-asp/restaurant-directory.7/* |
| Disallow | /projects/php-asp/restaurant-directory.7?* |
| Disallow | /projects/php-website-design/php-nuke-designer/* |
| Disallow | /projects/php-website-design/php-nuke-designer?* |
| Disallow | /projects/php-xml/flash-php-mysql-cms/* |
| Disallow | /projects/php-xml/flash-php-mysql-cms?* |
| Disallow | /projects/php/shopping-cart-checkout/* |
| Disallow | /projects/php/shopping-cart-checkout?* |
| Disallow | /projects/website-design/loan-referral-website/* |
| Disallow | /projects/website-design/loan-referral-website?* |
| Disallow | /projects/browse.php* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.freelancer.co.uk/sitemap_index_gb_s3.xml |
| sitemap | https://www.freelancer.co.uk/sitemap_index_gb_job-search_s3.xml |
| sitemap | https://www.freelancer.co.uk/sitemap_index_gb_projects_s3.xml |
| sitemap | https://www.freelancer.co.uk/sitemap_index_gb_contests_s3.xml |
| sitemap | https://www.freelancer.co.uk/sitemap_index_gb_profiles_s3.xml |
| sitemap | https://www.freelancer.co.uk/sitemap_index_gb_jobs_s3.xml |
| sitemap | https://www.freelancer.co.uk/sitemap_index_gb_hire_s3.xml |
| sitemap | https://www.freelancer.co.uk/sitemap_index_gb_freelancer-directory_s3.xml |
| sitemap | https://www.freelancer.co.uk/sitemap_index_gb_portfolios_s3.xml |
| sitemap | https://www.freelancer.co.uk/sitemap_index_gb_content-hub_s3.xml |
| sitemap | https://www.freelancer.co.uk/sitemap_index_gb_master-articles_s3.xml |
| sitemap | https://www.freelancer.co.uk/sitemap_index_gb_hire-job-synonym_s3.xml |
| sitemap | https://www.freelancer.co.uk/sitemap_index_gb_discover-category_s3.xml |