freelancer.com.ru
robots.txt
Robots Exclusion Standard data for freelancer.com.ru
Resource Scan
Scan Details
Site Domain | freelancer.com.ru |
Base Domain | freelancer.com.ru |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-04-21T10:36:42+00:00 |
Next Scan | 2024-07-20T10:36:42+00:00 |
Last Successful Scan
Scanned | 2023-12-17T10:27:38+00:00 |
URL | https://www.freelancer.com.ru/robots.txt |
Domain IPs | 151.101.130.114, 151.101.194.114, 151.101.2.114, 151.101.66.114 |
Response IP | 199.232.46.114 |
Found | Yes |
Hash | 7dcb876f877d64c4b3c3a3a5d026e95407abbe6dd61f173e386c392d012e4145 |
SimHash | ff428c66a096 |
Groups
*
Rule | Path |
---|---|
Disallow | /sellers/placebid.php* |
Disallow | /buyers/repost.php* |
Disallow | /ajax/ |
Allow | /ajax/project/getBids.php |
Allow | /ajax/pinky/footer.php |
Allow | /ajax/count-24h.php |
Allow | /ajax/_general_vars.php |
Allow | /ajax/skill-bundle.php |
Disallow | /users/login-fast.php* |
Disallow | /users/login-faster.php* |
Disallow | /users/login-instant.php* |
Disallow | /users/login-quick.php* |
Disallow | /bl-email/* |
Disallow | /users/onUpdateOnlineStatus.php* |
Disallow | /online-count/* |
Disallow | /report/violation* |
Disallow | /widgets$ |
Disallow | /widgets/* |
Disallow | /admin$ |
Disallow | /admin/* |
Disallow | /payments$ |
Disallow | /payments/* |
Disallow | /deloitte/* |
Disallow | /saml_sso/* |
Disallow | /pmi/* |
Disallow | /jobs/?* |
Disallow | /campaign/* |
Disallow | /work/* |
Disallow | /find/* |
Disallow | /assets$ |
Other Records
Field | Value |
---|---|
sitemap | https://www.freelancer.com.ru/sitemap_index_ru_s3.xml |
sitemap | https://www.freelancer.com.ru/sitemap_index_ru_job-search_s3.xml |
sitemap | https://www.freelancer.com.ru/sitemap_index_ru_projects_s3.xml |
sitemap | https://www.freelancer.com.ru/sitemap_index_ru_contests_s3.xml |
sitemap | https://www.freelancer.com.ru/sitemap_index_ru_profiles_s3.xml |
sitemap | https://www.freelancer.com.ru/sitemap_index_ru_jobs_s3.xml |
sitemap | https://www.freelancer.com.ru/sitemap_index_ru_hire_s3.xml |
sitemap | https://www.freelancer.com.ru/sitemap_index_ru_freelancer-directory_s3.xml |
sitemap | https://www.freelancer.com.ru/sitemap_index_ru_portfolios_s3.xml |
sitemap | https://www.freelancer.com.ru/sitemap_index_ru_content-hub_s3.xml |
sitemap | https://www.freelancer.com.ru/sitemap_index_ru_master-articles_s3.xml |
sitemap | https://www.freelancer.com.ru/sitemap_index_ru_hire-job-synonym_s3.xml |
sitemap | https://www.freelancer.com.ru/sitemap_index_ru_discover-category_s3.xml |