vn.freelancer.com
robots.txt

Robots Exclusion Standard data for vn.freelancer.com

Resource Scan

Scan Details

Site Domain vn.freelancer.com
Base Domain freelancer.com
Scan Status Ok
Last Scan2024-05-24T07:39:20+00:00
Next Scan 2024-06-23T07:39:20+00:00

Last Scan

Scanned2024-05-24T07:39:20+00:00
URL https://vn.freelancer.com/robots.txt
Redirect https://www.vn.freelancer.com/robots.txt
Redirect Domain www.vn.freelancer.com
Redirect Base freelancer.com
Domain IPs 3.211.22.40, 3.219.0.163, 34.235.96.196
Redirect IPs 151.101.130.114, 151.101.194.114, 151.101.2.114, 151.101.66.114
Response IP 199.232.46.114
Found Yes
Hash 85f6f7a17688dc2e79761b2147f23c8efc9792d16c4802731c29c34e226c19d8
SimHash ca57ec2caad4

Groups

jooblebot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

*

Rule Path
Disallow /sellers/placebid.php*
Disallow /buyers/repost.php*
Disallow /ajax/
Allow /ajax/project/getBids.php
Allow /ajax/pinky/footer.php
Allow /ajax/count-24h.php
Allow /ajax/_general_vars.php
Allow /ajax/skill-bundle.php
Disallow /users/login-fast.php*
Disallow /users/login-faster.php*
Disallow /users/login-instant.php*
Disallow /users/login-quick.php*
Disallow /bl-email/*
Disallow /users/onUpdateOnlineStatus.php*
Disallow /online-count/*
Disallow /report/violation*
Disallow /widgets$
Disallow /widgets/*
Disallow /admin$
Disallow /admin/*
Disallow /payments$
Disallow /payments/*
Disallow /deloitte/*
Disallow /saml_sso/*
Disallow /pmi/*
Disallow /jobs/?*
Disallow /campaign/*
Disallow /work/*
Disallow /find/*
Disallow /assets$
Disallow /projects/php-asp/dating-sites/*
Disallow /projects/php-asp/dating-sites?*
Disallow /projects/php-asp/restaurant-directory.7/*
Disallow /projects/php-asp/restaurant-directory.7?*
Disallow /projects/php-website-design/php-nuke-designer/*
Disallow /projects/php-website-design/php-nuke-designer?*
Disallow /projects/php-xml/flash-php-mysql-cms/*
Disallow /projects/php-xml/flash-php-mysql-cms?*
Disallow /projects/php/shopping-cart-checkout/*
Disallow /projects/php/shopping-cart-checkout?*
Disallow /projects/website-design/loan-referral-website/*
Disallow /projects/website-design/loan-referral-website?*
Disallow /projects/browse.php*

mediapartners-google
adidxbot

Rule Path
Allow /campaign/*
Allow /find/*
Disallow /u/*

Other Records

Field Value
sitemap https://www.vn.freelancer.com/sitemap_index_vn_s3.xml
sitemap https://www.vn.freelancer.com/sitemap_index_vn_job-search_s3.xml
sitemap https://www.vn.freelancer.com/sitemap_index_vn_projects_s3.xml
sitemap https://www.vn.freelancer.com/sitemap_index_vn_contests_s3.xml
sitemap https://www.vn.freelancer.com/sitemap_index_vn_profiles_s3.xml
sitemap https://www.vn.freelancer.com/sitemap_index_vn_jobs_s3.xml
sitemap https://www.vn.freelancer.com/sitemap_index_vn_hire_s3.xml
sitemap https://www.vn.freelancer.com/sitemap_index_vn_freelancer-directory_s3.xml
sitemap https://www.vn.freelancer.com/sitemap_index_vn_portfolios_s3.xml
sitemap https://www.vn.freelancer.com/sitemap_index_vn_content-hub_s3.xml
sitemap https://www.vn.freelancer.com/sitemap_index_vn_master-articles_s3.xml
sitemap https://www.vn.freelancer.com/sitemap_index_vn_hire-job-synonym_s3.xml
sitemap https://www.vn.freelancer.com/sitemap_index_vn_discover-category_s3.xml