Log In Sign Up

free-work.com
robots.txt

Robots Exclusion Standard data for free-work.com

Resource Scan

Scan Details

Site Domain free-work.com
Base Domain free-work.com
Scan Status Ok
Last Scan2024-09-30T20:11:57+00:00
Next Scan 2024-10-30T20:11:57+00:00

Last Scan

Scanned2024-09-30T20:11:57+00:00
URL https://free-work.com/robots.txt
Redirect https://www.free-work.com:443/robots.txt
Redirect Domain www.free-work.com
Redirect Base free-work.com
Domain IPs 13.36.186.69, 15.188.25.33, 35.181.203.180
Redirect IPs 13.36.186.69, 15.188.25.33, 35.181.203.180
Response IP 15.188.25.33
Found Yes
Hash f1cfd8f0ba5024fd51539cc75982ff3467dbaff155b206469903d7c97c0848ae
SimHash 05055a010d51

Groups

*

Rule Path
Disallow /login
Disallow /logout

googlebot-news

Rule Path
Disallow /
Allow /tech-it/blog/*

adidxbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

nutch

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

wget

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

httrack

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://statics.free-work.com/sitemapindex.xml
Back to top

Comments

  • robots.txt for https://www.free-work.com/
  • ███████╗██████╗ ███████╗███████╗ ██╗ ██╗ ██████╗ ██████╗ ██╗ ██╗
  • ██╔════╝██╔══██╗██╔════╝██╔════╝ ██║ ██║██╔═══██╗██╔══██╗██║ ██╔╝
  • █████╗ ██████╔╝█████╗ █████╗█████╗██║ █╗ ██║██║ ██║██████╔╝█████╔╝
  • ██╔══╝ ██╔══██╗██╔══╝ ██╔══╝╚════╝██║███╗██║██║ ██║██╔══██╗██╔═██╗
  • ██║ ██║ ██║███████╗███████╗ ╚███╔███╔╝╚██████╔╝██║ ██║██║ ██╗
  • ╚═╝ ╚═╝ ╚═╝╚══════╝╚══════╝ ╚══╝╚══╝ ╚═════╝ ╚═╝ ╚═╝╚═╝ ╚═╝
  • Last modified: 2022/09/09
Back to top