koofers.com
robots.txt

Robots Exclusion Standard data for koofers.com

Resource Scan

Scan Details

Site Domain koofers.com
Base Domain koofers.com
Scan Status Ok
Last Scan2024-09-13T01:57:13+00:00
Next Scan 2024-10-13T01:57:13+00:00

Last Scan

Scanned2024-09-13T01:57:13+00:00
URL https://koofers.com/robots.txt
Domain IPs 108.157.254.100, 108.157.254.113, 108.157.254.123, 108.157.254.71
Response IP 108.157.254.113
Found Yes
Hash fb2dfd9601a7fa0cddfd1d69ce09ac675919bf6376a4556d6e4028a83654d550
SimHash 651673227721

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

*

Rule Path
Disallow /wordpress/
Disallow /uploads/
Disallow /it-docs/
Disallow /es-docs/
Disallow /en-docs/
Disallow /sr-docs/
Disallow /pl-docs/
Disallow /ru-docs/
Disallow /pt-docs/
Disallow /fr-docs/
Disallow /de-docs/
Disallow /it-video/
Disallow /es-video/
Disallow /en-video/
Disallow /sr-video/
Disallow /pl-video/
Disallow /ru-video/
Disallow /pt-video/
Disallow /fr-video/
Disallow /de-video/
Disallow /documents_pages/
Disallow */dashboard*
Disallow */account/*
Disallow *?show_login
Disallow *escaped_fragment*
Disallow *?fb*
Disallow *?_pxhc=*
Disallow *store%3D*
Disallow *?qId=*
Disallow */search*
Disallow */profilo/*
Disallow */perfil/*
Disallow */profile/*
Disallow */profil/*
Disallow /en/university/
Allow /en/university/us
Allow /en/university/gb
Allow /en/university/in
Disallow /fr/professeurs/
Disallow /ru/professora/
Disallow /sr/profesori/
Disallow /pl/profesorowie/

Comments

  • FOLDERS
  • PARAMS
  • SEARCH
  • USERS
  • UNIVERSITIES
  • PROFESSORS