Log In Sign Up

uniqsys.com
robots.txt

Robots Exclusion Standard data for uniqsys.com

Resource Scan

Scan Details

Site Domain uniqsys.com
Base Domain uniqsys.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-06-20T05:48:24+00:00
Next Scan 2025-09-18T05:48:24+00:00

Last Successful Scan

Scanned2023-05-07T05:08:37+00:00
URL http://uniqsys.com/robots.txt
Redirect http://www.uniqsys.com/robots.txt
Redirect Domain www.uniqsys.com
Redirect Base uniqsys.com
Domain IPs 205.251.168.159
Redirect IPs 205.251.168.159
Response IP 205.251.168.159
Found Yes
Hash d857a1c47d74f63adc5ad91ab0d3b167cdf8725bd4d7ce5df36c9669f9c41d6f
SimHash ac710b554d65

Groups

*

Rule Path
Disallow

googlebot

Rule Path
Disallow /*sendto_form$
Disallow /*folder_factories$
Back to top

Other Records

Field Value
sitemap http://www.uniqsys.com/sitemaps.xml
Back to top

Comments

  • Define access-restrictions for robots/spiders
  • http://www.robotstxt.org/wc/norobots.html
  • By default we allow robots to access all areas of our site
  • already accessible to anonymous users
  • Add Googlebot-specific syntax extension to exclude forms
  • that are repeated for each piece of content in the site
  • the wildcard is only supported by Googlebot
  • http://www.google.com/support/webmasters/bin/answer.py?answer=40367&ctx=sibling
Back to top