Log In Sign Up

gdevminske.by
robots.txt

Robots Exclusion Standard data for gdevminske.by

Resource Scan

Scan Details

Site Domain gdevminske.by
Base Domain gdevminske.by
Scan Status Ok
Last Scan2026-04-04T02:03:31+00:00
Next Scan 2026-04-11T02:03:31+00:00

Last Scan

Scanned2026-04-04T02:03:31+00:00
URL https://gdevminske.by/robots.txt
Domain IPs 185.244.50.220
Response IP 185.244.50.220
Found Yes
Hash 23ace42bfd14c23bc73810718b652d9b39f281e67e0478e82d93f0d55d41611a
SimHash bc125d136524

Groups

*

No rules defined. All paths allowed.

Back to top

Comments

  • robots.txt
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
Back to top

Warnings

  • `host` is not a known field.
Back to top