minecraftservers.biz
robots.txt

Robots Exclusion Standard data for minecraftservers.biz

Resource Scan

Scan Details

Site Domain minecraftservers.biz
Base Domain minecraftservers.biz
Scan Status Ok
Last Scan2024-11-15T05:39:32+00:00
Next Scan 2024-11-22T05:39:32+00:00

Last Scan

Scanned2024-11-15T05:39:32+00:00
URL https://minecraftservers.biz/robots.txt
Domain IPs 23.156.128.114, 23.156.128.179, 23.156.128.240, 23.156.128.51
Response IP 23.156.128.114
Found Yes
Hash 8e8f91db86cd0d7cab4fd0162c9c3cd2a2a77d5402868729393cf8605705da67
SimHash 317cd81ebf9a

Groups

*

Rule Path
Disallow /search/
Disallow /servers/players/
Disallow /servers/version/
Disallow /servers/registration-date/
Disallow /servers/uptime/
Disallow /servers/recently-added/
Disallow /servers/recently-updated/

sirdatabot

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

alphaseobot-sa

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

proximic

Rule Path
Disallow /

netseer

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://minecraftservers.biz/sitemap/

Warnings

  • `noindex` is not a known field.