bitbot.ucraft.site
robots.txt

Robots Exclusion Standard data for bitbot.ucraft.site

Resource Scan

Scan Details

Site Domain bitbot.ucraft.site
Base Domain ucraft.site
Scan Status Ok
Last Scan2025-12-08T11:32:03+00:00
Next Scan 2026-01-07T11:32:03+00:00

Last Scan

Scanned2025-12-08T11:32:03+00:00
URL https://bitbot.ucraft.site/robots.txt
Domain IPs 104.21.16.63, 172.67.166.181, 2606:4700:3033::6815:103f, 2606:4700:3034::ac43:a6b5
Response IP 172.67.166.181
Found Yes
Hash d08e60bd67c32e951817b0a343da1ac2123df57e934dbe0f2d9371ed09c48dd0
SimHash cc0437548fd0

Groups

*

Rule Path
Allow /*.js*
Allow /*.css*
Allow /*.png*
Allow /*.jpg*
Allow /*.gif*
Disallow /frontend/

Other Records

Field Value
sitemap https://bitbot.ucraft.site/sitemap.xml

Comments

  • Robots @ Ucraft
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/orig.html

Warnings

  • `host` is not a known field.