manebooru.art
robots.txt

Robots Exclusion Standard data for manebooru.art

Resource Scan

Scan Details

Site Domain manebooru.art
Base Domain manebooru.art
Scan Status Ok
Last Scan2025-12-10T10:41:50+00:00
Next Scan 2026-01-09T10:41:50+00:00

Last Scan

Scanned2025-12-10T10:41:50+00:00
URL https://manebooru.art/robots.txt
Domain IPs 104.21.69.158, 172.67.209.167, 2606:4700:3033::6815:459e, 2606:4700:3035::ac43:d1a7
Response IP 172.67.209.167
Found Yes
Hash 393846a91709713f0e5c4d60619bb9ec4577282e1422d987822952e2c5f12475
SimHash 9938dfe26ad8

Groups

mj12bot
semrushbot
ahrefsbot

Rule Path
Disallow /

*

Rule Path
Allow /images/*
Disallow /profiles
Disallow /api
Disallow /filters/hide
Disallow /filters/spoiler
Disallow /harming/humans
Disallow /ignoring/human/orders
Disallow /harm/to/self

Other Records

Field Value
crawl-delay 2

Comments

  • Disallow: /images
  • Disallow: /tags
  • Disallow: /search