march42.net
robots.txt

Robots Exclusion Standard data for march42.net

Resource Scan

Scan Details

Site Domain march42.net
Base Domain march42.net
Scan Status Ok
Last Scan2025-12-20T04:03:00+00:00
Next Scan 2026-01-03T04:03:00+00:00

Last Scan

Scanned2025-12-20T04:03:00+00:00
URL https://march42.net/robots.txt
Domain IPs 178.254.30.149, 2a00:6800:3:e50::1
Response IP 178.254.30.149
Found Yes
Hash 456fe4bc724607f1174c79a22c0611a12f910b125c9eb495e25428d1b01ff530
SimHash f14d40166491

Groups

*

Rule Path
Disallow /

bingbot
duckduckbot
googlebot

Rule Path
Allow /

*

Rule Path
Disallow /manual/
Disallow /icons/
Disallow /cgi-bin/
Disallow /avatar/
Disallow /image/
Disallow /tine20/
Disallow /nextcloud/
Disallow /harvesterkiller
Disallow /pitchfork-of-hades
Disallow /bident-of-hades
Disallow /trident-of-poseidon
Disallow /thunderbolt-of-zeus
Disallow /caduceus-of-hermes

Comments

  • Crawl-Delay: 604800
  • ddg may index
  • User-agent: PetalBot
  • Crawl-Delay: 86400
  • sitemap: https://march42.net/sitemap.xml