diybanter.com
robots.txt

Robots Exclusion Standard data for diybanter.com

Resource Scan

Scan Details

Site Domain diybanter.com
Base Domain diybanter.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2026-01-03T11:08:02+00:00
Next Scan 2026-04-03T11:08:02+00:00

Last Successful Scan

Scanned2025-05-15T18:27:26+00:00
URL https://www.diybanter.com/robots.txt
Domain IPs 104.21.14.83, 172.67.202.172, 2606:4700:3034::6815:e53, 2606:4700:3036::ac43:caac
Response IP 104.21.14.83
Found Yes
Hash 2089ec403598ec56d62bad61f9720d61ec692ed1b1333085eb0b25eed1de001c
SimHash 2c1ed248c7c6

Groups

petalbot
yandex
semrushbot
baiduspider
baiduspider
mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /members/
Disallow /authors/
Disallow /ajax.php
Disallow /attachment.php
Disallow /calendar.php
Disallow /cron.php
Disallow /editpost.php
Disallow /global.php
Disallow /image.php
Disallow /inlinemod.php
Disallow /joinrequests.php
Disallow /login.php
Disallow /member.php
Disallow /memberlist.php
Disallow /misc.php
Disallow /moderator.php
Disallow /newattachment.php
Disallow /newreply.php
Disallow /newthread.php
Disallow /online.php
Disallow /poll.php
Disallow /postings.php
Disallow /printthread.php
Disallow /private.php
Disallow /profile.php
Disallow /register.php
Disallow /report.php
Disallow /reputation.php
Disallow /search.php
Disallow /sendmessage.php
Disallow /showgroups.php
Disallow /subscription.php
Disallow /threadrate.php
Disallow /usercp.php
Disallow /usernote.php
Disallow /viewheaders.php