raypeatforum.com
robots.txt
Robots Exclusion Standard data for raypeatforum.com
Resource Scan
Scan Details
| Site Domain | raypeatforum.com |
| Base Domain | raypeatforum.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-11-28T04:43:36+00:00 |
| Next Scan | 2026-02-26T04:43:36+00:00 |
Last Successful Scan
| Scanned | 2024-04-14T21:34:19+00:00 |
| URL | https://raypeatforum.com/robots.txt |
| Domain IPs | 104.26.14.2, 104.26.15.2, 172.67.75.226, 2606:4700:20::681a:e02, 2606:4700:20::681a:f02, 2606:4700:20::ac43:4be2 |
| Response IP | 172.67.75.226 |
| Found | Yes |
| Hash | cc6717504ec64e22450ccb6b551be0aa48c0100ad676e00760e655f58784c11d |
| SimHash | 92454096cf93 |
Groups
ahrefsbot
baidu
baiduspider
baiduspider-video
baiduspider-image
boardreader
boardtracker
cliqzbot
diffbot
dotbot
easouspider
exabot
gigabot
linkdexbot
linkdexbot-mobile
magpie-crawler
meanpathbot
mj12bot
twiceler
naverbot
omgilibot
proximic
rogerbot
sitebot
sogou
sogou spider
sogou web spider
sosospider
spbot
trendictionbot
twiceler
urlappendbot
yandex
youdaobot
yeti
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /community/admin.php |
| Disallow | /community/account/ |
| Disallow | /community/attachments/ |
| Disallow | /community/conversations/ |
| Disallow | /community/find-new/ |
| Disallow | /community/goto/ |
| Disallow | /community/login/ |
| Disallow | /community/search/ |
| Disallow | /community/unanswered/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://raypeatforum.com/community/sitemap.php |