jref.com
robots.txt
Robots Exclusion Standard data for jref.com
Resource Scan
Scan Details
| Site Domain | jref.com |
| Base Domain | jref.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-10-14T13:51:04+00:00 |
| Next Scan | 2026-01-12T13:51:04+00:00 |
Last Successful Scan
| Scanned | 2024-03-24T09:22:50+00:00 |
| URL | https://jref.com/robots.txt |
| Domain IPs | 104.21.55.239, 172.67.174.115, 2606:4700:3030::6815:37ef, 2606:4700:3034::ac43:ae73 |
| Response IP | 172.67.174.115 |
| Found | Yes |
| Hash | 46ec9da8f44a1a538553bc55c5c176be50d2ab559dc9f972150f949be1a4525b |
| SimHash | 7974f438d29d |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /cgi-bin/ |
| Disallow | /forums/account/ |
| Disallow | /forums/admin.php |
| Disallow | /forums/attachments/ |
| Disallow | /forums/conversations/ |
| Disallow | /forums/find-threads/ |
| Disallow | /forums/forums/*/create-thread |
| Disallow | /forums/forums/*/post-thread |
| Disallow | /forums/goto/ |
| Disallow | /forums/job.php |
| Disallow | /forums/login/ |
| Disallow | /forums/logout/ |
| Disallow | /forums/lost-password/ |
| Disallow | /forums/members/ |
| Disallow | /forums/misc/ |
| Disallow | /forums/online/ |
| Disallow | /forums/posts/ |
| Disallow | /forums/profile-posts/ |
| Disallow | /forums/register/ |
| Disallow | /forums/search/ |
| Disallow | /forums/search-forums/location |
| Disallow | /forums/threads/*/add-reply |
| Disallow | /forums/threads/*/approve |
| Disallow | /forums/threads/*/draft |
| Disallow | /forums/threads/*/latest |
| Disallow | /forums/threads/*/post |
| Disallow | /forums/threads/*/reply |
| Disallow | /forums/threads/*/unread |
| Disallow | /forums/whats-new/ |
| Disallow | /tags/ |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://jref.com/sitemap.php |
Warnings
- 1 invalid line.