bbs.bengo4.com
robots.txt
Robots Exclusion Standard data for bbs.bengo4.com
Resource Scan
Scan Details
| Site Domain | bbs.bengo4.com |
| Base Domain | bengo4.com |
| Scan Status | Ok |
| Last Scan | 6/1/2025, 7:19:27 AM |
| Next Scan | 6/15/2025, 7:19:27 AM |
Last Scan
| Scanned | 6/1/2025, 7:19:27 AM |
| URL | https://bbs.bengo4.com/robots.txt |
| Domain IPs | 23.54.155.199, 23.54.155.208 |
| Response IP | 23.54.118.68 |
| Found | Yes |
| Hash | 46814f0ab62ffd0bd63a3a32e14cddfe9a6c88ec4ddc8946237b6e8e86ef0170 |
| SimHash | d70e9650c5ab |
Groups
bingbot
| Rule | Path |
|---|---|
| Disallow | /74013581/ |
| Disallow | /api/ |
| Disallow | /c_3/api/ |
| Disallow | /fudosan/api/ |
| Allow | /api/bbs/rss |
| Allow | /api/img/ |
| Disallow | /bbs/vote/ |
| Disallow | /js/robotsDeny/ |
| Disallow | /js/pc/robotsDeny/ |
| Disallow | /js/sp/robotsDeny/ |
| Disallow | /js/test/robotsDeny/ |
| Disallow | /sp/search/result/*/ |
| Disallow | /sp/user/ |
| Disallow | /result/ |
| Disallow | /topics/jump/ |
| Disallow | /special/ |
| Disallow | /module/ |
| Disallow | /voice/* |
| Allow | /voice/$ |
| Disallow | /sp/voice/* |
| Allow | /sp/voice/$ |
| Disallow | /lawyer/private/* |
*
| Rule | Path |
|---|---|
| Disallow | /74013581/ |
| Disallow | /api/ |
| Disallow | /c_3/api/ |
| Disallow | /fudosan/api/ |
| Allow | /api/bbs/rss |
| Allow | /api/img/ |
| Disallow | /bbs/vote/ |
| Disallow | /js/robotsDeny/ |
| Disallow | /js/pc/robotsDeny/ |
| Disallow | /js/sp/robotsDeny/ |
| Disallow | /js/test/robotsDeny/ |
| Disallow | /sp/search/result/*/ |
| Disallow | /sp/user/ |
| Disallow | /result/ |
| Disallow | /topics/jump/ |
| Disallow | /special/ |
| Disallow | /module/ |
| Disallow | /voice/* |
| Allow | /voice/$ |
| Disallow | /sp/voice/* |
| Allow | /sp/voice/$ |
| Disallow | /lawyer/private/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bengo4.com/topics/feed/googlenews |
| sitemap | https://www.bengo4.com/times/sitemap.xml |