ybd-project-da5ui.onrender.com
robots.txt
Robots Exclusion Standard data for ybd-project-da5ui.onrender.com
Resource Scan
Scan Details
| Site Domain | ybd-project-da5ui.onrender.com |
| Base Domain | ybd-project-da5ui.onrender.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2025-08-27T07:40:50+00:00 |
| Next Scan | 2025-11-25T07:40:50+00:00 |
Last Successful Scan
| Scanned | 2025-01-30T06:59:58+00:00 |
| URL | https://ybd-project-da5ui.onrender.com/robots.txt |
| Redirect | https://redirect.ybd-project.workers.dev/robots.txt |
| Redirect Domain | redirect.ybd-project.workers.dev |
| Redirect Base | ybd-project.workers.dev |
| Domain IPs | 216.24.57.252, 216.24.57.4 |
| Redirect IPs | 104.21.19.21, 172.67.184.121, 2606:4700:3036::6815:1315, 2606:4700:3037::ac43:b879 |
| Response IP | 104.21.19.21 |
| Found | Yes |
| Hash | 6d2ce72a26eacd11a23a8c27a13f890779e03afa57ce0b0a16ee511e0833cb2e |
| SimHash | af09f84d1023 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /ja-JP/search/ |
| Disallow | /ja-JP/search |
| Disallow | /ja-JP/watch/ |
| Disallow | /ja-JP/watch |
| Disallow | /ja-JP/channel/ |
| Disallow | /ja-JP/channel |
| Disallow | /ja-JP/playlist/ |
| Disallow | /ja-JP/playlist |
| Disallow | /en-GB/search/ |
| Disallow | /en-GB/search |
| Disallow | /en-GB/watch/ |
| Disallow | /en-GB/watch |
| Disallow | /en-GB/channel/ |
| Disallow | /en-GB/channel |
| Disallow | /en-GB/playlist/ |
| Disallow | /en-GB/playlist |
Other Records
| Field | Value |
|---|---|
| sitemap | https://redirect.ybd-project.workers.dev/sitemap.xml |