pe.bebee.com
robots.txt
Robots Exclusion Standard data for pe.bebee.com
Resource Scan
Scan Details
| Site Domain | pe.bebee.com |
| Base Domain | bebee.com |
| Scan Status | Ok |
| Last Scan | 2025-11-29T04:36:08+00:00 |
| Next Scan | 2025-12-29T04:36:08+00:00 |
Last Scan
| Scanned | 2025-11-29T04:36:08+00:00 |
| URL | https://pe.bebee.com/robots.txt |
| Domain IPs | 2600:9000:20a5:3000:8:9d2b:3a40:93a1, 2600:9000:20a5:3800:8:9d2b:3a40:93a1, 2600:9000:20a5:4600:8:9d2b:3a40:93a1, 2600:9000:20a5:600:8:9d2b:3a40:93a1, 2600:9000:20a5:8800:8:9d2b:3a40:93a1, 2600:9000:20a5:8e00:8:9d2b:3a40:93a1, 2600:9000:20a5:e600:8:9d2b:3a40:93a1, 2600:9000:20a5:fe00:8:9d2b:3a40:93a1, 3.164.182.114, 3.164.182.123, 3.164.182.69, 3.164.182.8 |
| Response IP | 13.226.2.7 |
| Found | Yes |
| Hash | 9500a564b6e3fefa90b8c0729c14192a13b91feb6e505ce4d91dddba1d602970 |
| SimHash | c1101b16ca15 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | %5E/%40* |
| Disallow | %5E/?* |
| Disallow | %5E/login*?* |
| Disallow | %5E/register*?* |
| Disallow | %5E/job*?* |
| Disallow | %5E/jobs*?* |
| Disallow | %5E/bees*?* |
| Disallow | %5E/bee/*?* |
| Disallow | %5E/hives*?* |
| Disallow | %5E/producer*?* |
| Disallow | %5E/hashtags* |
| Disallow | %5E/company/*?* |
| Disallow | %5E/geoname-by-coordinates |
| Disallow | %5E/bee/*/report |
| Disallow | %5E/company/*/get-more |
| Disallow | %5E/job/*/modal-report-job |
| Disallow | %5E/job/*/set-freelance-modal |
| Disallow | %5E/job/*/get-sign-up-modal |
| Disallow | %5E/company/*/modal-company-report |
| Disallow | %5E/producer/*/*/comment-image |
| Disallow | %5E/services/get-service-route |
| Disallow | %5E/share-modal?* |
| Disallow | %5E/premium/*?* |
| Disallow | %5E/api/* |
| Disallow | %5E/apirest/* |
| Disallow | %5E/docs/* |
| Disallow | %5E/external/* |
| Disallow | %5E/external-apply/* |
| Disallow | %5E/pixel/* |
| Disallow | %5E/tracking/* |
| Disallow | %5E/browsebees* |
| Disallow | %5E/job/202*-* |
| Disallow | %5E/idea/* |
| Disallow | %5E/t/* |
| Allow | / |