ua.bebee.com
robots.txt
Robots Exclusion Standard data for ua.bebee.com
Resource Scan
Scan Details
Site Domain | ua.bebee.com |
Base Domain | bebee.com |
Scan Status | Ok |
Last Scan | 2024-10-23T00:38:17+00:00 |
Next Scan | 2024-11-22T00:38:17+00:00 |
Last Scan
Scanned | 2024-10-23T00:38:17+00:00 |
URL | https://ua.bebee.com/robots.txt |
Domain IPs | 18.172.213.101, 18.172.213.117, 18.172.213.128, 18.172.213.54, 2600:9000:20fe:1600:8:9d2b:3a40:93a1, 2600:9000:20fe:6000:8:9d2b:3a40:93a1, 2600:9000:20fe:6600:8:9d2b:3a40:93a1, 2600:9000:20fe:7400:8:9d2b:3a40:93a1, 2600:9000:20fe:9c00:8:9d2b:3a40:93a1, 2600:9000:20fe:9e00:8:9d2b:3a40:93a1, 2600:9000:20fe:cc00:8:9d2b:3a40:93a1, 2600:9000:20fe:f000:8:9d2b:3a40:93a1 |
Response IP | 13.226.2.42 |
Found | Yes |
Hash | edb088dc1a4b2003d58dee8590c66abb57d47c52b6a3e247f25980837c457066 |
SimHash | f00256841638 |
Groups
*
Rule | Path |
---|---|
Disallow | /%40* |
Disallow | /?* |
Disallow | /login*?* |
Disallow | /register*?* |
Disallow | /job*?* |
Disallow | /jobs*?* |
Disallow | /bees*?* |
Disallow | /bee/*?* |
Disallow | /hives*?* |
Disallow | /producer*?* |
Disallow | /hashtags*?* |
Disallow | /company/*?* |
Disallow | /geoname-by-coordinates |
Disallow | /bee/*/report |
Disallow | /company/*/get-more |
Disallow | /job/*/modal-report-job |
Disallow | /job/*/set-freelance-modal |
Disallow | /job/*/get-sign-up-modal |
Disallow | /company/*/modal-company-report |
Disallow | /producer/*/*/comment-image |
Disallow | /services/get-service-route |
Disallow | /share-modal?* |
Disallow | /premium/*?* |
Disallow | /api/* |
Disallow | /apirest/* |
Disallow | /docs/* |
Disallow | /external/* |
Disallow | /external-apply/* |
Disallow | /pixel/* |
Disallow | /tracking/* |
Disallow | /browsebees* |
Disallow | /job/202*-* |
Disallow | /idea/* |
Disallow | /t/* |
Allow | / |