il.bebee.com
robots.txt
Robots Exclusion Standard data for il.bebee.com
Resource Scan
Scan Details
Site Domain | il.bebee.com |
Base Domain | bebee.com |
Scan Status | Ok |
Last Scan | 2024-04-25T15:00:17+00:00 |
Next Scan | 2024-05-25T15:00:17+00:00 |
Last Scan
Scanned | 2024-04-25T15:00:17+00:00 |
URL | https://il.bebee.com/robots.txt |
Domain IPs | 18.244.214.107, 18.244.214.39, 18.244.214.40, 18.244.214.59 |
Response IP | 18.165.171.111 |
Found | Yes |
Hash | 2c6d53b9ba5a85ec6afec5943a9bda8f734f98674f9d9f74d7b5f5a6f9817022 |
SimHash | 714256855e31 |
Groups
*
Rule | Path |
---|---|
Disallow | /login*?* |
Disallow | /register*?* |
Disallow | /job*?* |
Disallow | /jobs*?* |
Disallow | /bees*?* |
Disallow | /bee/*?* |
Disallow | /hives*?* |
Disallow | /producer*?* |
Disallow | /hashtags*?* |
Disallow | /geoname-by-coordinates |
Disallow | /bee/*/report |
Disallow | /company/*/get-more |
Disallow | /job/*/modal-report-job |
Disallow | /job/*/set-freelance-modal |
Disallow | /job/*/get-sign-up-modal |
Disallow | /jobn/* |
Disallow | /producer/*/*/comment-image |
Disallow | /services/get-service-route |
Disallow | /api/* |
Disallow | /apirest/* |
Disallow | /docs/* |
Disallow | /external/* |
Disallow | /external-apply/* |
Disallow | /pixel/* |
Allow | / |