gb.bebee.com
robots.txt

Robots Exclusion Standard data for gb.bebee.com

Resource Scan

Scan Details

Site Domain gb.bebee.com
Base Domain bebee.com
Scan Status Ok
Last Scan2024-06-03T04:12:29+00:00
Next Scan 2024-07-03T04:12:29+00:00

Last Scan

Scanned2024-06-03T04:12:29+00:00
URL https://gb.bebee.com/robots.txt
Domain IPs 13.226.2.124, 13.226.2.42, 13.226.2.7, 13.226.2.73
Response IP 3.160.246.93
Found Yes
Hash 80330c9f1a53ea20d825b07d0783ed6d2ee7e6dd96896edcf7a15a069598b062
SimHash f042d6851e39

Groups

semrushbot

Rule Path
Disallow /

blexbot
gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /login*?*
Disallow /register*?*
Disallow /job*?*
Disallow /jobs*?*
Disallow /bees*?*
Disallow /bee/*?*
Disallow /hives*?*
Disallow /producer*?*
Disallow /hashtags*?*
Disallow /company/*?*
Disallow /geoname-by-coordinates
Disallow /bee/*/report
Disallow /company/*/get-more
Disallow /job/*/modal-report-job
Disallow /job/*/set-freelance-modal
Disallow /job/*/get-sign-up-modal
Disallow /jobn/*
Disallow /producer/*/*/comment-image
Disallow /services/get-service-route
Disallow /api/*
Disallow /apirest/*
Disallow /docs/*
Disallow /external/*
Disallow /external-apply/*
Disallow /pixel/*
Allow /