ve.bebee.com
robots.txt

Robots Exclusion Standard data for ve.bebee.com

Resource Scan

Scan Details

Site Domain ve.bebee.com
Base Domain bebee.com
Scan Status Ok
Last Scan2025-05-18T01:29:05+00:00
Next Scan 2025-06-17T01:29:05+00:00

Last Scan

Scanned2025-05-18T01:29:05+00:00
URL https://ve.bebee.com/robots.txt
Domain IPs 2600:9000:21f8:2800:8:9d2b:3a40:93a1, 2600:9000:21f8:3800:8:9d2b:3a40:93a1, 2600:9000:21f8:8a00:8:9d2b:3a40:93a1, 2600:9000:21f8:9c00:8:9d2b:3a40:93a1, 2600:9000:21f8:a200:8:9d2b:3a40:93a1, 2600:9000:21f8:ba00:8:9d2b:3a40:93a1, 2600:9000:21f8:e200:8:9d2b:3a40:93a1, 2600:9000:21f8:e600:8:9d2b:3a40:93a1, 3.161.119.106, 3.161.119.11, 3.161.119.43, 3.161.119.95
Response IP 108.156.22.43
Found Yes
Hash eeedd376a4b23ab1cd2ba8d37e4cd689b86d5402bbc565011ccfe6b4d607387d
SimHash f00056851638

Groups

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

*

Rule Path
Disallow /%40*
Disallow /?*
Disallow /login*?*
Disallow /register*?*
Disallow /job*?*
Disallow /jobs*?*
Disallow /bees*?*
Disallow /bee/*?*
Disallow /hives*?*
Disallow /producer*?*
Disallow /hashtags*
Disallow /company/*?*
Disallow /geoname-by-coordinates
Disallow /bee/*/report
Disallow /company/*/get-more
Disallow /job/*/modal-report-job
Disallow /job/*/set-freelance-modal
Disallow /job/*/get-sign-up-modal
Disallow /company/*/modal-company-report
Disallow /producer/*/*/comment-image
Disallow /services/get-service-route
Disallow /share-modal?*
Disallow /premium/*?*
Disallow /api/*
Disallow /apirest/*
Disallow /docs/*
Disallow /external/*
Disallow /external-apply/*
Disallow /pixel/*
Disallow /tracking/*
Disallow /browsebees*
Disallow /job/202*-*
Disallow /idea/*
Disallow /t/*
Allow /