ma.bebee.com
robots.txt

Robots Exclusion Standard data for ma.bebee.com

Resource Scan

Scan Details

Site Domain ma.bebee.com
Base Domain bebee.com
Scan Status Ok
Last Scan2025-12-09T01:40:45+00:00
Next Scan 2026-01-08T01:40:45+00:00

Last Scan

Scanned2025-12-09T01:40:45+00:00
URL https://ma.bebee.com/robots.txt
Domain IPs 13.226.2.124, 13.226.2.42, 13.226.2.7, 13.226.2.73, 2600:9000:21f8:3200:8:9d2b:3a40:93a1, 2600:9000:21f8:7c00:8:9d2b:3a40:93a1, 2600:9000:21f8:9200:8:9d2b:3a40:93a1, 2600:9000:21f8:9c00:8:9d2b:3a40:93a1, 2600:9000:21f8:be00:8:9d2b:3a40:93a1, 2600:9000:21f8:c200:8:9d2b:3a40:93a1, 2600:9000:21f8:d200:8:9d2b:3a40:93a1, 2600:9000:21f8:d400:8:9d2b:3a40:93a1
Response IP 13.226.2.7
Found Yes
Hash 9500a564b6e3fefa90b8c0729c14192a13b91feb6e505ce4d91dddba1d602970
SimHash c1101b16ca15

Groups

blexbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

*

Rule Path
Disallow %5E/%40*
Disallow %5E/?*
Disallow %5E/login*?*
Disallow %5E/register*?*
Disallow %5E/job*?*
Disallow %5E/jobs*?*
Disallow %5E/bees*?*
Disallow %5E/bee/*?*
Disallow %5E/hives*?*
Disallow %5E/producer*?*
Disallow %5E/hashtags*
Disallow %5E/company/*?*
Disallow %5E/geoname-by-coordinates
Disallow %5E/bee/*/report
Disallow %5E/company/*/get-more
Disallow %5E/job/*/modal-report-job
Disallow %5E/job/*/set-freelance-modal
Disallow %5E/job/*/get-sign-up-modal
Disallow %5E/company/*/modal-company-report
Disallow %5E/producer/*/*/comment-image
Disallow %5E/services/get-service-route
Disallow %5E/share-modal?*
Disallow %5E/premium/*?*
Disallow %5E/api/*
Disallow %5E/apirest/*
Disallow %5E/docs/*
Disallow %5E/external/*
Disallow %5E/external-apply/*
Disallow %5E/pixel/*
Disallow %5E/tracking/*
Disallow %5E/browsebees*
Disallow %5E/job/202*-*
Disallow %5E/idea/*
Disallow %5E/t/*
Allow /