unique.be
robots.txt

Robots Exclusion Standard data for unique.be

Resource Scan

Scan Details

Site Domain unique.be
Base Domain unique.be
Scan Status Ok
Last Scan2024-09-19T08:01:26+00:00
Next Scan 2024-10-19T08:01:26+00:00

Last Scan

Scanned2024-09-19T08:01:26+00:00
URL https://unique.be/robots.txt
Redirect https://www.unique.be/robots.txt
Redirect Domain www.unique.be
Redirect Base unique.be
Domain IPs 52.50.119.232, 52.50.220.153
Redirect IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.59
Found Yes
Hash 76c05c79aad5feb2d20a57f16778e990ab475b0d45da9630417ea1b23a7cfc11
SimHash 4a10c82a9512

Groups

*

Rule Path
Allow /
Disallow /nl/api/
Disallow /fr/api/

Other Records

Field Value
sitemap https://www.unique.be/nl/sitemaps/
sitemap https://www.unique.be/nl/sitemaps/default/
sitemap https://www.unique.be/nl/sitemaps/posts/
sitemap https://www.unique.be/nl/sitemaps/blogs/
sitemap https://www.unique.be/nl/sitemaps/campus/
sitemap https://www.unique.be/nl/sitemaps/sollicitatie-flow/
sitemap https://www.unique.be/nl/sitemaps/offices/