justjoin.it
robots.txt

Robots Exclusion Standard data for justjoin.it

Resource Scan

Scan Details

Site Domain justjoin.it
Base Domain justjoin.it
Scan Status Ok
Last Scan2026-01-11T16:06:18+00:00
Next Scan 2026-02-10T16:06:18+00:00

Last Scan

Scanned2026-01-11T16:06:18+00:00
URL https://justjoin.it/robots.txt
Domain IPs 104.26.0.78, 104.26.1.78, 172.67.72.99, 2606:4700:20::681a:14e, 2606:4700:20::681a:4e, 2606:4700:20::ac43:4863
Response IP 172.67.72.99
Found Yes
Hash 3ddcf54f55612d783dbe9df55d45d59bb9defa4ba9648e041b9e4acf1521d90c
SimHash c92dfe071d1a

Groups

*

Rule Path
Disallow /api/
Disallow /shared-gfx/
Disallow /_styles
Disallow /_scripts
Disallow /_images
Disallow /_images-app
Disallow /templates
Disallow /_includes
Disallow /_files
Disallow /terms-and-privacy-policies
Disallow /pdf/
Disallow /devs
Disallow /admin/

Other Records

Field Value
sitemap https://justjoin.it/sitemaps/active-jobs.xml
sitemap https://justjoin.it/sitemaps/categories.xml
sitemap https://justjoin.it/sitemaps/core-pages.xml
sitemap https://justjoin.it/sitemaps/expired-jobs.xml
sitemap https://justjoin.it/sitemaps/locations-categories.xml
sitemap https://justjoin.it/sitemaps/locations.xml
sitemap https://justjoin.it/sitemaps/top-locations.xml
sitemap https://justjoin.it/sitemaps/top-companies.xml