jobs2careers.com
robots.txt

Robots Exclusion Standard data for jobs2careers.com

Resource Scan

Scan Details

Site Domain jobs2careers.com
Base Domain jobs2careers.com
Scan Status Ok
Last Scan2024-10-12T11:35:50+00:00
Next Scan 2024-10-19T11:35:50+00:00

Last Scan

Scanned2024-10-12T11:35:50+00:00
URL https://www.jobs2careers.com/robots.txt
Domain IPs 3.215.208.10, 44.213.144.111, 54.147.12.116, 67.202.14.177
Response IP 44.213.144.111
Found Yes
Hash cd88a36a6eeca8fe5efa62d76ac4a11b2ac1fbce1f556a511442f4a02e8933a0
SimHash 0b243bb7c010

Groups

adidxbot
adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
mediapartners-google

Rule Path
Allow /
Disallow /admin/
Disallow /alert_manage.php
Disallow /api/
Disallow /chat_bot/
Disallow /click.php
Disallow /explore.php
Disallow /glassdoor/
Disallow /job_count.php
Disallow /job_info.php
Disallow /jobs.php
Disallow /local/
Disallow /results.php
Disallow /track.php
Disallow /u/
Disallow /unsubscribe.php

*
bingbot
googlebot
googlebot-image
googlebot-mobile
googlebot-news
msnbot-media
slurp

Rule Path
Allow /
Allow /index.php?bad_l
Disallow /*%26education%3D*
Disallow /*%26experience%3D*
Disallow /*%26jobtype%3D*
Disallow /?&l=*
Disallow /?q=*
Disallow /admin/
Disallow /alert_manage.php
Disallow /api/
Disallow /chat_bot/
Disallow /click.php
Disallow /explore.php
Disallow /glassdoor/
Disallow /index*.php
Disallow /job_count.php
Disallow /job_info.php
Disallow /jobs.php
Disallow /quickapply/
Disallow /results.php
Disallow /results*.php
Disallow /track.php
Disallow /u/
Disallow /unsubscribe.php

ahrefsbot
baiduspider
semrushbot
semrushbot-sa
sogou web spider
yandexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.jobs2careers.com/sitemap_index.xml