sojern.com
robots.txt

Robots Exclusion Standard data for sojern.com

Resource Scan

Scan Details

Site Domain sojern.com
Base Domain sojern.com
Scan Status Ok
Last Scan2024-09-04T20:07:00+00:00
Next Scan 2024-10-04T20:07:00+00:00

Last Scan

Scanned2024-09-04T20:07:00+00:00
URL https://sojern.com/robots.txt
Redirect https://www.sojern.com/robots.txt
Redirect Domain www.sojern.com
Redirect Base sojern.com
Domain IPs 75.2.70.75
Redirect IPs 13.200.123.229, 13.234.100.116, 65.0.79.182
Response IP 52.17.119.105
Found Yes
Hash ac47c326e102e5046f99f013b1abd9e516a2e574ece99884b86d27b0161f9f38
SimHash 78555e1de953

Groups

googlebot

Rule Path
Disallow /legal/
Disallow /leaders/
Disallow /channels/
Disallow /cp/
Disallow /feature-images/
Disallow /languages/
Disallow /partner/
Disallow /signup/
Disallow /success-story-review/
Disallow /categories/
Disallow /recent-terms-update/
Disallow /terms-conditions/
Disallow /tags/
Disallow /legal-archives/
Disallow /partner-dpa/
Disallow /employee-quotes/
Disallow /board-members/
Disallow /unsubscribe/
Disallow /preferences-center/

googlebot-image

Rule Path
Disallow /legal/
Disallow /leaders/
Disallow /channels/
Disallow /cp/
Disallow /feature-images/
Disallow /languages/
Disallow /partner/
Disallow /signup/
Disallow /success-story-review/
Disallow /categories/
Disallow /recent-terms-update/
Disallow /terms-conditions/
Disallow /tags/
Disallow /legal-archives/
Disallow /partner-dpa/
Disallow /employee-quotes/
Disallow /board-members/
Disallow /unsubscribe/

googlebot-mobile

Rule Path
Disallow /legal/
Disallow /leaders/
Disallow /channels/
Disallow /cp/
Disallow /feature-images/
Disallow /languages/
Disallow /partner/
Disallow /signup/
Disallow /success-story-review/
Disallow /categories/
Disallow /recent-terms-update/
Disallow /terms-conditions/
Disallow /tags/
Disallow /legal-archives/
Disallow /partner-dpa/
Disallow /employee-quotes/
Disallow /board-members/
Disallow /unsubscribe/
Disallow /preferences-center/

msnbot

Rule Path
Disallow /legal/
Disallow /leaders/
Disallow /channels/
Disallow /cp/
Disallow /feature-images/
Disallow /languages/
Disallow /partner/
Disallow /signup/
Disallow /success-story-review/
Disallow /categories/
Disallow /recent-terms-update/
Disallow /terms-conditions/
Disallow /tags/
Disallow /legal-archives/
Disallow /partner-dpa/
Disallow /employee-quotes/
Disallow /board-members/
Disallow /unsubscribe/
Disallow /preferences-center/

slurp

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /legal/
Disallow /leaders/
Disallow /channels/
Disallow /cp/
Disallow /feature-images/
Disallow /languages/
Disallow /partner/
Disallow /signup/
Disallow /success-story-review/
Disallow /categories/
Disallow /recent-terms-update/
Disallow /terms-conditions/
Disallow /tags/
Disallow /legal-archives/
Disallow /partner-dpa/
Disallow /employee-quotes/
Disallow /board-members/
Disallow /unsubscribe/
Disallow /preferences-center/

psbot

Rule Path
Disallow /legal/
Disallow /leaders/
Disallow /channels/
Disallow /cp/
Disallow /feature-images/
Disallow /languages/
Disallow /partner/
Disallow /signup/
Disallow /success-story-review/
Disallow /categories/
Disallow /recent-terms-update/
Disallow /terms-conditions/
Disallow /tags/
Disallow /legal-archives/
Disallow /partner-dpa/
Disallow /employee-quotes/
Disallow /board-members/
Disallow /unsubscribe/
Disallow /preferences-center/

*

Rule Path
Disallow /legal/
Disallow /leaders/
Disallow /channels/
Disallow /cp/
Disallow /feature-images/
Disallow /languages/
Disallow /partner/
Disallow /signup/
Disallow /success-story-review/
Disallow /categories/
Disallow /recent-terms-update/
Disallow /terms-conditions/
Disallow /tags/
Disallow /legal-archives/
Disallow /partner-dpa/
Disallow /employee-quotes/
Disallow /board-members/
Disallow /unsubscribe/
Disallow /preferences-center/

Other Records

Field Value
sitemap https://www.sojern.com/sitemap.xml