sjs.co.nz
robots.txt

Robots Exclusion Standard data for sjs.co.nz

Resource Scan

Scan Details

Site Domain sjs.co.nz
Base Domain sjs.co.nz
Scan Status Ok
Last Scan2025-04-03T22:57:04+00:00
Next Scan 2025-04-10T22:57:04+00:00

Last Scan

Scanned2025-04-03T22:57:04+00:00
URL https://sjs.co.nz/robots.txt
Domain IPs 104.21.69.183, 172.67.211.125, 2606:4700:3034::ac43:d37d, 2606:4700:3035::6815:45b7
Response IP 104.21.69.183
Found Yes
Hash e0e6512d033b0b6346a89db78c8a21256e1aa952f77f86a217945deea18d232f
SimHash 60255ed38716

Groups

*

Rule Path
Disallow /wp-admin
Allow /wp-admin/admin-ajax.php
Disallow /user-dashboard
Disallow /apply
Disallow /af-page
Disallow /user-forgot-password
Disallow /user-reset-password
Disallow /user-reset-email
Disallow /jobs/jobs
Disallow /jobview
Allow /af-page/create-job-alert
Allow /jobview/*/*
Disallow /job-seeker/account/
Disallow /job-seeker/forgot-password/
Disallow /job-apply/
Allow /job-seeker/jobs/
Allow /job-details/

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.sjs.co.nz/sitemaps.xml
sitemap https://www.sjs.co.nz/sitemaps.xml

Comments

  • Custom AF Rules
  • ============================
  • Default / site specific via virtual robots.txt
  • ============================
  • Custom AFP Rules
  • ============================
  • Default / site specific via virtual robots.txt
  • ============================