Log In Sign Up

backpackerjobboard.com.au
robots.txt

Robots Exclusion Standard data for backpackerjobboard.com.au

Resource Scan

Scan Details

Site Domain backpackerjobboard.com.au
Base Domain backpackerjobboard.com.au
Scan Status Ok
Last Scan2024-11-12T02:39:16+00:00
Next Scan 2024-11-19T02:39:16+00:00

Last Scan

Scanned2024-11-12T02:39:16+00:00
URL https://backpackerjobboard.com.au/robots.txt
Redirect https://www.backpackerjobboard.com.au/robots.txt
Redirect Domain www.backpackerjobboard.com.au
Redirect Base backpackerjobboard.com.au
Domain IPs 172.66.41.2, 172.66.42.254, 2606:4700:3108::ac42:2902, 2606:4700:3108::ac42:2afe
Redirect IPs 172.66.41.2, 172.66.42.254, 2606:4700:3108::ac42:2902, 2606:4700:3108::ac42:2afe
Response IP 172.66.42.254
Found Yes
Hash fdd849a11e841571619610cfce36c8d385ebb830a694c6ad285be25afe89b930
SimHash 32151e62fa67

Groups

*

Rule Path
Disallow /_includes
Disallow /_includes/smarty
Disallow /_templates
Disallow /post/
Disallow /search
Disallow /search/*
Disallow /report-spam/
Disallow /widgets/
Disallow /uploads/
Disallow /uploads/*
Disallow /uploads/applicants
Disallow /uploads/applicants/*
Disallow /uploads/resumes
Disallow /uploads/resumes/*
Disallow /uploads/media/resumes
Disallow /uploads/media/resumes/*
Disallow /uploads/media/applicants
Disallow /uploads/media/applicants/*
Disallow /upload/
Disallow /upload/*
Disallow /jobs-in/*/feed/
Disallow /jobs-in/*/feed
Disallow /jobs-in/*/fulltime/
Disallow /jobs-in/*/parttime/
Disallow /jobs-in/*/casual/
Disallow /jobs-in/*/temp/
Disallow /jobs-in/*/permanent
Disallow /jobs-in/*/fulltime
Disallow /jobs-in/*/parttime
Disallow /jobs-in/*/casual
Disallow /jobs-in/*/temp
Disallow /jobs-in/*/permanent
Disallow /jobs-in-other-cities/
Disallow /jobs-in-other-cities/*/fulltime/
Disallow /jobs-in-other-cities/*/parttime/
Disallow /jobs-in-other-cities/*/casual/
Disallow /jobs-in-other-cities/*/temp/
Disallow /jobs-in-other-cities/*/permanent
Disallow /jobs-in-other-cities/*/fulltime
Disallow /jobs-in-other-cities/*/parttime
Disallow /jobs-in-other-cities/*/casual
Disallow /jobs-in-other-cities/*/temp
Disallow /jobs-in-other-cities/*/permanent
Disallow /jobs/*/fulltime/
Disallow /jobs/*/parttime/
Disallow /jobs/*/casual/
Disallow /jobs/*/temp/
Disallow /jobs/*/permanent/
Disallow /jobs/0
Disallow /jobs/0/
Disallow /jobs/0/*
Disallow /companies/
Disallow /companies
Disallow /reset-password/
Disallow /logout/
Disallow /register/employer/
Disallow /register/backpacker/
Disallow /subscribe/
Disallow /resend-activation-link/
Disallow /manage/
Disallow /profile/
Disallow /orders/
Disallow /packages/
Disallow /applications/
Disallow /update-email/
Disallow /jobs/*/feed/
Disallow /jobs/*/feed
Allow /jobs-in/sydney/casual/
Allow /jobs-in/sydney/part-time/
Allow /postcode-checker/

grapeshot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /uploads/
Back to top

Other Records

Field Value
sitemap https://www.backpackerjobboard.com.au/sitemap.xml
sitemap https://www.backpackerjobboard.com.au/sitemapXMLJobs.xml
sitemap https://www.backpackerjobboard.com.au/sitemapXMLTax.xml
sitemap https://www.backpackerjobboard.com.au/sitemapXMLEmployers.xml
Back to top