jobinship.com
robots.txt

Robots Exclusion Standard data for jobinship.com

Resource Scan

Scan Details

Site Domain jobinship.com
Base Domain jobinship.com
Scan Status Ok
Last Scan2025-04-14T17:40:22+00:00
Next Scan 2025-04-21T17:40:22+00:00

Last Scan

Scanned2025-04-14T17:40:22+00:00
URL https://jobinship.com/robots.txt
Redirect https://www.jobinship.com/robots.txt
Redirect Domain www.jobinship.com
Redirect Base jobinship.com
Domain IPs 104.21.91.38, 172.67.209.132, 2606:4700:3034::ac43:d184, 2606:4700:3035::6815:5b26
Redirect IPs 104.21.91.38, 172.67.209.132, 2606:4700:3034::ac43:d184, 2606:4700:3035::6815:5b26
Response IP 104.21.91.38
Found Yes
Hash e24b1144e8a64c67f0c9cd2c5b2a36af63d9d0549d74968ade839abbd78c455b
SimHash c874ded2ef93

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /urgent-jobs-on-ships.html
Disallow /select-your-country.html
Disallow /companies-aphabetical-list.html
Disallow /lt-urgent-jobs-cruise-east-europe.html
Disallow /urgent-cargo-ship-jobs-australia.html
Disallow /pride-marine-agency.html
Disallow /candidates.html
Disallow /404.html
Disallow /search.html
Disallow /submit_confirm.html
Disallow /submit_confirm_company.html

Other Records

Field Value
sitemap https://www.jobinship.com/sitemap.xml