ostjob.ch
robots.txt

Robots Exclusion Standard data for ostjob.ch

Resource Scan

Scan Details

Site Domain ostjob.ch
Base Domain ostjob.ch
Scan Status Ok
Last Scan2024-06-09T14:38:51+00:00
Next Scan 2024-06-16T14:38:51+00:00

Last Scan

Scanned2024-06-09T14:38:51+00:00
URL https://ostjob.ch/robots.txt
Redirect https://www.ostjob.ch/robots.txt
Redirect Domain www.ostjob.ch
Redirect Base ostjob.ch
Domain IPs 159.69.143.71
Redirect IPs 159.69.143.71
Response IP 159.69.143.71
Found Yes
Hash fdb413a26566bd4a526c374130f92ea0b770b3cc4dea1c364d3cb1edd41e11f3
SimHash 7b08db5f19d3

Groups

x28-job-bot

Rule Path
Disallow /

burroboot

Rule Path
Disallow /

toweya

Rule Path
Disallow /

jobsearch

Rule Path
Disallow /

jorgee

Rule Path
Disallow /

seoscanners

Rule Path
Disallow /

jobroboter

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /api
Disallow /vacancy/topjobs
Disallow /export
Disallow /minisite
Disallow /fm1today
Disallow /job/preview

Other Records

Field Value
sitemap http://www.ostjob.ch/sitemap.xml