Log In Sign Up

job-in.uk
robots.txt

Robots Exclusion Standard data for job-in.uk

Resource Scan

Scan Details

Site Domain job-in.uk
Base Domain job-in.uk
Scan Status Ok
Last Scan2025-06-25T19:45:22+00:00
Next Scan 2025-07-02T19:45:22+00:00

Last Scan

Scanned2025-06-25T19:45:22+00:00
URL https://www.job-in.uk/robots.txt
Domain IPs 104.21.69.51, 172.67.204.229, 2606:4700:3031::6815:4533, 2606:4700:3034::ac43:cce5
Response IP 172.67.204.229
Found Yes
Hash 8e5850b7dff5acf37081f45f705ccf112834c2cbfbacc6d5a1a4904cf7d1304a
SimHash 406c94c0c739

Groups

mediapartners-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile-apps

Rule Path
Allow /

adidxbot

Rule Path
Allow /

*

Rule Path
Disallow /oc-admin/
Disallow /adpointer/
Disallow /display/
Disallow *pattern%2C*
Disallow *contact?v=*
Disallow *sShowAs*
Disallow *sOrder%2Ci_price*
Disallow *iPage*
Disallow *job/mark*
Disallow *job/send-friend*
Disallow *item-prev*
Disallow *item-next*
Disallow *page%3Dajax*
Disallow *languages*

bingbot

Rule Path
Disallow *sFeed%2Crss*

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

geedoproductsearch

Rule Path
Disallow /

dotbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.job-in.uk/map-cit
sitemap https://www.job-in.uk/map-img
sitemap https://www.job-in.uk/map-img?p=GR_jobs-3.xml.gz
sitemap https://www.job-in.uk/map-img?p=RO_jobs-3.xml.gz
sitemap https://www.job-in.uk/map-img?p=SG_jobs-1.xml.gz
sitemap https://www.job-in.uk/map-img?p=SA_jobs-9.xml.gz
sitemap https://www.job-in.uk/map-img?p=SG_jobs-11.xml.gz
sitemap https://www.job-in.uk/map-img?p=SA_jobs-3.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-79.xml.gz
sitemap https://www.job-in.uk/map-img?p=SA_jobs-20.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-66.xml.gz
sitemap https://www.job-in.uk/map-img?p=ID_jobs-11.xml.gz
sitemap https://www.job-in.uk/map-img?p=JP_jobs-28.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-25.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-36.xml.gz
sitemap https://www.job-in.uk/map-img?p=JP_jobs-23.xml.gz
sitemap https://www.job-in.uk/map-img?p=JP_jobs-35.xml.gz
sitemap https://www.job-in.uk/map-img?p=AE_jobs-16.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-14.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-41.xml.gz
sitemap https://www.job-in.uk/map-img?p=GR_jobs-1.xml.gz
sitemap https://www.job-in.uk/map-img?p=TH_jobs-0.xml.gz
sitemap https://www.job-in.uk/map-img?p=CL_jobs-0.xml.gz
sitemap https://www.job-in.uk/map-img?p=AE_jobs-17.xml.gz
sitemap https://www.job-in.uk/map-img?p=PA_jobs-0.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-18.xml.gz
sitemap https://www.job-in.uk/map-img?p=QA_jobs-4.xml.gz
sitemap https://www.job-in.uk/map-img?p=JP_jobs-47.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-86.xml.gz
sitemap https://www.job-in.uk/map-img?p=AE_jobs-9.xml.gz
sitemap https://www.job-in.uk/map-img?p=AE_jobs-11.xml.gz
sitemap https://www.job-in.uk/map-img?p=JP_jobs-44.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-58.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-24.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-27.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-70.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-50.xml.gz
sitemap https://www.job-in.uk/map-img?p=GT_jobs-1.xml.gz
sitemap https://www.job-in.uk/map-img?p=SA_jobs-28.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-75.xml.gz
sitemap https://www.job-in.uk/map-img?p=JP_jobs-10.xml.gz
sitemap https://www.job-in.uk/map-img?p=KE_jobs-0.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-100.xml.gz
sitemap https://www.job-in.uk/map-img?p=RO_jobs-0.xml.gz
sitemap https://www.job-in.uk/map-img?p=DK_jobs-0.xml.gz
sitemap https://www.job-in.uk/map-img?p=SA_jobs-29.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-5.xml.gz
sitemap https://www.job-in.uk/map-img?p=AE_jobs-13.xml.gz
sitemap https://www.job-in.uk/map-img?p=JP_jobs-16.xml.gz
sitemap https://www.job-in.uk/map-img?p=LU_jobs-0.xml.gz
sitemap https://www.job-in.uk/map-img?p=NG_jobs-1.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-83.xml.gz
sitemap https://www.job-in.uk/map-img?p=JP_jobs-19.xml.gz
sitemap https://www.job-in.uk/map-img?p=SG_jobs-4.xml.gz
sitemap https://www.job-in.uk/map-img?p=JP_jobs-38.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-32.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-60.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-46.xml.gz
sitemap https://www.job-in.uk/map-img?p=SG_jobs-14.xml.gz
sitemap https://www.job-in.uk/map-img?p=JP_jobs-4.xml.gz
sitemap https://www.job-in.uk/map-img?p=CO_jobs-0.xml.gz
sitemap https://www.job-in.uk/map-img?p=SG_jobs-16.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-31.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-11.xml.gz
sitemap https://www.job-in.uk/map-img?p=EC_jobs-0.xml.gz
sitemap https://www.job-in.uk/map-img?p=BH_jobs-0.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-34.xml.gz
sitemap https://www.job-in.uk/map-img?p=JP_jobs-32.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-95.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-22.xml.gz
sitemap https://www.job-in.uk/map-img?p=SG_jobs-18.xml.gz
sitemap https://www.job-in.uk/map-img?p=JP_jobs-50.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-52.xml.gz
sitemap https://www.job-in.uk/map-img?p=QA_jobs-5.xml.gz
sitemap https://www.job-in.uk/map-img?p=SG_jobs-23.xml.gz
sitemap https://www.job-in.uk/map-img?p=PK_jobs-16.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-71.xml.gz
sitemap https://www.job-in.uk/map-img?p=ID_jobs-6.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-43.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-38.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-26.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-47.xml.gz
sitemap https://www.job-in.uk/map-img?p=AE_jobs-6.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-13.xml.gz
sitemap https://www.job-in.uk/map-img?p=JP_jobs-24.xml.gz
sitemap https://www.job-in.uk/map-img?p=SA_jobs-0.xml.gz
sitemap https://www.job-in.uk/map-img?p=SG_jobs-5.xml.gz
sitemap https://www.job-in.uk/map-img?p=HU_jobs-2.xml.gz
sitemap https://www.job-in.uk/map-img?p=BE_jobs-7.xml.gz
sitemap https://www.job-in.uk/map-img?p=GT_jobs-0.xml.gz
sitemap https://www.job-in.uk/map-img?p=JP_jobs-9.xml.gz
sitemap https://www.job-in.uk/map-img?p=JP_jobs-33.xml.gz
Back to top

Comments

  • crawl-delay: 30
  • DaumWebMasterTool:88daf99681e9d147db9e51dafd87e4cdb2b924ebb2c56c3c50f1764ca013e812:elCazkMJjYjxKQyXLeIlvw==
Back to top