Log In Sign Up

good-jobs.info
robots.txt

Robots Exclusion Standard data for good-jobs.info

Resource Scan

Scan Details

Site Domain good-jobs.info
Base Domain good-jobs.info
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-11T13:29:42+00:00
Next Scan 2024-12-10T13:29:42+00:00

Last Successful Scan

Scanned2024-08-13T07:54:05+00:00
URL https://good-jobs.info/robots.txt
Domain IPs 217.20.195.199
Response IP 217.20.195.199
Found Yes
Hash 7986ab2fff118426504523f541f4ba9251a7a6f0438d6dea7da4af1a93ab2392
SimHash 2d51d3a05051

Groups

googlebot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

googlebot-mobile

Rule Path
Disallow /user/*
Disallow /job/redirect/*

googlebot-image

Rule Path
Disallow /user/*
Disallow /job/redirect/*

mediapartners-google

Rule Path
Disallow /user/*
Disallow /job/redirect/*

adsbot-google

Rule Path
Disallow /user/*
Disallow /job/redirect/*

googlebot-news

Rule Path
Disallow /user/*
Disallow /job/redirect/*

googlebot-video

Rule Path
Disallow /user/*
Disallow /job/redirect/*

slurp

Rule Path
Disallow /user/*
Disallow /job/redirect/*

msnbot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

msnbot-media

Rule Path
Disallow /user/*
Disallow /job/redirect/*

applebot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

bingbot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

bingpreview

Rule Path
Disallow /user/*
Disallow /job/redirect/*

duckduckbot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

twitterbot/1.0

Rule Path
Disallow /user/*
Disallow /job/redirect/*

askjeeves

Rule Path
Disallow /user/*
Disallow /job/redirect/*

facebot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

facebookexternalhit/1.1

Rule Path
Disallow /user/*
Disallow /job/redirect/*

*

Rule Path
Disallow /
Back to top