nicejob.de
robots.txt

Robots Exclusion Standard data for nicejob.de

Resource Scan

Scan Details

Site Domain nicejob.de
Base Domain nicejob.de
Scan Status Ok
Last Scan2024-09-18T23:14:08+00:00
Next Scan 2024-09-25T23:14:08+00:00

Last Scan

Scanned2024-09-18T23:14:08+00:00
URL https://nicejob.de/robots.txt
Redirect https://www.nicejob.de/robots.txt
Redirect Domain www.nicejob.de
Redirect Base nicejob.de
Domain IPs 159.69.143.71
Redirect IPs 159.69.143.71
Response IP 159.69.143.71
Found Yes
Hash 0084337e35a54826bd769fdbe8419ba332b04c900a1ddfe03c63d6e24706fee1
SimHash 5f18db5b0953

Groups

x28-job-bot

Rule Path
Disallow /

burroboot

Rule Path
Disallow /

toweya

Rule Path
Disallow /

jobsearch

Rule Path
Disallow /

jorgee

Rule Path
Disallow /

seoscanners

Rule Path
Disallow /

jobroboter

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /ratgeber
Disallow /api
Disallow /vacancy/topjobs
Disallow /export
Disallow /minisite
Disallow /job/preview

Other Records

Field Value
sitemap http://www.nicejob.de/sitemap.xml