yourfirm.de
robots.txt

Robots Exclusion Standard data for yourfirm.de

Resource Scan

Scan Details

Site Domain yourfirm.de
Base Domain yourfirm.de
Scan Status Ok
Last Scan2024-09-08T20:45:11+00:00
Next Scan 2024-09-22T20:45:11+00:00

Last Scan

Scanned2024-09-08T20:45:11+00:00
URL https://yourfirm.de/robots.txt
Redirect https://www.yourfirm.de/robots.txt
Redirect Domain www.yourfirm.de
Redirect Base yourfirm.de
Domain IPs 54.93.41.209
Redirect IPs 13.226.2.105, 13.226.2.126, 13.226.2.47, 13.226.2.81, 2600:9000:2792:1800:a:8063:2c40:93a1, 2600:9000:2792:400:a:8063:2c40:93a1, 2600:9000:2792:5400:a:8063:2c40:93a1, 2600:9000:2792:9c00:a:8063:2c40:93a1, 2600:9000:2792:aa00:a:8063:2c40:93a1, 2600:9000:2792:d000:a:8063:2c40:93a1, 2600:9000:2792:e400:a:8063:2c40:93a1, 2600:9000:2792:ea00:a:8063:2c40:93a1
Response IP 13.226.2.105
Found Yes
Hash 0414d4e12714209465c8e6727524db5d29933ba3fffab9cc7ced78b99a85930e
SimHash f281ff632ff0

Groups

*

Rule Path
Disallow /s/
Disallow /p/
Disallow /stellenangebote/plain/
Disallow /tam17az1/
Disallow /job/inline/
Disallow /job/app/
Disallow /job/jobheader-full/
Disallow /job/jobheader-ref-num/
Disallow /job/plain/
Disallow /suche/all*
Disallow /job/full/
Disallow /job/reference/
Disallow /job/bare/
Disallow /job/xing/
Disallow /jobs*offset%3D
Disallow /stellenangebote*offset%3D
Disallow /jobangebote*offset%3D
Disallow /stellen*offset%3D

Warnings

  • `host` is not a known field.