alljobsfresh.com
robots.txt

Robots Exclusion Standard data for alljobsfresh.com

Resource Scan

Scan Details

Site Domain alljobsfresh.com
Base Domain alljobsfresh.com
Scan Status Ok
Last Scan2024-11-16T18:17:23+00:00
Next Scan 2024-11-23T18:17:23+00:00

Last Scan

Scanned2024-11-16T18:17:23+00:00
URL https://www.alljobsfresh.com/robots.txt
Domain IPs 142.250.4.121, 2404:6800:4003:c11::79
Response IP 64.233.170.121
Found Yes
Hash a8abf24ecb23d0fb7858a7ca05717e6547e0d92243bedd63f8eb25d42eade096
SimHash 6905d013c693

Groups

*

Rule Path
Disallow /search
Disallow /LABLES
Disallow /lables
Allow /
Allow /

Other Records

Field Value
sitemap https://www.alljobsfresh.com/sitemap.xml
sitemap https://www.alljobsfresh.com/atom.xml