gardiner.com
robots.txt

Robots Exclusion Standard data for gardiner.com

Resource Scan

Scan Details

Site Domain gardiner.com
Base Domain gardiner.com
Scan Status Ok
Last Scan2025-09-13T10:43:25+00:00
Next Scan 2025-10-13T10:43:25+00:00

Last Scan

Scanned2025-09-13T10:43:25+00:00
URL https://gardiner.com/robots.txt
Redirect https://www.gardiner.com/robots.txt
Redirect Domain www.gardiner.com
Redirect Base gardiner.com
Domain IPs 159.223.216.165
Redirect IPs 94.247.142.1
Response IP 94.247.142.1
Found Yes
Hash 000fe1639a60c951fc2a1bfcfb5c866d165607205e375a0edd763fa0b5b04ad6
SimHash 8b148d3a9b70

Groups

*

Rule Path
Disallow /craft/

jooblebot

Rule Path
Disallow /

Comments

  • Don't allow web crawlers to index Craft CMS
  • Don't allow the JoobleBot to crawl any job vacancies
  • User-agent: Jooblebot
  • User-agent: jooblebot
  • User-agent: jooble
  • User-agent: jooble.org