hellodirect.com
robots.txt

Robots Exclusion Standard data for hellodirect.com

Resource Scan

Scan Details

Site Domain hellodirect.com
Base Domain hellodirect.com
Scan Status Ok
Last Scan2024-09-06T07:08:14+00:00
Next Scan 2024-10-06T07:08:14+00:00

Last Scan

Scanned2024-09-06T07:08:14+00:00
URL https://www.hellodirect.com/robots.txt
Domain IPs 23.215.7.11, 23.215.7.23
Response IP 125.56.219.3
Found Yes
Hash 351dbcb703b31b5c3ce62505e54582224247e8b0793b4782bcbf34a0d606ed34
SimHash 310128a2ab9a

Groups

*

Rule Path
Disallow /shopflow/

*

Rule Path
Disallow /assets/tools/

*

Rule Path
Disallow /pfizerny

*

Rule Path
Disallow /pfizerny/

Comments

  • block internal tools from being crawled
  • block new Pfizer-only page
  • block new Pfizer-only directory