industrymedics.com
robots.txt

Robots Exclusion Standard data for industrymedics.com

Resource Scan

Scan Details

Site Domain industrymedics.com
Base Domain industrymedics.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-08-02T15:01:05+00:00
Next Scan 2024-10-31T15:01:05+00:00

Last Successful Scan

Scanned2024-01-06T14:59:14+00:00
URL https://industrymedics.com/robots.txt
Domain IPs 104.21.87.81, 172.67.142.130, 2606:4700:3034::6815:5751, 2606:4700:3034::ac43:8e82
Response IP 104.21.87.81
Found Yes
Hash 10e4a28c71fdce0091aa7ccfc96820189f55bceb50e3d4ddc33acc9c80c72649
SimHash 286cc8c48590

Groups

*

Rule Path
Disallow

googlebot

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

go-http-client

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

appengine

Rule Path
Disallow /

grabber

Rule Path
Disallow /

kraken

Rule Path
Disallow /

Other Records

Field Value
sitemap https://industrymedics.com/sitemap.xml

Warnings

  • `host` is not a known field.