essentialits.com
robots.txt

Robots Exclusion Standard data for essentialits.com

Resource Scan

Scan Details

Site Domain essentialits.com
Base Domain essentialits.com
Scan Status Ok
Last Scan2025-10-17T01:43:39+00:00
Next Scan 2025-11-16T01:43:39+00:00

Last Scan

Scanned2025-10-17T01:43:39+00:00
URL https://essentialits.com/robots.txt
Redirect https://www.essentialits.com/robots.txt
Redirect Domain www.essentialits.com
Redirect Base essentialits.com
Domain IPs 75.2.32.4
Redirect IPs 75.2.32.4
Response IP 75.2.32.4
Found Yes
Hash e3bbe3c104289d28c661b8bf1615976f9cf1d91a11ede9e8e1d4c3ba85e82d2c
SimHash 67159450c531

Groups

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /cdn-cgi/

Other Records

Field Value
sitemap https://www.essentialits.com/sitemap.xml