envirobuild.com
robots.txt

Robots Exclusion Standard data for envirobuild.com

Resource Scan

Scan Details

Site Domain envirobuild.com
Base Domain envirobuild.com
Scan Status Ok
Last Scan2025-10-23T22:10:27+00:00
Next Scan 2025-11-06T22:10:27+00:00

Last Scan

Scanned2025-10-23T22:10:27+00:00
URL https://envirobuild.com/robots.txt
Redirect https://www.envirobuild.com/robots.txt
Redirect Domain www.envirobuild.com
Redirect Base envirobuild.com
Domain IPs 76.76.21.21
Redirect IPs 104.21.36.248, 172.67.201.103, 2606:4700:3036::ac43:c967, 2606:4700:3037::6815:24f8
Response IP 172.67.201.103
Found Yes
Hash c12f4cbe647e7539827b0f5c9d6925bb5d9596de5562b69b84ad6c17f35f98bc
SimHash 6d5c9e40f1d0

Groups

*

Rule Path
Disallow */search?*
Disallow */cart
Disallow */account
Disallow */wishlist

adsbot-google

Rule Path
Disallow */search?*
Disallow */cart
Disallow */account
Disallow */wishlist

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow */search?*
Disallow */cart
Disallow */account
Disallow */wishlist

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

Rule Path
Disallow */search?*
Disallow */cart
Disallow */account
Disallow */wishlist

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap /sitemap.xml
sitemap /sitemap.xml
sitemap /sitemap.xml
sitemap /sitemap.xml

Comments

  • Google adsbot ignores robots.txt unless specifically named!