productpine.com
robots.txt

Robots Exclusion Standard data for productpine.com

Resource Scan

Scan Details

Site Domain productpine.com
Base Domain productpine.com
Scan Status Ok
Last Scan2025-03-24T00:10:27+00:00
Next Scan 2025-04-23T00:10:27+00:00

Last Scan

Scanned2025-03-24T00:10:27+00:00
URL https://productpine.com/robots.txt
Domain IPs 104.21.70.21, 172.67.217.240, 2606:4700:3035::6815:4615, 2606:4700:3036::ac43:d9f0
Response IP 104.21.70.21
Found Yes
Hash f64eadbf583346d5d9c846ff44611cfc54a67753b7f0f6b95b4944cf6d1fbdd3
SimHash 681518d7c305

Groups

*
adsbot-google

Rule Path
Allow /
Disallow /orders*
Disallow /*/orders*
Disallow /account*
Disallow /*/account*
Disallow /search*
Disallow /*/search*
Disallow /collections*
Disallow /*/collections*

Other Records

Field Value
crawl-delay 10

googlebot
googlebot-image

Rule Path
Allow /
Disallow /orders*
Disallow /*/orders*
Disallow /account*
Disallow /*/account*
Disallow /search*
Disallow /*/search*
Disallow /collections*
Disallow /*/collections*

Other Records

Field Value
sitemap https://productpine.com/sitemap.xml