cleanpix.com
robots.txt

Robots Exclusion Standard data for cleanpix.com

Resource Scan

Scan Details

Site Domain cleanpix.com
Base Domain cleanpix.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2026-03-01T08:23:25+00:00
Next Scan 2026-03-02T08:23:25+00:00

Last Successful Scan

Scanned2026-01-30T08:23:11+00:00
URL https://cleanpix.com/robots.txt
Redirect https://www.cleanpix.com/robots.txt
Redirect Domain www.cleanpix.com
Redirect Base cleanpix.com
Domain IPs 172.66.41.28, 172.66.42.228, 2606:4700:3108::ac42:291c, 2606:4700:3108::ac42:2ae4
Redirect IPs 172.66.41.28, 172.66.42.228, 2606:4700:3108::ac42:291c, 2606:4700:3108::ac42:2ae4
Response IP 172.66.41.28
Found Yes
Hash c1fa504d2e89d55251af234a46eb12b6c9af372df91bc91b4feb4ffe30ec0e2e
SimHash 477cddb2c21b

Groups

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 240

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 240

yahoo-slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 240

baiduspider
baiduspider-video
baiduspider-image
mj12bot
ahrefsbot
blexbot
amazonbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.cleanpix.com/sitemap.txt