projectcece.com
robots.txt

Robots Exclusion Standard data for projectcece.com

Resource Scan

Scan Details

Site Domain projectcece.com
Base Domain projectcece.com
Scan Status Ok
Last Scan2025-08-08T13:41:29+00:00
Next Scan 2025-08-15T13:41:29+00:00

Last Scan

Scanned2025-08-08T13:41:29+00:00
URL https://projectcece.com/robots.txt
Redirect https://www.projectcece.com/robots.txt
Redirect Domain www.projectcece.com
Redirect Base projectcece.com
Domain IPs 104.21.58.250, 172.67.166.131, 2606:4700:3030::ac43:a683, 2606:4700:3037::6815:3afa
Redirect IPs 104.21.58.250, 172.67.166.131, 2606:4700:3030::ac43:a683, 2606:4700:3037::6815:3afa
Response IP 104.21.58.250
Found Yes
Hash e7aa278e1336fb5ca9a68e542fd8183193ce9186b393503ab570f779a551b6a2
SimHash 6d17d113c710

Groups

*

Rule Path
Disallow /goto/
Disallow /*?c=*
Disallow /*?pc=*
Disallow *size%3D*
Disallow *certificates%3D*
Disallow *certificate%3D*
Disallow *brands%3D*
Disallow *stores%3D*
Disallow *labels%3D*
Disallow *materials%3D*
Disallow *colors%3D*
Disallow *locations%3D*
Disallow *category%3D*
Disallow *subcategory%3D*
Disallow *price%3D*
Disallow *page%3D*
Disallow *limit%3D*
Disallow *sortBy%3D*
Disallow *query%3D*
Disallow /search/
Disallow /api/

Other Records

Field Value
crawl-delay 1

slurp
msnbot
bingbot
googlebot

Rule Path
Disallow /goto/
Disallow /*?c=*
Disallow /*?pc=*
Disallow *size%3D*
Disallow *price%3D*
Disallow *limit%3D*
Disallow *sortBy%3D*
Disallow *query%3D*
Disallow /search/
Disallow /api/

semrushbot

Rule Path
Disallow /catalog/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.projectcece.com/sitemap.xml