professionalsupplementcenter.com
robots.txt

Robots Exclusion Standard data for professionalsupplementcenter.com

Resource Scan

Scan Details

Site Domain professionalsupplementcenter.com
Base Domain professionalsupplementcenter.com
Scan Status Ok
Last Scan2024-10-01T06:29:40+00:00
Next Scan 2024-10-31T06:29:40+00:00

Last Scan

Scanned2024-10-01T06:29:40+00:00
URL https://professionalsupplementcenter.com/robots.txt
Redirect https://www.professionalsupplementcenter.com/robots-psc.txt
Redirect Domain www.professionalsupplementcenter.com
Redirect Base professionalsupplementcenter.com
Domain IPs 104.26.12.79, 104.26.13.79, 172.67.72.153, 2606:4700:20::681a:c4f, 2606:4700:20::681a:d4f, 2606:4700:20::ac43:4899
Redirect IPs 125.56.219.17, 125.56.219.18
Response IP 125.56.219.17
Found Yes
Hash 38f469fe79f7b207a7f453daa3bf408ebaffcad1e3d3f5af5a0e838582cf0de2
SimHash 690ccc875f92

Groups

*

Rule Path
Disallow */custitem*
Disallow */price*
Disallow */newReview*
Disallow */fragrance/*
Disallow */filter-brands/*
Disallow */flavors/*
Disallow */specialty/*
Disallow */color/*

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.professionalsupplementcenter.com/sitemap_www.professionalsupplementcenter.com_Index.xml