bestproductsreviews.com
robots.txt

Robots Exclusion Standard data for bestproductsreviews.com

Resource Scan

Scan Details

Site Domain bestproductsreviews.com
Base Domain bestproductsreviews.com
Scan Status Ok
Last Scan2024-11-11T08:53:30+00:00
Next Scan 2024-11-18T08:53:30+00:00

Last Scan

Scanned2024-11-11T08:53:30+00:00
URL https://bestproductsreviews.com/robots.txt
Redirect https://www.bestproductsreviews.com:443/robots.txt
Redirect Domain www.bestproductsreviews.com
Redirect Base bestproductsreviews.com
Domain IPs 45.60.240.15, 45.60.250.15
Redirect IPs 45.60.244.15
Response IP 45.60.244.15
Found Yes
Hash 4a193036d697d1e2a3569aadfe35ead2f02cf588de5c38e478ac492780b7d8f0
SimHash 60d559648353

Groups

googlebot

Rule Path
Disallow /p/
Disallow /p/*
Disallow /remote/*
Disallow /redirect*
Disallow /*?sort=
Disallow /*?brands=
Disallow /*?conditions=
Disallow /*?sellers=
Disallow /js/visit-enrich
Disallow /user-action
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

gptbot

Rule Path
Disallow

*

Rule Path
Disallow /p/
Disallow /p/*
Disallow /remote/*
Disallow /redirect*
Disallow /*?sort=
Disallow /*?brands=
Disallow /*?conditions=
Disallow /*?sellers=
Disallow /user-action
Disallow /panel/words-to-remove
Disallow /panel/words-to-remove/modify