101prices.com
robots.txt

Robots Exclusion Standard data for 101prices.com

Resource Scan

Scan Details

Site Domain 101prices.com
Base Domain 101prices.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-05-29T22:48:53+00:00
Next Scan 2025-08-27T22:48:53+00:00

Last Successful Scan

Scanned2024-11-01T22:33:25+00:00
URL https://101prices.com/robots.txt
Domain IPs 104.21.29.46, 172.67.171.101, 2606:4700:3036::ac43:ab65, 2606:4700:3037::6815:1d2e
Response IP 104.21.29.46
Found Yes
Hash 97fe71da73a4a0e3ab7c837f59e601e30ce8be10346d8e627627fcb2c9ef2c02
SimHash 805f0c73c8f3

Groups

ahrefsbot
mj12bot
rogerbot
backlinkcrawler
semrushbot
seomoz
rogerbot
dotbot
semrush
majestic12
majestic-seo
screaming frog seo spider

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /video/
Disallow /video/*
Disallow /play/
Disallow /play/*
Disallow /play_v2/
Disallow /play_v2/*
Allow /*.js$
Allow /*.css$