deals.bleepingcomputer.com
robots.txt

Robots Exclusion Standard data for deals.bleepingcomputer.com

Resource Scan

Scan Details

Site Domain deals.bleepingcomputer.com
Base Domain bleepingcomputer.com
Scan Status Ok
Last Scan2024-04-25T09:58:03+00:00
Next Scan 2024-05-25T09:58:03+00:00

Last Scan

Scanned2024-04-25T09:58:03+00:00
URL https://deals.bleepingcomputer.com/robots.txt
Domain IPs 18.205.76.234, 3.215.68.77, 34.197.11.185
Response IP 3.215.68.77
Found Yes
Hash 2a0e9ebaec4dc8db206b82bbb04165d4f2ed322aa51dbe3d60ddd4b92be139bd
SimHash 687549932013

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

*

Rule Path
Disallow /300250/
Disallow /300250
Disallow /checkout
Disallow /orders
Disallow /paypal_checkout
Disallow /paypal_authorization_callback
Disallow /paypal_cancel_callback
Disallow /fb-product-feed
Disallow /fb-stitcher-feed
Disallow /tmp