pbtech.com
robots.txt
Robots Exclusion Standard data for pbtech.com
Resource Scan
Scan Details
Site Domain | pbtech.com |
Base Domain | pbtech.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-06-06T12:10:19+00:00 |
Next Scan | 2025-09-04T12:10:19+00:00 |
Last Successful Scan
Scanned | 2024-11-02T06:59:00+00:00 |
URL | https://pbtech.com/robots.txt |
Redirect | https://www.pbtech.com/robots.txt |
Redirect Domain | www.pbtech.com |
Redirect Base | pbtech.com |
Domain IPs | 104.21.5.10, 172.67.132.182, 2606:4700:3034::ac43:84b6, 2606:4700:3036::6815:50a |
Redirect IPs | 104.21.5.10, 172.67.132.182, 2606:4700:3034::ac43:84b6, 2606:4700:3036::6815:50a |
Response IP | 172.67.132.182 |
Found | Yes |
Hash | 3ae9cd9ffe66efac254886da8e4ee7b4d07c0287d91824e878810dde0d4813ee |
SimHash | 2340530bc4a2 |
Groups
*
Rule | Path |
---|---|
Disallow | /_staff/* |
Disallow | /my-account/* |
Disallow | /*myaccount* |
Disallow | /basket/* |
Disallow | /shipping/* |
Disallow | /billing/* |
Disallow | /confirm-order/* |
Disallow | /process-order/* |
Disallow | /order-complete/* |
Disallow | /*basket$ |
Disallow | /*shipping$ |
Disallow | /*billing$ |
Disallow | /*confirm-order$ |
Disallow | /*process-order$ |
Disallow | /*order-complete$ |
Disallow | /pdf_soin.php* |
Disallow | /cameras.php* |
Disallow | /games.php* |
Disallow | /xmlrpc.php* |
Disallow | /extprint.php* |
Disallow | /search* |
Disallow | /code/*.php* |
Allow | / |
Comments