pbtech.com
robots.txt

Robots Exclusion Standard data for pbtech.com

Resource Scan

Scan Details

Site Domain pbtech.com
Base Domain pbtech.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-06-06T12:10:19+00:00
Next Scan 2025-09-04T12:10:19+00:00

Last Successful Scan

Scanned2024-11-02T06:59:00+00:00
URL https://pbtech.com/robots.txt
Redirect https://www.pbtech.com/robots.txt
Redirect Domain www.pbtech.com
Redirect Base pbtech.com
Domain IPs 104.21.5.10, 172.67.132.182, 2606:4700:3034::ac43:84b6, 2606:4700:3036::6815:50a
Redirect IPs 104.21.5.10, 172.67.132.182, 2606:4700:3034::ac43:84b6, 2606:4700:3036::6815:50a
Response IP 172.67.132.182
Found Yes
Hash 3ae9cd9ffe66efac254886da8e4ee7b4d07c0287d91824e878810dde0d4813ee
SimHash 2340530bc4a2

Groups

*

Rule Path
Disallow /_staff/*
Disallow /my-account/*
Disallow /*myaccount*
Disallow /basket/*
Disallow /shipping/*
Disallow /billing/*
Disallow /confirm-order/*
Disallow /process-order/*
Disallow /order-complete/*
Disallow /*basket$
Disallow /*shipping$
Disallow /*billing$
Disallow /*confirm-order$
Disallow /*process-order$
Disallow /*order-complete$
Disallow /pdf_soin.php*
Disallow /cameras.php*
Disallow /games.php*
Disallow /xmlrpc.php*
Disallow /extprint.php*
Disallow /search*
Disallow /code/*.php*
Allow /

adsbot-google

Rule Path
Allow /search*

mediapartners-google

Rule Path
Allow /search*

facebookbot

Rule Path
Disallow /new-arrival*
Allow /search*

facebookexternalhit

Rule Path
Disallow /new-arrival*

facebot

Rule Path
Disallow /new-arrival*

amazonbot

Rule Path
Disallow /new-arrival*

Comments

  • robots.txt for http://www.pbtech.co.nz/
  • list disallows
  • ads and social share allows