digispot.co.uk
robots.txt

Robots Exclusion Standard data for digispot.co.uk

Resource Scan

Scan Details

Site Domain digispot.co.uk
Base Domain digispot.co.uk
Scan Status Ok
Last Scan2025-09-21T17:24:46+00:00
Next Scan 2025-10-21T17:24:46+00:00

Last Scan

Scanned2025-09-21T17:24:46+00:00
URL https://digispot.co.uk/robots.txt
Domain IPs 104.21.52.171, 172.67.201.145, 2606:4700:3033::ac43:c991, 2606:4700:3035::6815:34ab
Response IP 172.67.201.145
Found Yes
Hash 36592b1778321202124a66a5c25c19922d1af271b3cb11b6205ead0a6b41106f
SimHash 3b44ff06efc0

Groups

*

Rule Path
Disallow /*uid%3D
Disallow /*OrderNumber%3D
Disallow /*function%3D*
Disallow /*function%3DCART
Disallow /*function%3DCHECKOUT
Disallow /*function%3DSEARCH
Disallow /*function%3Dsearch
Disallow /*function%3DCHECKOUTFIELDS
Disallow /*function%3Dcheckoutfields
Disallow /*function%3DWEBPAGE
Disallow /*function%3Dwebpage
Disallow /*function%3DDISPLAYCAT
Disallow /*function%3Ddisplaycat
Disallow /*function%3DEMAILTOFRIEND
Disallow /*function%3Demailtofriend
Disallow /*function%3DPAYMENTCOMPLETE
Disallow /*function%3Dpaymentcomplete
Disallow /*function%3DTERMS
Disallow /*function%3Dterms
Disallow /*function%3DIFRAME
Disallow /*function%3Diframe
Disallow /*function%3DMAILPASS
Disallow /*function%3Dmailpass
Disallow /*function%3D*404*
Disallow /*function%3DPRODUCTIMAGEWINDOW
Disallow /paymentgateways/out.asp
Disallow /paymentgateways/in.asp
Disallow /*?404*
Disallow /*wp-admin*

Other Records

Field Value
crawl-delay 10

Comments

  • Robots.txt file
  • All robots will spider the domain