www.collectplus.yodel.co.uk
robots.txt

Robots Exclusion Standard data for www.collectplus.yodel.co.uk

Resource Scan

Scan Details

Site Domain www.collectplus.yodel.co.uk
Base Domain yodel.co.uk
Scan Status Ok
Last Scan2024-11-05T00:27:21+00:00
Next Scan 2024-11-19T00:27:21+00:00

Last Scan

Scanned2024-11-05T00:27:21+00:00
URL https://www.collectplus.yodel.co.uk/robots.txt
Domain IPs 3.164.85.15, 3.164.85.65, 3.164.85.97, 3.164.85.99
Response IP 18.244.87.27
Found Yes
Hash bc210198a1a1a2db4db226d5f57e3da0138ef2994040d83d85309638ab4a9456
SimHash 9905c9006cd5

Groups

*

Rule Path Comment
Disallow /health -
Disallow /paypoint-callback -
Disallow /returns/paypoint-callback -
Disallow /addresses -
Disallow /orders/ UGC: orders labels
Disallow /send-a-parcel/labels -
Disallow /cs -
Disallow /404 -
Disallow /500 -
Disallow /label -
Disallow /collected -
Disallow /collectplus-default -
Disallow /collectplus-logged-in -

Other Records

Field Value
sitemap https://www.collectplus.yodel.co.uk/sitemap-collectplus.xml.gz
sitemap https://www.collectplus.yodel.co.uk/video-sitemap-collectplus.xml

Comments

  • Callbacks
  • Private
  • Disallow: /api #sadly we need this for google understanding angular pages
  • Angular - robots.txt is the only place that allows us to "easily" block angular pages
  • System
  • PHP
  • Storyblok Preview