Log In Sign Up

collectplus.yodel.co.uk
robots.txt

Robots Exclusion Standard data for collectplus.yodel.co.uk

Resource Scan

Scan Details

Site Domain collectplus.yodel.co.uk
Base Domain yodel.co.uk
Scan Status Ok
Last Scan2024-06-01T03:19:22+00:00
Next Scan 2024-07-01T03:19:22+00:00

Last Scan

Scanned2024-06-01T03:19:22+00:00
URL https://collectplus.yodel.co.uk/robots.txt
Domain IPs 13.226.2.118, 13.226.2.34, 13.226.2.56, 13.226.2.7
Response IP 18.165.171.58
Found Yes
Hash bc210198a1a1a2db4db226d5f57e3da0138ef2994040d83d85309638ab4a9456
SimHash 9905c9006cd5

Groups

*

Rule Path Comment
Disallow /health -
Disallow /paypoint-callback -
Disallow /returns/paypoint-callback -
Disallow /addresses -
Disallow /orders/ UGC: orders labels
Disallow /send-a-parcel/labels -
Disallow /cs -
Disallow /404 -
Disallow /500 -
Disallow /label -
Disallow /collected -
Disallow /collectplus-default -
Disallow /collectplus-logged-in -
Back to top

Other Records

Field Value
sitemap https://www.collectplus.yodel.co.uk/sitemap-collectplus.xml.gz
sitemap https://www.collectplus.yodel.co.uk/video-sitemap-collectplus.xml
Back to top

Comments

  • Callbacks
  • Private
  • Disallow: /api #sadly we need this for google understanding angular pages
  • Angular - robots.txt is the only place that allows us to "easily" block angular pages
  • System
  • PHP
  • Storyblok Preview
Back to top