images.autotrader.com
robots.txt

Robots Exclusion Standard data for images.autotrader.com

Resource Scan

Scan Details

Site Domain images.autotrader.com
Base Domain autotrader.com
Scan Status Ok
Last Scan2024-08-30T05:23:47+00:00
Next Scan 2024-09-29T05:23:47+00:00

Last Scan

Scanned2024-08-30T05:23:47+00:00
URL https://images.autotrader.com/robots.txt
Domain IPs 108.156.133.122, 108.156.133.129, 108.156.133.58, 108.156.133.59, 2600:9000:2755:2200:6:249c:1640:93a1, 2600:9000:2755:3000:6:249c:1640:93a1, 2600:9000:2755:4000:6:249c:1640:93a1, 2600:9000:2755:6800:6:249c:1640:93a1, 2600:9000:2755:6a00:6:249c:1640:93a1, 2600:9000:2755:7c00:6:249c:1640:93a1, 2600:9000:2755:aa00:6:249c:1640:93a1, 2600:9000:2755:d000:6:249c:1640:93a1
Response IP 108.156.133.122
Found Yes
Hash f5ecc932c98a90c76da7de1359c10a1a9cce1452adcd3dfc78ffdf60d8ee37ac
SimHash b516f8550d34

Groups

*

Rule Path
Disallow /auction
Disallow /auction3
Disallow /auction_old
Disallow /auctionimages
Disallow /bestpractices
Disallow /bkup_no_cache
Disallow /cms
Disallow /imagefs
Disallow /img
Disallow /pictures
Disallow /test
Disallow /users
Disallow /images/2002
Disallow /images/2003
Disallow /images/2004
Disallow /images/2005
Disallow /images/2006
Disallow /images/2007
Disallow /images/2008
Disallow /images/auction
Disallow /images/bestpractices
Disallow /images/dealers
Disallow /images/direct
Disallow /images/ds
Disallow /images/marketing
Disallow /images/intelli_thumb
Disallow /images/intellichoice
Disallow /images/original
Disallow /images/preview_tool
Disallow /images/product
Disallow /images/syc
Disallow /images/user_guide

Comments

  • Only allow access to the /images directory
  • Disallow: /images
  • Only allow access to the /images/consumersite directory for sitemaps
  • Disallow: /images/consumersite