I bought an XJ650 back in '83 - and had it until a year ago. I had actually gone to the Yamaha dealer to buy an XS650, but he had this leftover '82 XJ for the same price - $1999 OTD. It was a fantastic bike - 4 cylinder, shaft drive, 5 speed - and served me well for over 20 years, but seemed dull after getting the Triumph.
Once I had the Speed Triple, the XJ only got ridden a couple times a month. Once the Norton was in the garage, that was it. I sold the XJ to a kid who needed cheap transportation - he loves it.
Now the Triumph and the Norton each get about 1/2 my riding time.