If the kick starter rotates then yes, stop riding, and replace the lay shaft bearing, else you and your bike will be sliding down the road together and no manner of pulling in the clutch will help you.
However if it is end float that's a different story.
End float is normal, I had end float in mine but it was a bit excessive.
It caused no dramas normally, except occasionally it would jump out of first gear and into neutral in the most undesirable places.
It would drop out when I back off the throttle.
You know when going around a tight mountain switch back corner, leaning over as far as you dare, then back off a little, and then its in neutral.
It is about this time that the laws of gravity, inertia and the pendulum effect take over and you find your self lying on the road, bike beside you, or on top depending on how unlucky you are.
But just to keep me on my toes it only did it ever now and then. I'm sure it waited until I was relaxed before it did the got you.
Any way I shimmed the shaft and it has now been a few years without the boogie man returning.
Cheers
Peter R