There is a lot of free play in my rear brake pedal. I think it is being caused by the hole in the frame where the bolt goes through having worn so much that it has become too big for the bolt
Pull it apart and see what is moving and or wearing. If I recall correctly, when everything is together correctly the lever moves but the pivot should stay fixed and tight.