How to tighten a wobbly door handle?

[Alexis1978]

Please help I have these unusual door handles, they don't have a outside plate to remove. How do I tighten them?? They only have the small screw/ Allen key hole on the bottom though it doesn't  seem to do anything 

 

[PSCAberfoyle]

Thanks Jacob. I got the inner part out by using small screwdriver to wedge the two apart. There was a rubber ring on the outside of the inner part.