You can delete a Private Health Group only if you are the one who created it.
Click on "Learn&Discuss" and then select "Private Health Group"
Select the Private Health Group you would like to delete from the left hand side of your screen
Select "Settings" from the list of tabs above the group wall
Click on the grey "Delete Group" buton