Managing contacts with contact groups