Archive Loop - Custom sorting for grouping

Hi it would be great if there was a way to sort the groupings when "Group by taxonomy" is enabled. I am currently using this feature to group items by category, but am not able to sort the categories alphabetically for example of even give it a specified order number. Currently, the sorting seems to be random.