Gems can be slotted into weapons with the appropriate slots.
They currently are only cosmetic.
It is planned in the future that they will give bonuses. Specifics yet unknown.
There are 3 shapes and 3 colors currently in the game. Red, Blue, and Green 9 different gems in total.