Windows > Dockable Dialogs > Palettes

Click on the tiny black arrow icon in the dialog next to Palettes. Choose Palettes Menu > New Palette

Use the foreground colour changer in the toolbox to choose a new colour, click and drag the colour from "current" into your new palette. Repeat until you have all the colours you want.