As far as I know, the sideboard is only for cards that you have due to clothing, wands, and amulets. You can't rearrange these cards and you can only remove them by removing the item you are currently wearing. This is also true with changing the contents. If you want something new in the sideboard, change what you're wearing or change wands. Each item list how many cards will be given.