Once a seed has been planted in a pot or plot, it cannot be moved or picked up.
If you're swapping houses, you can either wait for your current plants to mature and harvest them one last time when they're Elder, or plow them under with the 'plow' tool spell.
