In a large mixing bowl, whisk together the eggs, milk, heavy cream, granulated sugar, brown sugar, vanilla extract, cinnamon, nutmeg (if using), and salt. Make sure everything is well combined. The custard should smell heavenly at this point, thanks to the vanilla and spices.