Preheat the oven to 425 degrees. In a covered dish with a lid, whisk together the water, cornmeal, salt and pepper. Cover and bake for 30 minutes*, stirring halfway through.
Remove from the oven and add the milk, butter, and marjoram, if desired. Whisk quickly until the polenta is smooth and creamy. Serve immediately. Enjoy!