In a medium saucepan, bring water to a boil. Place tea bags in the pan, cover with a lid and let it steep for 5 minutes. Remove the tea bags. Set aside.
In another saucepan over medium heat, warm up the milk until it just starts to steam, but not boiling. Add in sugar and all spices and stir until combined. Turn off the heat and allow mixture to sit for 5 minutes to let the flavors blend. Use a handheld frother or immersion blender to froth the milk until foamy on the surface. You can also froth the milk by shaking it in a jar for about 60 seconds.
Pour the tea into a mug or a teapot then add warm milk and stir to combine. Top with a spoonful of milk froth as desired. Sprinkle the top with ground cinnamon. Serve immediately.
Notes
*I like this slightly sweet pumpkin spice latte with just 1 tablespoon of brown sugar but you can always add a little extra if you want a sweeter drink.