Bring the water and teabags to a boil in a medium-sized pot over medium-high heat.
Add the spices, maple syrup, and vanilla extract. Stir and allow the spices to dissolve.
Remove the tea bags, add the milk, and reduce the heat to a simmer. Cook for 3 or 4 more minutes, or until the temperature of the tea is to your liking.