Line a 9x13-inch pan with parchment paper. Spray lightly with cooking spray.
In a large pot, start to melt ¼ cup butter over medium-low heat. Once melted quickly add 5 cups of the mini marshmallows to the butter, stirring often.
Once the marshmallows are almost melted, turn the heat to low.
Add ½ teaspoon of vanilla and the red food coloring, a few drops at a time, and mix well. Continue to add food coloring until desired color.
Remove from heat. Mix in 4 cups of the cereal. Stir until the cereal is well coated. Pour into the parchment lined pan.
Spread evenly while pressing down firmly, and smooth the top using the back of a buttered spoon or buttered wax paper.
Repeat the same process, but leave the second batch white. Pour the white batch on top of the red layer. Press down and smooth evenly.
Repeat the process one more time with the blue food coloring. Place on top of the white layer. Press firmly and smooth out the top layer.
Allow to cool completely at room temperature. Do not refrigerate.
Remove the treats from the pan (use a knife to cut around the edges if needed). Peel off the parchment paper and place on a cutting board.
Cut the treats into star shapes using a 3 inch star cookie cutter. If the cutter isn’t deep enough to completely reach the bottom of the pan, create an indentation with the cutter to use as a stencil, and then cut it out completely using a knife.
You will have leftover rice krispie treats. You can use a smaller cutter to make more star treats.