In a blender, combine the diced mangoes, coconut milk, honey or maple syrup, lime juice, and vanilla extract. Blend until smooth and creamy.
Taste the mixture and adjust sweetness if necessary by adding more honey or maple syrup.
Pour the mango mixture into popsicle molds, leaving a little space at the top for expansion.
Insert sticks into the molds and place them in the freezer. Freeze for at least 4-6 hours, or until completely solid.
To release the popsicles, run warm water over the outside of the molds for a few seconds, then gently pull out the popsicles.