Coconut milk will have a cool and soothing effect on the mouth ulcers that will help them cool down. Make sure you use chilled coconut milk for the purpose.
Remedy:
Gargle with coconut milk twice or thrice daily, this will make the immense pain of ulcers go away in no time. You can also fill your mouth with coconut milk and swish it around for about 5 minutes.