Sure, you can use markdown or html but in the latter case you have to pass pass HTML in the parse_mode field.

Let me point you to the related docs

https://core.telegram.org/bots/api#formatting-options