What would be faster - plugin, html or shortcode?

I'm curious if anyone has experience with refining their WordPress site to make it as fast for page loading as possible and which approaches work better than others. For example, lets take adding...