Confidence is more a matter of accepting yourself and being happy with who you are. If you can do that you need not worry about what others think. And you should stop worrying about things you 'might' do wrong.
Everybody has different abilities, just relax throughout your day. A busy mind is more than enough to cause fumbles and errors in mundane. Feel the task at hand.
Oh and smile
