That's a part of it, yes. There are particular motions required to direct the energy used for a spell into the correct pattern, as well as an incantation and particular mental focus in order to shape and activate it. If any one of those elements is missing, casting a spell would be impossible.