On a Riemannian spin manifold with parallel skew torsion, we use the twistor operator to obtain an eigenvalue estimate for the Dirac operator with torsion. We consider the equality case in dimensions four and six. In odd dimensions we describe Sasaki manifolds on which equality in the estimate is realized by Killing spinors with torsion. In dimension five we characterize all Killing spinors with torsion and obtain certain naturally reductive spaces as exceptional cases.