[The Doctor is poised with his sword and eyeing the opponent, of course, doesn't like being hassled more than he likes his arm being figuratively twisted behind his back with having to fight]

We could but - would they then have us both killed?

[Ten doesn't want to fight for sport entertainment either but maybe they can be clever together?]