Most players won’t keep attacking if they can’t get anything:
Level up your Storehouse to protect all your resources from attack.
This mostly works but does not protect your gold (if they get past your walls).
To avoid losing your troops, tell them to hide in the sanctuary (do so in your castle).