They start to desert you.
The chance that 10% of your troops will leave goes up every 6 minutes that you don’t feed them.
If not fed, you will eventually lose enough troops to bring your upkeep in line with your production.