Speedwalking
Imagine you're walking along at a leisurely pace. Then, glancing at your watch, you realize you're late for something. You pick up the pace, walking briskly now.
After a while, you realize that you still won't make it on time. You accelerate. Your brisk walk now qualifies for a proper Olympic speed walk.
Still, you see that time's tight. You're already walking as fast as you can. What else can you do?
You can run.
When we find ourselves in a tight spot, we often continue in our current mode with heightened intensity.
The neural network isn't learning well. Let's add more layers.
The project is late. Let's add more people to it.
The team is misaligned with business goals. Let's have more meetings about it.
Nobody is using our app. Let's add more features.
The app is slow under load. Let's split out a few more microservices.
Or you can pull back and try an entirely different approach.