I don't quite understand this phenomenon

I guess it's similar to overfitting in statistics?

Is this related to Runge Kutta?