If we are doing importance sampling, should we take equal samples on both red and blue region, as they have the same area?

I think you should have a reason for doing importance sampling. Once you know why you are doing it, you know how to take samples. For the red blue case, I don't see a reason to do importance sampling

But the red side is noisier, maybe that is a good reason to favor the red side?