When there is no interval intersection between intersections with x planes and intersections with y planes, we know that the ray misses the box.