This feels like we could get the time complexity of a hash table if we control grid resolution to maintain invariants on the number of primitives in a voxel.