Why not skip the middleman? If AIs can manage large groups of people effectively, why not have them directly perform labor instead?

Why not skip the middleman? If AIs can manage large groups of people effectively, why not have them directly perform labor instead?