The lords did own the land, but expelling the serfs could not be done simply by telling the serfs to leave. There was a large accumulation that was forced on the serfs. Feudalism was a fundamentally distinct class society from capitalism.