I feel doubtful that the scenario involves taxes as you describe them.

Under a manor, polity and production are fully integrated. Each peasant takes a share the harvest, and may have entitlements for the commons, while the rest falls under control of the lord and his house.