How do technocrat ministers affect governance under autocracy? Autocrats frequently appoint non-partisan actors with technical competencies to bureaucratic leadership roles. Though their competencies might predict positive performance in office, these ministers are also dependent on the regime for their position and should thus demonstrate loyalty to its interests. I test this in the context of horizontal accountability to the legislature, using data on more than 27,000 legislative requests submitted to ministries in Morocco. I use both exact matching and difference-in-differences analyses to show that technocrat ministers are more than 25 percentage points less likely to respond to legislative queries than partisan cabinet members. The results imply that outside (partisan) participation in government strengthens weak institutions of executive oversight. They also cast doubt on the presumption that technocrat participation in government is universally beneficial to governance.