This is just the same principle as private organization boards of directors delegating the minutia of running the organization to the executives and their teams. If you think it would be madness for hiring decisions on individual contributors to be made by board votes, then you should support the delegation of rule-making authority to executive agencies.
Yes, it means that changing the executive might change the rules. Congress remains free to overrule the agencies by passing further legislation, if they so desire. And voters remain free to replace the executive the next time around, if they want to see different rules. These are all features, not bugs.
There is certainly value in stability and predictability, but there is even more value in having an executive branch of government that is empowered to make decisions quickly and a short feedback loop between the public and the government.
It isn't, because the board can replace the executive leadership at any time, whereas the President can only be replaced every four years and isn't elected by the legislature whatsoever, bypassing checks and balances.
The proper way to delegate minutia to an administrative agency is to have them propose rules that Congress then votes on. The rules might be a thousand pages long and 99.9% uncontroversial, so those rules get rubber stamped, but controversial changes have to go through the political process because it gives Congress the opportunity to refuse.
> Congress remains free to overrule the agencies by passing further legislation, if they so desire.
But that's not how it works, because now you've inverted the default. Before you needed a majority of the House and Senate and the President's signature in order to make a change. Now you need all that to undo the change a President makes unilaterally -- implying that the President would veto it and the legislature would need a veto-proof majority. It's not the same thing at all and is handing too much power to the executive branch.
> There is certainly value in stability and predictability, but there is even more value in having an executive branch of government that is empowered to make decisions quickly and a short feedback loop between the public and the government.
There is value in allowing the executive branch to remove bad rules unilaterally, in the same way as the President can veto a bill. Allowing new rules to be created without the appropriate process is tyrannical.