I don't disagree with anything you've said, but some conservative culture warriors go much further:
1) The question at the heart of the Ahmari-French debate was whether the government (including the federal government!) should have the power to ban drag queen story hour, not whether libraries had a right not to host them (a right which I agree with).
2) Some of the drag show bans being considered would apply to all public property where minors can potentially see it. This could mean that a drag queen performing in a park for adults (but where kids could potentially see it) could become illegal, with criminal penalties under state law.
3) We really need to differentiate between the normal application of freedom of association (which I fully support) from the intrusive extension of government power into areas of everyday life, to the detriment of individual freedom and/or local decision making (which we must oppose).