Does Your ‘Agent Governance’ End Up Governing Everything But The Agent Itself?