While it is the seller who remits the fee, the reality is the money comes from the buyer. Changing who sees the fee might help things but in the end it is buyers who pay for everything in just about all markets. Brokers love it when they can get one party to be the actual payer, and another party to be the negotiator of the fee, because that usually is a win for the broker.