You are correct that intermediaries are not necessary with DEXs, but I think you are forgetting other important "details". The commissions of the Ethereum chain are very high when working with a DEX, another negative point is that at any time liquidity can be withdrawn and all users can lose their funds, it would not be the first time that a "Dev" takes all the money and disappears.