Explanation: This phrase comes from a popular way of getting agreement, which is "buy in." For example, a company director can say, "we need buy in from all the board members to proceed." In this statement, "buy in" is getting agreement. Therefore, if you "don't buy it," then you are not agreeing.