Banks should lower their dependence on bulk deposits, which are typically of higher tenor and better-priced than retail liabilities, if they want to protect their margins and profitability especially in a higher interest rates regime, Reserve Bank deputy governor Swaminathan J said on Thursday.