It's important that while we keep in mind the ethical considerations of minorities there is also an ethical consideration of marginalized users of financial capital, who are denied credit because banks are unable to afford them a lower rate due to lacking information.
This isn't a black-and-white choice between including peripheral information into credit lending. When banks and lenders make a deliberate decision to ignore information that could allow them to be more accurate with lending, those costs are passed down to users - and although it may not hurt the typical HN user, marginalized credit-seekers can literally have their hopes of home-ownership or education denied because of a bank's choice to be ignorant but considerate. Neither choice is completely without consequences.
This isn't a black-and-white choice between including peripheral information into credit lending. When banks and lenders make a deliberate decision to ignore information that could allow them to be more accurate with lending, those costs are passed down to users - and although it may not hurt the typical HN user, marginalized credit-seekers can literally have their hopes of home-ownership or education denied because of a bank's choice to be ignorant but considerate. Neither choice is completely without consequences.