Because racism exists. Take Redlining for example. A lot of brown kids grew up in underprivileged environments. They were not given the same opportunities to thrive and excel as their white counterparts. This has been studied and a known fact. Colleges try to compensate. It’s an imperfect system, but at least it’s something.