As mentioned, my baked normal map is kind of weird and I don't know what caused it. I baked normal maps previously, but I'm not a pro.
I selected the high-poly mesh first, then the low-poly mesh. Low poly mesh is unwrapped.
SOLUTION:Turns out the subdivision modifier was too high. After turning it down to 2, the normal map worked!