In the current development of my own Blender AMV, I answered a similar question in another post. Have a look and see if this helps.
Tips for creating an animated music video?
Read through it before continuing to read this answer.
Once you map out your song with the drum beat and place it in Blender, you can scrub through your drum track and manually animate the lights. I know that you can keyframe their values, meaning you won't spend as much time animating each light.
And an idea to go with that is to copy and paste keyframes in the dope sheet. That will save you some time instead of manually keying each value.
Be aware that your framerate must match the beats per minute of your song, otherwise syncing will be off and you'll end up with a headache. To avoid this problem, determine the BPM of your song here. https://getsongbpm.com/tools/audio
Once you have the BPM, calculate the frames per beat here. https://www.vjamm.com/support_av_bpm.php%3Flang=en.html
Adjust the value of the framerate until the frames per beat is a whole number. Then you can adjust your framerate in Blender to match with the one shown when you determined your frames per beat.
From there, start animating!
Hope this helps!