I would like to add an edge loop around each one of these windows and are not 100% sure on the best way to do it even after watching some videos.
If someone could point me in the right direction that would be great. Thanks.
Blender Stack Exchange is a question and answer site for people who use Blender to create 3D graphics, animations, or games. It only takes a minute to sign up.Sign up to join this community
Avoid NGons, and avoid Boolean operations, you topology is not quad-dominant and you wont be able to easily add edgeloops anywhere with ngons like those around the windows. in fact you will likely have a hard time doing anything at all with your current model.
Ideally your mesh should be made primarily of faces with four sides, use Ctrl+R to add edge loops, use Ctrl+B to bevel, use E to extrude, and abuse of modifiers.
In your case I am guessing a Mirror modifier would help with symmetry, a Subdivision Surface would help with smoothing/curving, and an array might help with multiple windows.