Yes your topology is bad, ngons create these artefacts, try this topology instead (create a hole, extrude inwards and right click > LoopTools > Circle):
moonboots
- 167.7k
- 8
- 114
- 181