The don't "pop out of nowhere" - the problem is your mesh topology. See these vertices here, indicated in yellow:
Those vertices make the large face into a nasty n-gon, and so Blender has to add extra geometry to render it.
See for example this: Subdivision problem during modeling
To fix it, you need to connect those edge vertices to something, whether it's making more edges along the face or something similar.