Using Blender 2.92.0
It seems this issue is kind of interesting. I've adjusted the font sizes to where they seem usable for me, great :) However loading up a saved file *.blend file and the UI elements in Blender itself get changed. Is there a way to get Blender to not resize its own UI settings when loading a drawing? Or save off the portion of the UI settings and only load them or merge/replace them in the saved drawing file?
Expected: Blender's UI fonts remain to a user's settings/preferences.