Ulthuan and Naggarond cannot be traversed or interacted with but they are still there
The terrain itself matters little in performance terms; what usually slugs the game down are playable provinces full of rulers, courts and characters.
But yeah, both Winter King and Warhammer mods have really awful performance.