According to Swedish wikipedia. There were Wehrmacht forces in Finnmark at the time and they evacuated the locals due to Soviet air operations.
With this in mind I would still suggest that you make the connection between Northern Norway and Finland impassable. Or reduce the infrastructure to 0, or perhaps 5. Conducting division sized operations, and maintaining sufficient supply lines for a large scale invasion from the North Sea into Finland seems insane considering the terrain and the climate up there.