The Men Who Stare at Goats is a good review of the wacky (and occasionally deeply sinister) world of marginal military research in the US. Given the nature of the Nazi state I would be frankly surprised if someone wasn't researching something deeply fringe in an at least semi-official capacity.
Given the small cost to a massive economy like Germany's of a few a individuals doing this sort of research, and given that something like quantum mechanics is entirely indecipherable to a layman, it is probably worth having a few individuals doing this kind of research as it is probably cheaper and easier to support a small fringe than to shoot down possibly revolutionary developments just because you can't understand it. The difference between crazy and revolutionary can be hard to tell apart without hindsight (sometimes). Indeed, philosophers of science struggle to produce a satisfactory definition of science that both excludes things we don't consider science without excluding things we do.
So, did the Nazis build (or try to build) a time machine? Hell no. Was there someone trying to produce strong electromagnetic fields and plasmas to see if they could find something that could be used for a weapon, or drawing up plans for flying saucers to see if they could build better planes? Most likely yes. Was someone trying to see if time behaved normally in extreme situations (such as strong fields)? Almost certainly yes.