Well, my hunt for public-domain era music continues. I'm focusing on orchestral marches, dances, symphonies and similar in true Victoria I fashion so the player wouldn't be bored to tears

. If somebody would point to me such (public-domain) performances I'd appreciate it.
Regarding eastern music: I think jumping from Western music straight to Ottoman music would break immersion a little bit

. On the other hand, it's not that hard to find eastern influenced western music for this era(check Strauss II's Persian and Egyptian Marches for example).