Except in a calm or in shallow waters where the galley (or more often, galleys) could pummel the ship of the line at will.
Even then, the galley (talking here about an early game galley, with few or no guns - not just any stray ship of the type "galley") would be a much flimsier ship (so much more vulnerable to hits), with a few old guns, and a crew limited in size. Very, very difficult fight.
If we bring in numbers, I would contend that with a significant number advantage canoes could certainly take many early types of light ships, transports and galleys. Carracks probably not because of the sheer size difference - boarding the one boat from the other would be likely too much of a hurdle. (Caravels, ironically enough, would be easier, but that's because caravels are miscategorized as big ships)