no, jiro, that is precisely how you start the game without loading steam.
you can after that direct join other games.
however, if it did not bring you any upsides, your issues probably have nothing to do with steam.
the issues you can have with steam is the steam lobby, used for game search and connection to the host or the steam overlay. it is however a separate step and connection.
if you start the game without steam, naturally you have no server browser, you can however direct join other games, but might not be able to get into games where the host is behind a firewall.
imagine steam to be a bridge you got to cross to get to the other game, without steam you have to swim. unfortunately if you connect by steam, a separate connection to that service is being kept alive, which is probably why some people have issues with it (e.g. if their internet is not that good), or as said its just about the overlay.