Due to the fact that surfactant molecules are known to alter the structure (and consequently the function) of a protein, protein–surfactant interactions are very important in the biological, pharmaceutical, and cosmetic industries. Although there are numerous studies on the interactions of albumins with surfactants, the investigations are often performed at fixed environmental conditions and limited to separate surface-active agents and consequently do not present an appropriate comparison between their different types and structures. In the present paper, the interactions between selected cationic, anionic, and nonionic surfactants, namely hexadecylpyridinium chloride (CPC), hexadecyltrimethylammonium bromide (CTAB), sodium dodecyl sulfate (SDS), polyethylene glycol sorbitan monolaurate, monopalmitate, and monooleate (TWEEN 20, TWEEN 40, and TWEEN 80, respectively) with bovine serum albumin (BSA) were studied qualitatively and quantitatively in an aqueous solution (10 mM cacodylate buffer; pH 5.0 and 7.0) by steady-state fluorescence spectroscopy supported by UV spectrophotometry and CD spectroscopy. Since in the case of all studied systems, the fluorescence intensity of BSA decreased regularly and significantly under the action of the surfactants added, the fluorescence quenching mechanism was analyzed thoroughly with the use of the Stern–Volmer equation (and its modification) and attributed to the formation of BSA–surfactant complexes. The binding efficiency and mode of interactions were evaluated among others by the determination, comparison, and discussion of the values of binding (association) constants of the newly formed complexes and the corresponding thermodynamic parameters (ΔG, ΔH, ΔS). Furthermore, the influence of the structure of the chosen surfactants (charge of hydrophilic head and length of hydrophobic chain) as well as different environmental conditions (pH, temperature) on the binding mode and the strength of the interaction has been investigated and elucidated.