This study identified color emotion factors of naturally dyed two-color combination fabrics focused on yellowish and reddish shades to examine the relationship between color emotion factors and physical colorimetric variables (as well as tone combination groups) to provide prediction models for color emotion factors of naturally dyed fabrics with a two-color combination. Each of eight different stimuli were prepared by paring two pieces of silk fabrics colored in red and yellow by natural dyeing respectively; in addition, their color emotion descriptors were evaluated by human subjects using semantic deferential scales. ``Joyful``, ``Natural``, ``Classical``, and ``Soft`` were extracted as color emotion factors for the naturally dyed yellowishreddish combination fabrics. They were found to be significantly affected by physical colorimetric variables such as CIE C* and L* and tone combination groups. Finally, prediction models for all color emotion factors were established using physical colorimetric variables and tone combination groups that led to the conclusion that they could be applicable to design a color combination for naturally dyed fashion fabrics.