A superlative combination of the Board of Directors (BOD) with diverse members is considered a sign of a good governance structure. Meanwhile, the key decision taken by BOD to make organizations profitable is the capital structure with the optimal mix of debt and equity. Unfortunately, previous literature has reported this relationship with a mixed trend, which may be due to research gaps in the statistical analysis. Moreover, it also shows that the relationship between them has not yet been fully predicted and can still be completely understood. This study contains time-variant and time-invariant variables, and these variables usually have an outlier's problem. As we know that the OLS estimators are more sensitive to react adversely to this problem, yet we have not received enough evidence from similar researches that cares about it. Consistent with these arguments, this study focuses primarily on exploring the influence of corporate governance structure and the capital structure on firms' market-oriented and accounting-based performance, especially with the contemplation of outliers. Hypotheses have been evaluated using M-estimators and S-estimators of robust regression for 45 listed firms for the period from 2013 to 2017. The findings reveal that the governance structure of firms with BOD, independent director, institutional investors, audit committee and female directors accelerates its performance. Further, we find that the leverage ratio improves accounting performance, but it has a downward impact on the share prices of listed firms. Our study contributes to the prevailing literature by proving that the kind of governance structure that based on diverse expert members and a capital structure with a high volume of debt is of utmost importance to the performance of firms as a whole.