Central venous catheters (CVCs) are generally required for chemotherapy in patients with acute leukemia, but catheter-related infection is one of the common causes of neutropenic fever. We investigated the in-hospital mortality according to early removal of CVCs and the factors influencing the mortality in patients with acute leukemia undergoing remission induction chemotherapy. This study retrospectively analyzed the hospital record data of 278 patients with acute leukemia treated with non-tunneled CVCs and remission induction chemotherapy in a single institution. Bloodstream infection was more common (p < 0.0001) and median peak C-reactive protein (CRP) levels after neutropenic fever were significantly higher (23.3 vs. 14.5 mg/dl, p = 0.003) in the group with early removal than in the group with maintenance of the CVC. Multivariate analysis of the patients revealed a significant decrease in the mortality with female gender (odds ratio (OR): 0.19, 95% confidence interval (CI): 0.06–0.54, p = 0.002) and a significant increase in the mortality according to the peak CRP (OR 1.12, 95% CI: 1.07–1.17, p < 0.0001). By contrast, early removal of the CVC had no significant effect on the mortality (OR = 1.16, 95% CI: 0.54–2.47, p = 0.706) in univariate analysis. Furthermore, subsequent bloodstream infection after clinical decision for maintenance or early removal of the CVC was confirmed more frequently in the group with early removal (early removal, 22.6%; maintenance, 7.6%, p < 0.0001). Early removal of the CVC had no benefit regarding the mortality and prophylaxis of bloodstream infection in patients with acute leukemia undergoing remission induction chemotherapy. Therefore, maintaining a CVC for as long as possible may be considered, if catheter-related bloodstream infection is not strongly suspected.