Pancreatic cancer is a devastating disease and is highly resistant to anticancer drugs because of its complex microenvironment. Cancer-associated fibroblasts (CAFs) are an important source of extracellular matrix (ECM) components, which alter the physical and chemical properties of pancreatic tissue, thus impairing effective intratumoral drug delivery and resulting in resistance to conventional chemotherapy. The objective of this study was to develop a new cancer organoid model, including a fibrous tumor microenvironment (TME) using CAFs. The CAF-integrated pancreatic cancer organoid (CIPCO) model developed in this study histologically mimicked human pancreatic cancer and included ECM production by CAFs. The cancer cell-CAF interaction in the CIPCO promoted epithelial-mesenchymal transition of cancer cells, which was reversed by CAF inhibition using all-trans retinoic acid. Deposition of newly synthesized collagen I in the CIPCO disturbed the delivery of gemcitabine to cancer cells, and treatment with collagenase increased the cytotoxic effect of gemcitabine. This model may lead to the development of next-generation cancer organoid models recapitulating the fibrous TME.