Recent years have witnessed the rise of pathomics as a mean to describe histopathological images with quantitative biomarkers for predictive and prognostic ends, combining digital pathology, omic science and artificial intelligence. This novel research branch is the counterpart of radiomics which pursues the same aims extracting knowledge from radiological images. In this paper, we present the design of a pathomic deep learning-based system to predict the treatment outcome in non-small cell lung cancer patients. We describe the system design and optimization under the condition of limited data and limited training, with corresponding tests. The experimental results show the feasibility of the proposed scalable architecture providing also a comparison between different transfer learning strategies.