In this paper, we propose a method to remove the background area by analyzing the pattern of the character area. In the character detection result of the MSER(Maximally Stable External Regions) method which distinguishes a region having a constant contrast background regions were detected. To solve this problem, we use the MSER method in natural images, the background is removed by calculating the change rate by searching the character area and the background area which are not different from the areas where the contrast values are different from each other. However, in the background removed image, using the LBP(Local Binary Patterns) method, the area with uniform values in the image was determined to be a character area and character detection was performed. Experiments were carried out with simple images with backgrounds, images with frontal characters, and images with slanted images. The proposed method has a high detection rate of 1.73% compared with the conventional MSER and MSER + LBP method.