Agriculture is the most important sector of the Indian economy. Rice cultivation plays an important role in many regions of India. Most farmers in India are fully dependent on rice. Early detection of diseases in rice plants plays an important role in yielding more. This paper proposes a solution to detect and classify rice plant diseases too early using automatic image processing techniques. Automatic detection uses image segmentation and neural networks for classification of plant leaves. It takes the image as input and applies techniques to that image, like pre-processing and segmentation, and then the input is given to the convolutional neural network in order to classify the disease. Most Indian farmers are not well educated to detect the disease of the plant before it gets damaged, which results in less production. Rice production has the main role in Indian economics, so adequate efforts are needed to improve it.