Segmentation plays an important role in low level image analysis and understanding. Basically, it involves the identification of regions with the same texture features .The further analysis can be performed on the respective regions alone. Due to its simplicity and performance, many people have applied it to a number of different applications such as analysis of remote sensing images, industrial monitoring of product quality, medical image analysis, and image retrieval. In this paper, Segmentation algorithm is applied for intelligent based driver for driving vehicles to avoid obstacles. Computers become a part of our real life. Educated persons, Business Magnets waste most of their time in driving (Four-wheeler) vehicles to reach the destinations on time to accomplish their goals. If they were allowed to do some useful work while driving, it will be a great boon. During night times many accidents take place due to driver’s negligence. It can be avoided if vehicle can be driven with intelligent based driver which is developed by software. This Paper describes how the intelligent based driver can be developed and the usage of it.