Eastern religions, unlike Western religions, are actually philosophies. Their temples, though places of worship, are also places of reflection. Eastern religions are also more individual focused, so it is very difficult to effectively demonstrate fanaticism in Eastern traditions. In India, many of the temples are not only a place for convening with gods but conversing with dead ancestors or even just thinking. As such, India's temples are an important part of its cultural heritage.
The temples of India are an example of cultural heritage. Thousands of years of worship and community have existed in those temples, and to ever lose them would be giving up the symbols of those thousands of years. Religion has long been an important part of cultures the world over.