The photograph of a monk in a Tamil daily stole his heart; he was thrilled by the speeches of the monk. It was none other than Swami Vivekananda, the Lion of Vedanta. Sri Naidu was overwhelmed by the essence of Sawamiji's message. The service mentality in him began to bloom. He gave away all his wealth to the poor around. He memorised Swamiji's speeches. Clad in saffron and sporting a turban, he dressed up like Swamiji and reproduced these speeches in Tamil, with verve and gusto to an ever-increasing audience. He would conclude, "So said Swami Vivekananda in America". It was much later that he came to know of Sri Ramakrishna.

Thus was sown the seed of the Ramakrishna Order in North Arcot District of Tamil Nadu out of the many Vivekananda Societies started by Sri Naidu and his friends, the one at Nattarampalli alone has become a full-fledged Math.

Three singularly like-minded brothers, Sri C. Samundi Gounder, Sri R.Thayappa Gounder, Sri R C Hanumantha Gounder and Sri R C Vadigi Gounder donated a piece of land. A small building was erected with the financial assistance of Rs 500/- each from Sarva Sri Venkatasamy Naidu, Chamundi Gounder, Mylarampatti Gounder, Thayappa Gounder and Rangasamy Naidu. Today the Math is a sprawling complex of more than three acres.