The first ever Diwali festival was celebrated at the U.S. Congress on Tuesday amidst chanting of Vedic mantras by a Hindu priest.