Congress had accused the Narendra Modi government of "surrendering" India's strategic interests to China and "woefully compromising" national security.
Congress leader P Chidambaram too had questioned Modi's silence on the border issue.
Rahul Gandhi announced on Wednesday that he has resigned as the Congress President.
Congress leaders including Rahul Gandhi, Sonia Gandhi and Manmohan Singh visited the memorial of India's first woman prime minister.