Demolishers were accompanied by Vilnius police officers and representatives of Vilnius Municipality.
The Inspectorate also said it had identified another 12 illegal structures, and their owners would be ordered to remove them.
The parliamentary Committee on Human Rights said in a statement on Monday the demolition process was carried out without violations of fundamental human, children rights and were observed by all responsible institutions.
Five habitable and one non-habitable structures were demolished on December 2-3, 2004 on the initiative of the then Vilnius Mayor Arturas Zuokas. In 2010, the Supreme Administrative Court of Lithuania ordered to pay LTL 55,600 (EUR 15,877) in non-pecuniary damages to Roma people, although it acknowledged the fact that the structures had been built illegally.