The drones crashed near the city of Kouvola, about 200 kilometers northeast of Helsinki, the ministry said, adding that the Finnish Defence Forces are investigating the incident together with other authorities.
Finnish Prime Minister Petteri Orpo told Finnish state broadcaster Yle that the drones likely came from Ukraine, which has been conducting attacks on Russian territory along the border with Finland.
Earlier on Sunday, the Finnish Defence Forces deployed fighter jets to southeastern Finland as Ukraine mounted drone attacks on Russian oil ports in the Gulf of Finland.
This story is being updated.