Latvia's Foreign Minister Krisjanis Karins announced Thursday he will step down amid a criminal probe of his office's usage of expensive private flights during his time served as prime minister.