Please offer some help to seal our windows airtight

We are living in our new house since five weeks now and when the temperature decreased the last days we discovered a defect in our windows. Six of them are neither soundprofed nor sealed airtight and we had to caulk them tentative but this is no long-term solution of course. Now we need an offer as quickly as might be most notably because of the further sinking temperatures.