My E46 was doing the same...
Google it, and trust me, if that unit breaks apart, (mine it was the DISA flap that was loose and worn out) the parts get sucked into the engine, and the flap is held by a metal pin in my cars case, so I just opted to replace the unit. Was R2500 at Goldwagen
Good luck