Change the Resize Mode to Split to enable this feature.
For example, set Column Resize Mode to split. Now change the width of column A. Column B will automatically resize while the remaining columns will stay the same size.