Hold the Alt key before releasing the mouse (Alt+Drop) to ignore the highlighted drop target (group):