It depends on the app. Some apps, like Chrome, will not disable if they are open in the background or if they are set to sync across devices.