There is more to it when a user disallows an app to track your activity. From Apple and enforced in their review guidelines:

“The app is also not permitted to track your activity using other information that identifies you or your device, like your email address.”