If you remove a follow option from your site (follow form, follow icons etc.) then it means that new users cannot follow you anymore. Existing users who already signed up still receive the notifications.

If you want to stop that, please delete your feed.