I SHOULD charge, and I would if I had enough annual plugin fees. I got ACF Pro when it was one-off, WP All Import/Export is one-off, I got GF when it was only $100 annual renewal.
Basically, I’m not paying so much in fees. Most other plugins I have the client purchase.
I think the general logic is that you either roll extra fees into your project, and intend to have enough new projects to pay for it continually, or, you bill.
If I was going to start having a lot of fees for plugins/themes/etc, I would let clients know in the beginning of the project (ie in the proposal) that there are recurring fees involved in having a website: hosting, domain, email, and plugins/themes. I have a discount which they can sign up for to receive these plugins through me for $X per year, or they can purchase them independently for $X per year, and be able to use them on other sites they own.
I DO include a line in my terms that says that I am not responsible to maintain licenses for premium products for more than 1 year post the start date of the project.