Has anyone developed an app using a language model?

hey all – I'm looking into building in some language processing tasks into my application and was curious for any feedback on do's and do not's, any gotchas, things to consider, things that you wish you knew going into it? I don't have a ML background so I'd like to use some managed backend APIs where possible. I'll be mostly classifying text before responding to a user.

Thanks!