At least for anything statically linked where the GPL code would end up as part of your binary and force you to GPL your own code I believe.

Anything more lax is fine, so you could also release your code under MIT license if you use GPL modules. Yes, it does force you to release your code but after all it’s a protection for the user.