I share these feelings; I don't use JVM anywhere and so booting up IntelliJ just for art felt weird. I eventually decided to write an SVG library in TypeScript heavily inspired by the OPENRNDR API [1]. Of course, if small community is one of your concerns, then I can't help you there, as the community for my library is just me.

[1] https://github.com/ericyd/salamivg