California at least has quite reasonable laws on this stuff. As long as you're not doing anything shifty and you are strictly using own resources and time there's not much to worry about.

Whether you should talk to your employer mostly depends on the company you work for and the laws in your area.