Yes, you can use an Xbox controller plugged in without batteries. When the controller is plugged in, it will charge the batteries.
Yes, you can plug in an Xbox controller with batteries in it. The controller will work as usual, but the batteries will drain faster than if the controller were plugged into the console.