With WP Empire Builder, do I need to register a new domain, if I want a new child site to be on its own domain?

Yes. You will still need to register a domain, as usual, and point its nameservers to your host.

You won't need to add the domain or addon domain to your cPanel though. WP Empire Builder will do this automatically.