Starter extensions can be shared with end users on a free plan, whereas Advanced extensions are only shareable on a paid plan (which plan is required depends on the extension). Advanced extensions can still be created on a free plan, but only for internal testing. This way, you can ensure that the extension fits your use case before committing to a subscription.
Starter extensions offer basic functionality, whereas Advanced extensions offer all functionality.