outline
You can use AWS ALB with multiple certificates on same the HTTPS port 443.
requirement
AWS ACM with multiple certificates
AWS Route53
AWS ALB
how-to
ACM
ALB
Listener
HTTP redirect to HTTPS 443
HTTPS(443) >>>> Certificates, add multiple certificates
Host Based Routing
Route53
reference
https://aws.amazon.com/blogs/aws/new-application-load-balancer-sni/