You didn't say where you're deploying your apps to but I'm going to assume it's Azure App Service (since you said "moving to Azure"). Yes, multiple projects can be deployed using a single pipeline.
The now "legacy" way of doing this would be simply setup your build pipeline, and then setup a release pipeline with multiple stages. Each stage of your release pipeline can be one app/project.
The "modern" way that Microsoft recommends is to use the new multi-stage pipeline where you can define your build and release parameters in the same YAML template.
Here's a guide I found that shows a simple example of deploying multiple projects from a single solution to Azure App Service in Azure DevOps (this is the legacy way).
https://www.johansmarius.com/2019/10/deploying-multiple-projects-from-one_18.html
Cheers!
与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…