It's okay to say not yet/ that's not the best time of day/ sorry we are going to have to cancel, or just no to visitors. Visitors in the those early days of having baby can be a bit of a love hate thing. There are moments where you can't wait for people to meet baby. There are moments where you, baby and partner just want to hide away/ figure out feeding or just get some kip whilst baby is sleeping. Both of these are okay. What's important is recognising what is best for your new little family and going with that.
When visitors do come it's also okay if they are the ones who make the tea, bring food, you are in your night clothes and the house is a mess. The people coming to see you in those early days are the people who should be wanting to look after you all.
You do not need to be the hosts with most!