How do I install barn door style closet doors when we have tall baseboards?

We want to put in barn door style closet doors, but I’m worried that the baseboards will interfere with the functionality of the doors. We could set the doors farther out, but then I’m worried that the gap between the doors and the wall will look funny. We have 5" baseboards with some decorative details, and they stick out from the wall about 1/4 inch (the same as our standard door frames). The closets are in a hallway and don’t have door frames, since the original doors were tracked, sliding doors on the interior of the frame. How do people normally deal with baseboards when installing sliding barn doors?

Each job is unique of course. But normally it is the rails and hardware that make the difference in slide and set position. Normally the trim and base are the same widths and the door rails are adjusted for fit.