Pretty as it is, I’d be inclined to dig it out and sort out the grouting to make the slabs firm and safe - wobbly pavers could become a slip/fall hazard.
If you like the thyme (which I do), put some in a pot. It will spill over the edge, look very pretty and attract the bees and other insects when in flower, plus you can use it in your cooking.
Either buy some, or try lifting the thyme you have growing between your pavers with some roots attached and pot it up. I did that with some errant mint once and it is now happily growing in a small trough.