Brush the peach halves with the olive oil, then place them on the hot grill. Grill for 3-4 minutes per side, until lightly charred and just beginning to soften.
Transfer the grilled peaches to a large bowl. Drizzle with the balsamic vinegar and season with salt and pepper, to taste.
Top with feta cheese and chopped basil. Serve immediately.