Place potatoes in a pot and cover with water. Boil until potatoes are cooked, about 10-15 minutes.
Drain potatoes and allow potatoes to cool.
When potatoes are cool, combine potatoes, celery, and onion in a large bowl.
Drizzle with oil and vinegar. Mix to combine.
Season with salt and pepper.
At this point it is a good time to go ahead and taste the potato salad. Add more oil and/or vinegar if needed.
Salad can be kept at room temperature or in the fridge until ready to serve. Mix in bacon just before serving.
Although this is best eaten the day of, you can store leftovers in an airtight container in the fridge.