In a medium-sized pot, boil the whole potatoes in salted water for 10 minutes until they are tender but still firm.
In a small bowl, whisk together the mustard, olive oil, apple cider vinegar, and sugar.
Season the dressing with salt and pepper and add the chopped dill.
Drain the potatoes and let them cool slightly.