We explore the potential for using dynamic programming (DP) and approximate dynamic programming (ADP) techniques to optimize the set points of distributed photovoltaic (DGPV) inverters under uncertainty about future DGPV deployment. We consider a case where a large $(\geq1\mathbf{MW})$ system is installed first, and growth in deployment of small rooftop systems is anticipated, but uncertain. We find that for a real feeder (EPRI's J1 feeder), a significant reduction in the number and severity of voltage violations can be expected when DP or ADP is used compared to selecting set points based on the current conditions (the traditional myopic approach). Additionally, we find that using a simple ADP algorithm, sampled backward induction, is more than twice as fast as DP with similar outcomes.