David Wagner was left frustrated after Huddersfield conceded a last-minute goal in the 1-0 defeat to relegation rivals Fulham.