Harry Potter was physically abused

Fame Abuse For Harry Potter: Did Dumbledore Vote Right?

Dumbledore himself has this Harry in Harry Potter and the Order of the Phoenix explained . Dumbledore tells Harry that he knew his choice was between abuse and fame. Then he goes on to say that he believes the choice he made - keeping Harry with the Dursleys - was the right one.

The optional

“You arrived at Hogwarts five years ago, Harry, safely and just as I planned and intended. Well - not quite. You suffered. I knew you would when I left you on your aunt and uncle's front door. I knew that I sentenced you to ten dark and difficult years.1

Not really a choice

“One could ask - and for good reason - why it had to be that way. Why couldn't a wizarding family take you in? Many would have been more than happy to do so, would have been honored and delighted to raise you as a son.
My answer is that my priority was to keep you alive.... "1

Dumbledore had no choice at this point 2 , the Death Eaters would be after Harry. He also believed that Voldemort wasn't really was gone; that he would come back and try to kill Harry.

So protecting Lily's victim outweighed any other option for Harry's safety. For which wizarding family could Harry protect if Dumbledore didn't believe that even he could:

I knew that even my most complex and powerful wards and spells would not be invincible if he [Voldemort] were ever to return to full strength. 1

The result
Dumbledore goes on to state that he's proud of the way Harry turned out:

“So five years ago,” Dumbledore went on as if he hadn't paused in his story, “you arrived at Hogwarts, neither as happy nor as well fed as I might have wished, but still alive and well . You weren't a spoiled little prince, just as normal a boy as I would have hoped given the circumstances. So far my plan has worked well.
"And then ... well, you will remember the events of your first year at Hogwarts as well as I did. You faced the challenge you faced splendidly, and sooner - much earlier - than I expected, you stood face to face with Voldemort. You survived again. You did more. You delayed his return to full strength and vigor. You fought a man's fight.I was ...prouder of you than i can say . 1

The result - explained
There is evidence that Harry's greatest strength is his character 3, 4 was . This is crucial as the story sums up how Harry's overwhelming love defeats hatred for Voldemort.

Harry endures hardship, mostly from the Dursleys, and in turn becomes a patient and caring person. He is often referred to as "remarkable" and "exceptional" not only because of his accomplishments but also because of himself Character :

[Dumbledore]: "I never thought I'd have such a person in my hands ..."
"You may be young, but you have proven that you are exceptional. ..." 1

We see this from the start when he refuses to get along with Draco Malfoy 5 and immediately befriended Ron Weasley.

Harry is compared and quite similar to his father on many occasions, but what James didn't have was the same selfless character Harry had - from the start. Would James have done the same things Harry ended up doing? Would Harry have done the same if he'd grown up a "jock" like his father?

At the end chooses Harry put his friends and family in front of himself 6 - a choice that not everyone can or would make. That makes him special.

1.Harry Potter and the Order of the Phoenix, chapter 37 (The Lost Prophecy).[All added emphases are mine]

2. Like Zibbobs highlighted