You need to go with your gut instincts, you know your child and you know your neighbourhood.
But for what it's worth, last year when my daughter was attending university in your city, she had an afternoon job looking after the 5 yr old son of university porfs, and he was allowed to play on the lawn, or across the street at a friend's, with her keeping an eye on him from the window whle studying, and he wasn't allowed to cross the street without her or another adult there.
To me, the hallmark of a good place to raise your kids is one where you can holler down the street for them to come home at suppertime. I thought we were extremely fortunate to have that for our kids (in suburban Cape Town and rural New Brunswick); our friends in Toronto certainly didn't live like that. So I am gratified to hear how many of you feel that same level of confidence in/have chosen your neighbourhoods for your kids to have the same thing. It makes the whole world a less scary place. (With traffic proofing, stranger training etc.)