I agree completely. I personally think high performance sportbikes are the safest bikes to ride. They stop turn and go faster, all of which can help you miss what you do not want to hit. I also like the riding position on sportbikes because they put you in the best position for control. Sportbikes are "Form Follows Function", cruisers.............not so much.
I agree with Danny, and agree with this as well. For defensive riding/driving, nothing outperforms a good sport bike, especially in braking. I rode dirt bikes from single digits age right up to about now, as well many sport bikes from my first VFR 750 in 90 or so, and every Honda sport bike along the line, the first CBR 900 as well many others, and got into cruisers in the mid 2000s and rode a Harley Fat Bob as well as a Harley Ultra Classic. If I was in a crisis/emergency road situation, I'd take a sport bike any day. Only possibly a dual sport dirt bike is more maneuverable and quicker to stop on pavement, and that's even debatable.
I really like the Vtwin in a sport bike combo, I haven't ridden a Buell in years, when they first came out at "Harley Days" I think, but one of my favorite bikes, one of the few I've kept when "trading up" for the new model year, is my Honda Firehawk. I've had a 98 and a 2004, one of the last model years, and kept the 04, although I usually ride either our VFR or CBR1000 when sport biking about, I still really like that 1 litre v twin Honda motor for longer range rides when I have no passenger (wife) and don't want to ride a heavy cruiser/highway bike. Something about the torque and how the motor likes to hum along at about 110km/h or 70 ish mph...like I said, it isn't as nimble as the many other sport bikes I've ridden, but it has bundles of torque to spare.
Don't quit street riding Joeacheem, I too started out on sleds and dirt bikes, and went from my CR250 right to the first year Honda ever built a VFR 750 for my first road bike. Just "be aware" and watch for cars turning left in front of you, and you'll be fine. Do what some others suggested, and try a different style bike - I always found Buell to have an odd riding position - many suggested 600 sized sport bikes, and I too agree with that, they're prefect for your size/weight. IMO you'll truly regret giving it up, one single 10 minute ride shouldn't decide the rest of what could be a long life of riding in that open air.