|Come for the quick hacks, stay for the epiphanies.
Just like yourself -- I graduated high school with Algebra II as my highest level Math course. If I were to attempt a computer science degree, due to my Math limitations, I think I would really struggle to make it through. Comp Sci students are responsible for a lot of Math -- things like Calc III, numerical analysis, differemtial equations, and so on. If you're simply a little behind, thats one thing. But if you find yourself having trouble learning it, make sure you know what you are getting yourself into.
Instead of going that route, I decided to take a two year degree in Computer Information Systems, which tends to be a well balanced computer degree. Along with some interesting system troubleshooting, you also get into various sorts of programming, networking, possibly even web development, and so on. You will have to get into some math. For me though, it was still challenging, but not prohibitive.
I have since been hired as somewhat of a network administrator. Actually, my title is Internet Specialist. I do everything from administer a bunch of Linux boxes doing "Internet stuff" (www, email, dns, etc) to web application development. I certainly get my fair share of programming in -- usually with Perl. Both web application development and system admin is really helped through the use of Perl, along with other languages where appropriate.
However, programming isn't all I do, and I really enjoy it that way. Dealing with Perl code is an incredible amount of fun, but the variety I'm offered by also getting to learn new technologies, protect systems from intruders, configuring/tweaking software, and all that other wonderful stuff that comes along with sysadmin is something I don't think I'd ever want to give up.