Beefy Boxes and Bandwidth Generously Provided by pair Networks
Pathologically Eclectic Rubbish Lister
 
PerlMonks  

OT - Unix Administration - What's needed?

by TStanley (Canon)
on Jun 11, 2001 at 03:47 UTC ( [id://87374]=perlmeditation: print w/replies, xml ) Need Help??

As some of you know (or may not know), I was among the recently unemployed for a while, but was offered a job on the 8th as a Unix Administrator. While I managed the routine administration work for my own Linux box at my former employer, I haven't really done it on a major scale. I would like the benefit of the collective experience of the monks here, as to what I should know, and possibly some good reference guides that I could buy. I have already purchased the Essential System Administration Nutshell Handbook, but I am interested in any other books/advice that might help me hit the ground running.

UPDATE (29 Jun): The operating system of my box is HP-UX 11. I have also found a good book on the basics of HP-UX 11 (it belongs to my boss). Thank you all for your excellent advice

TStanley
--------
There's an infinite number of monkeys outside who want to talk to us
about this script for Hamlet they've worked out
-- Douglas Adams/Hitchhiker's Guide to the Galaxy
  • Comment on OT - Unix Administration - What's needed?

Replies are listed 'Best First'.
Re: OT - Unix Administration - What's needed?
by ZZamboni (Curate) on Jun 11, 2001 at 05:59 UTC

    It's a dirty job, but someone told me I had to do it
    --Usenix fridge magnet

    Apart from the others' suggestions, if you are going to administrate a large network, I would suggest brushing up on your TCP/IP. Understanding how things work helps a lot in diagnosing many problems. Pick up TCP/IP Network Administration (another O'Reilly book), which has a very good overview of TCP/IP in general, and some useful network administration techniques.

    Another good book is the Unix System Administration Handbook, which has the nice feature of pointing out specificities of different versions of Unix along with the more general descriptions.

    I would like to stress the advice about staying (starting now) up to date on the latest happenings, particularly in security: subscribe at least to BugTraq and to the security mailing lists of the vendors whose OS's you will be administrating, and stay up to date on patches and fixes.

    Another useful thing is having a good set of tools at your disposal. For example, for tracking user requests, where I work they use wreq, which works out quite well, although I think they had some trouble setting it up (I'm not the sysadmin here, but I talk to them a lot). There are other similar systems, I'm sure several will come up if you search in Freshmeat.net.

    Read The Egoless Admin, a recent piece on Freshmeat with some good pieces of advice. Also read The Bastard Operator From Hell, of course :-)

    And remember that no matter what you do, Systems Administration is a thankless job: when everything is working, you are completely transparent (as it should be!). But when things go south, it's all your fault. But it's a job that is its own reward: there's nothing more satisfying that having everything working perfectly, automated, and well-tuned.

    Good luck!

    --ZZamboni

Re: OT - Unix Administration - What's needed?
by andreychek (Parson) on Jun 11, 2001 at 04:05 UTC
    Well, for one.. who could properly use UNIX without the Camel book ;-)

    Seriously though, knowing which variety of UNIX you would be administrating would be a good help. Having an admin book specific to that OS would likely prove most useful.

    There are a few books that I have gotten much out of though. I find "Essential System Administration, 2nd edition" by Aeleen Frisch to be an all around good, generic UNIX/Linux book. If you'll be dealing with mail administration, and Sendmail in particular, the book "Sendmail, 2nd edition" by Bryan Costales would be an excellent choice, as mail administration can tend to be a bit complicated at times, to say the least :-) Also, if you'll be doing DNS admin too, you will find "DNS and BIND, 3rd Ed" by Paul Albitz & Cricket Lie to be quite useful.

    And if you are looking for some general "cool stuff", grab a copy of "UNIX PowerTools". Thats a good book :-)

    You'll find that with UNIX admin, Perl really comes in handy, and will really help you automate various tasks that you will come aross. With that, regular expressions are heavily used in the UNIX world, so if you don't have "Mastering Regular Expressions" by Jeffrey Friedl, now would be a good time to get it.

    Every book I mentioned is an O'Reilly book, so by the time you're done book shopping, you'll have quite a zoo :-) Good luck in your new position!
    -Eric

    Update: I think you'll also find that some of what you'll be doing will be based on what's going on in the Internet community. Ie, you'll monitor the bugtrack mailing list, and every few months, you'll mutter "Oh no, not another DNS/BIND remote exploit", and you'll wander out to grab the latest version :-) The point being though that even if you don't have a book for everything, much of what you'll need to do you can find (instructions for | information on) the Internet.
Re: OT - Unix Administration - What's needed?
by Abigail (Deacon) on Jun 11, 2001 at 12:28 UTC
    You don't learn system administration from a book. The only way to learn is by experience. And I don't mean learning from adminning once Linux box at home. And listen. Listen to people with 10, 20, or more years of experience under their belt. There are places on the net where you can find them. No, not on the web. On Usenet. But don't come barging in and ask questions right away - that won't make you any friends.

    Abilities needed for a UNIX sysadmin: the command line has to be dear to you. vi, because that's everyone and the other editors aren't. Be able to RTFM. But keep in mind that all soft- and hardware sucks, and all documentation lies. You need to know shell scripting (Bourne shell, because that is everywhere). Knowledge of sed/awk/Perl are definiately pres. You also need a LART, to punish your lusers with. Distrust everyone. They *will* lie to you ("no, I didn't change anything!"). Be prepared to work long and odd hours (the mailserver always goes down at 5 PM on Friday night, or 3 AM Monday morning). Your pager will go off all the time. Forget your social live - you'll see the inside of the server room most of the time you are awake - sometimes even 24 hours a day. Of course, you need to know how UNIX works. People will automatically assume you also know how each application works, even if it's a Windows application! And you'll be the one maintaining the phone system, and repairing the copier machine.

    And remember, just because everyone is out there to get you doesn't mean you are paranoid!

    -- Abigail

      Well, pager (or mobile for that matter) going off all the time, applications crashing at times when normal people don't even think about confusers anymore, and people expecting the IT personnel to know everything about phones and copiers - that sounds very much like my job, and I'm (unfortunately) a windows admin...

      But then, every user is potentially (and probably) dangerous. So, be prepared. They will ask you questions when they see you on Sunday morning in town. They will leave their password-protected screensaver on, go for a coffee and expect you to repair their machine in the meantime. And true, you don't learn Unix from books - but they may save your life, so keep them where you can get them quickly.

      --cs

      > Be prepared to work long and odd hours (the
      > mailserver always goes down at 5 PM on Friday
      > night, or 3 AM Monday morning). Your pager will
      > go off all the time. Forget your social live -
      > you'll see the inside of the server room most of
      > the time you are awake - sometimes even 24 hours a
      > day.

      While this is probably the case for many unfortunate sysadmins, I happen to be one of the lucky few with an 8-5 UNIX (well, Linux) sysadmin job. But I suppose what it comes down to is, who you are sysadmining for?

      The system I keep up and running is for users who are only in the building between 8 and 5 on the weekdays. Almost none of them ever works late (and no, it's not government work ;-), and weekend work is almost nil. The 2.5 years I've been here, the only weekend I came in to work was for a few hours one Saturday morning for Y2K testing.

      Also, we don't host any in-house apps that customers would need to view from the web, we are currently outsourcing that portion of our business. So if that goes down, some unfortunate person at the local ISP will have to handle that work. However, that may not last as our needs for more flexibility grow.

      We are also lucky here in that the users don't typically push the limits. On the weekends, people don't want to think about work. So they have no desire to check their email remotely. With that in mind -- if by chance the mail server does go down, our ISP is nice enough to queue all our mail for us until we fix up the server Monday morning. Nobody will miss it while it's down.

      Our management is kind enough to respect the difference between work time and personal time. However, I can't say that on some weekends I don't get curious and ssh in to the servers to see what all is going on. If you are looking to save yourself some grief, by all means make sure you set up some tools to monitor the systems, to both watch over your services, and to keep an eye on security. The tools "Big Brother" and "Log Check" are good for that sort of thing.

      I have to say though, the thing that really helps keep management off our backs here is the fact that these Linux boxes just never seem to go down. Our DNS servers have uptimes over half a year, and the Linux router we use has over a 400 day uptime. So I tend to sleep very well at night :-)

      Does this mean everything is always peachy at where I work? Heavens no. While the boxes stay up, someone has to make sure the services running on them are still working properly. Now, Big Brother helps here, but there's just some things it won't find. We once had an extremely odd issue with one of our DNS servers. The service still allowed you to connect to it, but it was apparently giving back bogus information. Now, I'll tell you, sendmail just didn't like that at all. So instead of quietly accepting that bogus information, or not accepting emails at all, do you know what it decided to do? It decided to take every email that came into our system, and duplicate it hundreds of times. Now, thats all good, but of course this happens on Saturday... and the day after my boss signed up on a high traffic mailing list... and it was one of the weekends where I did NOT happen to check up on things. So, needless to say, it was a messy Monday morning :-)

      In any case though, you'll have alot of fun, not much beats a good UNIX/Linux sysadmin job.
      -Eric
Re: Unix Administration and Perl books
by petdance (Parson) on Jun 11, 2001 at 05:01 UTC
    Once you start getting the hang of sysadminning, you'll get into the world of automating everything, in which case you'll want to get Perl for System Administration. Data Munging With Perl is also pretty good in this area, at least as far as dealing with big amounts of data.

    xoxo,
    Andy

    %_=split/;/,".;;n;u;e;ot;t;her;c; ".   #   Andy Lester
    'Perl ;@; a;a;j;m;er;y;t;p;n;d;s;o;'.  #   http://petdance.com
    "hack";print map delete$_{$_},split//,q<   andy@petdance.com   >
    
Re: OT - Unix Administration - What's needed?
by lemming (Priest) on Jun 11, 2001 at 13:12 UTC

    To quote the game Paranoia: "Trust no one and keep your laser handy."

    Backups will be your nearest and dearest friend. If you are new to this, do backups and make sure your backups are good.

    One thing you didn't mention is if you're the sole admin or if you're under someone. Learn from them, but learn from outside as well.

    My admin story:
    I was hired to take care of a HP-UX system. First week I'm there the medical Lab manager asks me if I would know what could cause all medical systems to be cut off from the HP at 1am every night. If the lab hadn't finished processing by 1am, they would have to start over.
    I immediately think that sounds scheduled and notice backups start at 1am. Look in the script and wow, there's a few kills involved.
    I move the start time to 3 am after checking some other dependencies. This takes 15 minutes at around 6pm.
    I shoot an email to my manager who had gone home at 5pm and talk to the lab manager. She's thankful and when I get in the next morning I find a nice note on my desk from the lab people.
    I then get chewed out by my manager. He's really pissed, but I don't get a real reason why. He goes away after I go over what I did showing him why it works. (All of which was in my email)
    Later that day I find out he had been telling the lab for the last three months that there was no way to fix it. I had cost him major points. He worked hard to fire me for the next year.
    So find out what the environment is like as well as the systems.

Re: OT - Unix Administration - What's needed?
by BigJoe (Curate) on Jun 11, 2001 at 19:48 UTC
    I have a book that has treated me well. It is a Linux book though. It is called "Linux Companion for System Administrators" by Hein. Two other "Linux" ones that I like are "Red Hat Linux Administrators Handbook" by kabir and "Linux for NT Administrators". Even though they are not Unix books I did find the information I needed to fix a SCO Unix 5.0 machine that I was working on.

    --BigJoe

    Learn patience, you must.
    Young PerlMonk, craves Not these things.
    Use the source Luke.

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: perlmeditation [id://87374]
Approved by root
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others cooling their heels in the Monastery: (4)
As of 2024-04-19 05:25 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found