Do you have permission to access the Oracle libraries?

Have you set the environment properly (eg $ORACLE_HOME, $ORACLE_SID etc)?

Have you tried using SQL*Plus from the same account that you are installing DBD::Oracle?