Wednesday, 30 November 2011

Hadoop on OSX 10.7

When starting Hadoop using start-all.sh I kept seeing the following in my log file
"Unable to load realm info from SCDynamicStore"
A workaround is suggested on the Hadoop Jira under HADOOP-7489 which is to specify kerberos config on the command line:
 -Djava.security.krb5.realm=OX.AC.UK -Djava.security.krb5.kdc=kdc0.ox.ac.uk:kdc1.ox.ac.uk
This works perfectly but is easier if you add it into the HADOOP_OPTS environment variable in $HADOOP_HOME/conf/hadoop-env.sh Mine looks like this:
export HADOOP_OPTS="-server -Djava.security.krb5.realm=OX.AC.UK -Djava.security.krb5.kdc=kdc0.ox.ac.uk:kdc1.ox.ac.uk"

1 comment:

  1. I have an interest to learn Hadoop technology in online; the online tutorials help me a lot to understand the Big Data concepts well, In that your post provides useful information about Hadoop. Thanks for sharing…
    Regards,
    Big Data Training

    ReplyDelete