http://blog.gmane.org/gmane.comp.jakarta.lucene.hadoop.devel hourly 1 1901-01-01T00:00+00:00 http://gmane.org/img/gmane-25t.png http://gmane.org http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.devel/71711 <pre>Radim Kolar created HADOOP-8441: ----------------------------------- Summary: Build bot timeout is too small Key: HADOOP-8441 URL: https://issues.apache.org/jira/browse/HADOOP-8441 Project: Hadoop Common Issue Type: Bug Reporter: Radim Kolar Priority: Blocker QA Build bot timeout is set too low. It fails to make build in time and then no results are posted to JIRA. See example https://builds.apache.org/job/PreCommit-HADOOP-Build/1040/console -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira </pre> Radim Kolar (JIRA 2012-05-26T09:27:23 http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.devel/71710 <pre>See &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/264/&gt; ------------------------------------------ [...truncated 12430 lines...] [javadoc] Loading source files for package org.apache.hadoop.fs.ftp... [javadoc] Loading source files for package org.apache.hadoop.fs.kfs... [javadoc] Loading source files for package org.apache.hadoop.fs.local... [javadoc] Loading source files for package org.apache.hadoop.fs.permission... [javadoc] Loading source files for package org.apache.hadoop.fs.s3... [javadoc] Loading source files for package org.apache.hadoop.fs.s3native... [javadoc] Loading source files for package org.apache.hadoop.fs.shell... [javadoc] Loading source files for package org.apache.hadoop.fs.viewfs... [javadoc] Loading source files for package org.apache.hadoop.http... [javadoc] Loading source files for package org.apache.hadoop.http.lib... [javadoc] Loading source files for package org.apache.hadoop.io... [javadoc] Loading source files for package org.apache.hadoop.io.compress... [javadoc] Loading source files for package org.apache.hadoop.io.compress.bzip2... [javadoc] Loading source files for package org.apache.hadoop.io.compress.lz4... [javadoc] Loading source files for package org.apache.hadoop.io.compress.snappy... [javadoc] Loading source files for package org.apache.hadoop.io.compress.zlib... [javadoc] Loading source files for package org.apache.hadoop.io.file.tfile... [javadoc] Loading source files for package org.apache.hadoop.io.nativeio... [javadoc] Loading source files for package org.apache.hadoop.io.retry... [javadoc] Loading source files for package org.apache.hadoop.io.serializer... [javadoc] Loading source files for package org.apache.hadoop.io.serializer.avro... [javadoc] Loading source files for package org.apache.hadoop.ipc... [javadoc] Loading source files for package org.apache.hadoop.ipc.metrics... [javadoc] Loading source files for package org.apache.hadoop.jmx... [javadoc] Loading source files for package org.apache.hadoop.log... [javadoc] Loading source files for package org.apache.hadoop.log.metrics... [javadoc] Loading source files for package org.apache.hadoop.metrics... [javadoc] Loading source files for package org.apache.hadoop.metrics.file... [javadoc] Loading source files for package org.apache.hadoop.metrics.ganglia... [javadoc] Loading source files for package org.apache.hadoop.metrics.jvm... [javadoc] Loading source files for package org.apache.hadoop.metrics.spi... [javadoc] Loading source files for package org.apache.hadoop.metrics.util... [javadoc] Loading source files for package org.apache.hadoop.metrics2... [javadoc] Loading source files for package org.apache.hadoop.metrics2.annotation... [javadoc] Loading source files for package org.apache.hadoop.metrics2.filter... [javadoc] Loading source files for package org.apache.hadoop.metrics2.impl... [javadoc] Loading source files for package org.apache.hadoop.metrics2.lib... [javadoc] Loading source files for package org.apache.hadoop.metrics2.sink... [javadoc] Loading source files for package org.apache.hadoop.metrics2.sink.ganglia... [javadoc] Loading source files for package org.apache.hadoop.metrics2.source... [javadoc] Loading source files for package org.apache.hadoop.metrics2.util... [javadoc] Loading source files for package org.apache.hadoop.net... [javadoc] Loading source files for package org.apache.hadoop.record... [javadoc] Loading source files for package org.apache.hadoop.record.compiler... [javadoc] Loading source files for package org.apache.hadoop.record.compiler.ant... [javadoc] Loading source files for package org.apache.hadoop.record.compiler.generated... [javadoc] Loading source files for package org.apache.hadoop.record.meta... [javadoc] Loading source files for package org.apache.hadoop.security... [javadoc] Loading source files for package org.apache.hadoop.security.authorize... [javadoc] Loading source files for package org.apache.hadoop.security.token... [javadoc] Loading source files for package org.apache.hadoop.security.token.delegation... [javadoc] Loading source files for package org.apache.hadoop.tools... [javadoc] Loading source files for package org.apache.hadoop.util... [javadoc] Loading source files for package org.apache.hadoop.util.bloom... [javadoc] Loading source files for package org.apache.hadoop.util.hash... [javadoc] 2 errors [xslt] Processing &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsXml.xml&gt; to &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/site/findbugs.html&gt; [xslt] Loading stylesheet /home/jenkins/tools/findbugs/latest/src/xsl/default.xsl [INFO] Executed tasks [INFO] [INFO] --- maven-antrun-plugin:1.6:run (pre-dist) &lt; at &gt; hadoop-common --- [INFO] Executing tasks main: [INFO] Executed tasks [INFO] [INFO] &gt;&gt;&gt; maven-javadoc-plugin:2.8.1:javadoc (default) &lt; at &gt; hadoop-common &gt;&gt;&gt; [INFO] [INFO] --- maven-antrun-plugin:1.6:run (create-testdirs) &lt; at &gt; hadoop-common --- [INFO] Executing tasks main: [INFO] Executed tasks [INFO] [INFO] --- build-helper-maven-plugin:1.5:add-source (add-source) &lt; at &gt; hadoop-common --- [INFO] Source directory: &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/generated-sources/java&gt; added. [INFO] [INFO] --- build-helper-maven-plugin:1.5:add-test-source (add-test-source) &lt; at &gt; hadoop-common --- [INFO] Test Source directory: &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/generated-test-sources/java&gt; added. [INFO] [INFO] --- maven-antrun-plugin:1.6:run (compile-proto) &lt; at &gt; hadoop-common --- [INFO] Executing tasks main: [INFO] Executed tasks [INFO] [INFO] --- maven-antrun-plugin:1.6:run (save-version) &lt; at &gt; hadoop-common --- [INFO] Executing tasks main: [INFO] Executed tasks [INFO] [INFO] &lt;&lt;&lt; maven-javadoc-plugin:2.8.1:javadoc (default) &lt; at &gt; hadoop-common &lt;&lt;&lt; [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:javadoc (default) &lt; at &gt; hadoop-common --- [INFO] ExcludePrivateAnnotationsStandardDoclet 9 warnings [WARNING] Javadoc Warnings [WARNING] &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java&gt;:49: warning: sun.net.dns.ResolverConfiguration is Sun proprietary API and may be removed in a future release [WARNING] import sun.net.dns.ResolverConfiguration; [WARNING] ^ [WARNING] &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java&gt;:50: warning: sun.net.util.IPAddressUtil is Sun proprietary API and may be removed in a future release [WARNING] import sun.net.util.IPAddressUtil; [WARNING] ^ [WARNING] &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java&gt;:51: warning: sun.security.jgss.krb5.Krb5Util is Sun proprietary API and may be removed in a future release [WARNING] import sun.security.jgss.krb5.Krb5Util; [WARNING] ^ [WARNING] &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java&gt;:52: warning: sun.security.krb5.Credentials is Sun proprietary API and may be removed in a future release [WARNING] import sun.security.krb5.Credentials; [WARNING] ^ [WARNING] &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java&gt;:53: warning: sun.security.krb5.PrincipalName is Sun proprietary API and may be removed in a future release [WARNING] import sun.security.krb5.PrincipalName; [WARNING] ^ [WARNING] &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java&gt;:28: warning: sun.security.krb5.Config is Sun proprietary API and may be removed in a future release [WARNING] import sun.security.krb5.Config; [WARNING] ^ [WARNING] &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java&gt;:29: warning: sun.security.krb5.KrbException is Sun proprietary API and may be removed in a future release [WARNING] import sun.security.krb5.KrbException; [WARNING] ^ [WARNING] &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java&gt;:25: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [WARNING] import sun.misc.Unsafe; [WARNING] ^ [WARNING] &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java&gt;:117: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [WARNING] static final Unsafe theUnsafe; [WARNING] ^ [INFO] [INFO] --- maven-assembly-plugin:2.3:single (dist) &lt; at &gt; hadoop-common --- [WARNING] The following patterns were never triggered in this artifact exclusion filter: o 'org.apache.ant:*:jar' o 'jdiff:jdiff:jar' [INFO] Copying files to &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.3-SNAPSHOT&gt; [INFO] [INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) &lt; at &gt; hadoop-common --- [INFO] [INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) &lt; at &gt; hadoop-common --- [INFO] org already added, skipping [INFO] org/apache already added, skipping [INFO] org/apache/hadoop already added, skipping [INFO] Building jar: &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.3-SNAPSHOT-sources.jar&gt; [INFO] org already added, skipping [INFO] org/apache already added, skipping [INFO] org/apache/hadoop already added, skipping [WARNING] Artifact org.apache.hadoop:hadoop-common:java-source:sources:0.23.3-SNAPSHOT already attached to project, ignoring duplicate [INFO] [INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) &lt; at &gt; hadoop-common --- [INFO] [INFO] --- maven-antrun-plugin:1.6:run (tar) &lt; at &gt; hadoop-common --- [INFO] Executing tasks main: [INFO] Executed tasks [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) &lt; at &gt; hadoop-common --- [INFO] ExcludePrivateAnnotationsStandardDoclet 9 warnings [WARNING] Javadoc Warnings [WARNING] &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java&gt;:49: warning: sun.net.dns.ResolverConfiguration is Sun proprietary API and may be removed in a future release [WARNING] import sun.net.dns.ResolverConfiguration; [WARNING] ^ [WARNING] &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java&gt;:50: warning: sun.net.util.IPAddressUtil is Sun proprietary API and may be removed in a future release [WARNING] import sun.net.util.IPAddressUtil; [WARNING] ^ [WARNING] &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java&gt;:51: warning: sun.security.jgss.krb5.Krb5Util is Sun proprietary API and may be removed in a future release [WARNING] import sun.security.jgss.krb5.Krb5Util; [WARNING] ^ [WARNING] &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java&gt;:52: warning: sun.security.krb5.Credentials is Sun proprietary API and may be removed in a future release [WARNING] import sun.security.krb5.Credentials; [WARNING] ^ [WARNING] &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java&gt;:53: warning: sun.security.krb5.PrincipalName is Sun proprietary API and may be removed in a future release [WARNING] import sun.security.krb5.PrincipalName; [WARNING] ^ [WARNING] &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java&gt;:28: warning: sun.security.krb5.Config is Sun proprietary API and may be removed in a future release [WARNING] import sun.security.krb5.Config; [WARNING] ^ [WARNING] &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java&gt;:29: warning: sun.security.krb5.KrbException is Sun proprietary API and may be removed in a future release [WARNING] import sun.security.krb5.KrbException; [WARNING] ^ [WARNING] &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java&gt;:25: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [WARNING] import sun.misc.Unsafe; [WARNING] ^ [WARNING] &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java&gt;:117: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [WARNING] static final Unsafe theUnsafe; [WARNING] ^ [INFO] Building jar: &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.3-SNAPSHOT-javadoc.jar&gt; [INFO] [INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) &lt; at &gt; hadoop-common --- [INFO] [INFO] There are 8513 checkstyle errors. [WARNING] Unable to locate Source XRef to link to - DISABLED [INFO] [INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) &lt; at &gt; hadoop-common --- [INFO] ****** FindBugsMojo execute ******* [INFO] canGenerate is true [INFO] ****** FindBugsMojo executeFindbugs ******* [INFO] Temp File is &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsTemp.xml&gt; [INFO] Fork Value is true [INFO] xmlOutput is false [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop Common Project 0.23.3-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) &lt; at &gt; hadoop-common-project --- [INFO] Deleting &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/target&gt; [INFO] [INFO] --- maven-antrun-plugin:1.6:run (create-testdirs) &lt; at &gt; hadoop-common-project --- [INFO] Executing tasks main: [mkdir] Created dir: &lt;https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/target/test-dir&gt; [INFO] Executed tasks [INFO] [INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) &lt; at &gt; hadoop-common-project --- [INFO] [INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) &lt; at &gt; hadoop-common-project --- [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) &lt; at &gt; hadoop-common-project --- [INFO] Not executing Javadoc as the project is not a Java classpath-capable package [INFO] [INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) &lt; at &gt; hadoop-common-project --- [INFO] [INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) &lt; at &gt; hadoop-common-project --- [INFO] ****** FindBugsMojo execute ******* [INFO] canGenerate is false [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop Annotations ......................... SUCCESS [13.769s] [INFO] Apache Hadoop Auth ................................ SUCCESS [19.341s] [INFO] Apache Hadoop Auth Examples ....................... SUCCESS [8.447s] [INFO] Apache Hadoop Common .............................. SUCCESS [4:07.299s] [INFO] Apache Hadoop Common Project ...................... SUCCESS [0.035s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 4:50.116s [INFO] Finished at: Sat May 26 09:09:14 UTC 2012 [INFO] Final Memory: 80M/815M [INFO] ------------------------------------------------------------------------ + /home/jenkins/tools/maven/latest/bin/mvn test -Pclover -DcloverLicenseLocation=/home/jenkins/tools/clover/latest/lib/clover.license Build step 'Execute shell' marked build as failure [WARNINGS] Skipping publisher since build result is FAILURE Archiving artifacts Recording fingerprints Publishing Javadoc Recording test results </pre> Apache Jenkins Server 2012-05-26T09:19:07 http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.devel/71708 <pre>Ivan Mitic created HADOOP-8440: ---------------------------------- Summary: HarFileSystem.decodeHarURI fails for URIs whose host contains numbers Key: HADOOP-8440 URL: https://issues.apache.org/jira/browse/HADOOP-8440 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 1.0.0 Reporter: Ivan Mitic Assignee: Ivan Mitic Priority: Minor For example, HarFileSystem.decodeHarURI will fail for the following URI: har://hdfs-127.0.0.1:51040/user -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira </pre> Ivan Mitic (JIRA 2012-05-25T20:40:23 http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.devel/71707 <pre>Devaraj K created HADOOP-8439: --------------------------------- Summary: Update hadoop-setup-conf.sh to support yarn configurations Key: HADOOP-8439 URL: https://issues.apache.org/jira/browse/HADOOP-8439 Project: Hadoop Common Issue Type: Bug Components: scripts Affects Versions: 2.0.0-alpha, 3.0.0 Reporter: Devaraj K Assignee: Devaraj K At present hadoop-setup-conf.sh refers the classic mapred properties. It can be updated to support yarn configurations. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira </pre> Devaraj K (JIRA 2012-05-25T12:56:23 http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.devel/71706 <pre>Devaraj K created HADOOP-8438: --------------------------------- Summary: hadoop-validate-setup.sh refers to examples jar file which doesn't exist Key: HADOOP-8438 URL: https://issues.apache.org/jira/browse/HADOOP-8438 Project: Hadoop Common Issue Type: Bug Reporter: Devaraj K Assignee: Devaraj K hadoop-validate-setup.sh is trying to find the file with the name hadoop-examples-*.jar and it is failing to find because the examples jar is renamed to hadoop-mapreduce-examples-*.jar. {code:xml} linux-rj72:/home/hadoop/hadoop-3.0.0-SNAPSHOT/sbin # ./hadoop-validate-setup.sh find: `/usr/share/hadoop': No such file or directory Did not find hadoop-examples-*.jar under '/home/hadoop-3.0.0-SNAPSHOT or '/usr/share/hadoop' linux-rj72:/home/hadoop-3.0.0-SNAPSHOT/sbin # {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira </pre> Devaraj K (JIRA 2012-05-25T09:33:23 http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.devel/71704 <pre>Brahma Reddy Battula created HADOOP-8437: -------------------------------------------- Summary: getLocalPathForWrite is not throwing any expection for invalid paths Key: HADOOP-8437 URL: https://issues.apache.org/jira/browse/HADOOP-8437 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 2.0.1-alpha Reporter: Brahma Reddy Battula Assignee: Brahma Reddy Battula call dirAllocator.getLocalPathForWrite ( "/InvalidPath", conf ); Here it will not thrown any exception but earlier version it used throw. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira </pre> Brahma Reddy Battula (JIRA 2012-05-25T08:58:23 http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.devel/71702 <pre>Brahma Reddy Battula created HADOOP-8436: -------------------------------------------- Summary: NPE In getLocalPathForWrite ( path, conf ) when dfs.client.buffer.dir not configured Key: HADOOP-8436 URL: https://issues.apache.org/jira/browse/HADOOP-8436 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 2.0.0-alpha, 3.0.0 Reporter: Brahma Reddy Battula Call dirAllocator.getLocalPathForWrite ( path , conf ); without configuring "dfs.client.buffer.dir".. {noformat} java.lang.NullPointerException at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.confChanged(LocalDirAllocator.java:261) at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:365) at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:134) at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:113) {noformat} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira </pre> Brahma Reddy Battula (JIRA 2012-05-25T07:13:23 http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.devel/71701 <pre>Harsh J created HADOOP-8435: ------------------------------- Summary: Propdel all svn:mergeinfo Key: HADOOP-8435 URL: https://issues.apache.org/jira/browse/HADOOP-8435 Project: Hadoop Common Issue Type: Bug Affects Versions: 2.0.0-alpha, 3.0.0 Reporter: Harsh J Assignee: Harsh J TortoiseSVN/some versions of svn have added several mergeinfo props to Hadoop's svn files/dirs (list below). We should propdel that unneeded property, and fix it up. This otherwise causes pain to those who backport with a simple root-dir-down command (svn merge -c num &lt;url/path&gt;). We should also make sure to update the HowToCommit page on advising to avoid mergeinfo additions to prevent this from reoccurring. Files affected are, from my propdel revert output earlier today: {code} Reverted '.' Reverted 'hadoop-hdfs-project' Reverted 'hadoop-hdfs-project/hadoop-hdfs' Reverted 'hadoop-hdfs-project/hadoop-hdfs/src/test/hdfs' Reverted 'hadoop-hdfs-project/hadoop-hdfs/src/main/java' Reverted 'hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/datanode' Reverted 'hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/hdfs' Reverted 'hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/secondary' Reverted 'hadoop-hdfs-project/hadoop-hdfs/src/main/native' Reverted 'hadoop-mapreduce-project' Reverted 'hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site' Reverted 'hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt' Reverted 'hadoop-mapreduce-project/conf' Reverted 'hadoop-mapreduce-project/CHANGES.txt' Reverted 'hadoop-mapreduce-project/src/test/mapred' Reverted 'hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/hdfs' Reverted 'hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/fs' Reverted 'hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/ipc' Reverted 'hadoop-mapreduce-project/src/contrib' Reverted 'hadoop-mapreduce-project/src/contrib/eclipse-plugin' Reverted 'hadoop-mapreduce-project/src/contrib/block_forensics' Reverted 'hadoop-mapreduce-project/src/contrib/index' Reverted 'hadoop-mapreduce-project/src/contrib/data_join' Reverted 'hadoop-mapreduce-project/src/contrib/build-contrib.xml' Reverted 'hadoop-mapreduce-project/src/contrib/vaidya' Reverted 'hadoop-mapreduce-project/src/contrib/build.xml' Reverted 'hadoop-mapreduce-project/src/java' Reverted 'hadoop-mapreduce-project/src/webapps/job' Reverted 'hadoop-mapreduce-project/src/c++' Reverted 'hadoop-mapreduce-project/src/examples' Reverted 'hadoop-mapreduce-project/hadoop-mapreduce-examples' Reverted 'hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml' Reverted 'hadoop-mapreduce-project/bin' Reverted 'hadoop-common-project' Reverted 'hadoop-common-project/hadoop-common' Reverted 'hadoop-common-project/hadoop-common/src/test/core' Reverted 'hadoop-common-project/hadoop-common/src/main/java' Reverted 'hadoop-common-project/hadoop-common/src/main/docs' Reverted 'hadoop-common-project/hadoop-auth' Reverted 'hadoop-project' Reverted 'hadoop-project/src/site' {code} Proposed set of fix (from http://stackoverflow.com/questions/767418/remove-unnecessary-svnmergeinfo-properties): {code} svn propdel svn:mergeinfo -R svn revert . svn commit -m &lt;appropriate message&gt; {code} (To be done on branch-2 and trunk both) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira </pre> Harsh J (JIRA 2012-05-25T06:54:23 http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.devel/71700 <pre>Harsh J created HADOOP-8434: ------------------------------- Summary: TestConfiguration currently has no tests for direct setter methods Key: HADOOP-8434 URL: https://issues.apache.org/jira/browse/HADOOP-8434 Project: Hadoop Common Issue Type: Bug Affects Versions: 3.0.0 Reporter: Harsh J Jan van der Lugt noticed this on HADOOP-8415. bq. Just FYI, there are no tests for setFloat, setInt, setLong, etc. Might be better to add all of those at the same time. Would be good to have (coverage-wise first, regression-wise second) explicit tests for the each of the setter methods, although other projects' tests do test this extensively. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira </pre> Harsh J (JIRA 2012-05-25T06:10:24 http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.devel/71699 <pre>Brahma Reddy Battula created HADOOP-8433: -------------------------------------------- Summary: Logs are getting misplaced after introducing hadoop-env.sh Key: HADOOP-8433 URL: https://issues.apache.org/jira/browse/HADOOP-8433 Project: Hadoop Common Issue Type: Bug Components: scripts Affects Versions: 2.0.1-alpha, 3.0.0 Reporter: Brahma Reddy Battula It's better to comment the following in hadoop-env.sh # Where log files are stored. $HADOOP_HOME/logs by default. export HADOOP_LOG_DIR=${HADOOP_LOG_DIR}/$USER Because of this logs are placing under root($user) and this getting called two times while starting process. hence logs are placing at /root/root/ -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira </pre> Brahma Reddy Battula (JIRA 2012-05-25T02:22:16 http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.devel/71698 <pre>kosik created HADOOP-8432: ----------------------------- Summary: SH script syntax errors Key: HADOOP-8432 URL: https://issues.apache.org/jira/browse/HADOOP-8432 Project: Hadoop Common Issue Type: Bug Components: scripts Affects Versions: 2.0.0-alpha Environment: ubuntu 12, Oracle_JDK 1.7.0_03, env. variables setted to: export JAVA_HOME=/mnt/dataStorage/storage/local/glassfish3/jdk7 export PATH=$PATH:$JAVA_HOME/bin export HADOOP_INSTALL=/mnt/dataStorage/storage/local/hadoop-2.0.0-alpha export PATH=$PATH:$HADOOP_INSTALL/bin export HADOOP_CONF_DIR=$HADOOP_INSTALL/etc/hadoop Reporter: kosik Priority: Blocker Fix For: 2.0.0-alpha Hi, Everyone I just can't start with new binary release of hadoop with following CLI command: ... /hadoop-2.0.0-alpha/sbin/start-dfs.sh: 78: ... /hadoop-2.0.0-alpha/sbin/../libexec/hadoop-config.sh: Syntax error: word unexpected (expecting ")") Inside the script start-dfs.sh there are multiple syntax wrongs. Could you fix it? Regards -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira </pre> kosik (JIRA 2012-05-24T16:09:29 http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.devel/71694 <pre>Hi! I am trying to set up hadoop 1.0.2 for single node. After starting it, when i execute jps command i get the following : NameNode 13478 Jps 13187 SecondaryNameNode In log files i get the following errors for tasktracker : 12-05-24 12:39:21,268 ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:hduser cause:org.apache.hadoop.ipc.RemoteException: java.io.IOException: Unknown protocol to name node: org.apache.hadoop.mapred.InterTrackerProtocol at org.apache.hadoop.hdfs.server.namenode.NameNode.getProtocolVersion(NameNode.java:149) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:563) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1388) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1384) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1382) 2012-05-24 12:39:21,268 ERROR org.apache.hadoop.mapred.TaskTracker: Can not start task tracker because org.apache.hadoop.ipc.RemoteException: java.io.IOException: Unknown protocol to name node: org.apache.hadoop.mapred.InterTrackerProtocol at org.apache.hadoop.hdfs.server.namenode.NameNode.getProtocolVersion(NameNode.java:149) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:563) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1388) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1384) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1382) at org.apache.hadoop.ipc.Client.call(Client.java:1066) at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225) at org.apache.hadoop.mapred.$Proxy5.getProtocolVersion(Unknown Source) at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396) at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:370) at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:429) at org.apache.hadoop.ipc.RPC.waitForProxy(RPC.java:331) at org.apache.hadoop.ipc.RPC.waitForProxy(RPC.java:296) at org.apache.hadoop.mapr And following error for jobtracker : FATAL org.apache.hadoop.mapred.JobTracker: java.net.BindException: Problem binding to localhost/127.0.0.1:6500 : Address already in use at org.apache.hadoop.ipc.Server.bind(Server.java:227) at org.apache.hadoop.ipc.Server$Listener.&lt;init&gt;(Server.java:301) at org.apache.hadoop.ipc.Server.&lt;init&gt;(Server.java:1483) at org.apache.hadoop.ipc.RPC$Server.&lt;init&gt;(RPC.java:545) at org.apache.hadoop.ipc.RPC.getServer(RPC.java:506) at org.apache.hadoop.mapred.JobTracker.&lt;init&gt;(JobTracker.java:2306) at org.apache.hadoop.mapred.JobTracker.&lt;init&gt;(JobTracker.java:2192) at org.apache.hadoop.mapred.JobTracker.&lt;init&gt;(JobTracker.java:2186) at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300) at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291) at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978) Caused by: java.net.BindException: Address already in use at sun.nio.ch.Net.bind(Native Method) at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:126) at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59) at org.apache.hadoop.ipc.Server.bind(Server.java:225) ... 10 more Please help i am very new to Hadoop. Thanks: kripal </pre> kripal kashyav 2012-05-24T07:12:55 http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.devel/71693 <pre>Eli Collins created HADOOP-8431: ----------------------------------- Summary: Running distcp wo args throws IllegalArgumentException Key: HADOOP-8431 URL: https://issues.apache.org/jira/browse/HADOOP-8431 Project: Hadoop Common Issue Type: Bug Affects Versions: 2.0.0-alpha Reporter: Eli Collins Running distcp w/o args results in the following: {noformat} hadoop-3.0.0-SNAPSHOT $ ./bin/hadoop distcp 12/05/23 18:49:04 ERROR tools.DistCp: Invalid arguments: java.lang.IllegalArgumentException: Target path not specified at org.apache.hadoop.tools.OptionsParser.parse(OptionsParser.java:86) at org.apache.hadoop.tools.DistCp.run(DistCp.java:102) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.hadoop.tools.DistCp.main(DistCp.java:368) Invalid arguments: Target path not specified {noformat} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira </pre> Eli Collins (JIRA 2012-05-24T01:51:40 http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.devel/71692 <pre>Eli Collins created HADOOP-8430: ----------------------------------- Summary: Backport new FileSystem methods introduced by HADOOP-8014 to branch-1 Key: HADOOP-8430 URL: https://issues.apache.org/jira/browse/HADOOP-8430 Project: Hadoop Common Issue Type: Bug Reporter: Eli Collins Assignee: Eli Collins Per HADOOP-8422 let's backport the new FileSystem methods from HADOOP-8014 to branch-1 so users can transition over in Hadoop 1.x releases, which helps upstream projects like HBase work against federation (see HBASE-6067). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira </pre> Eli Collins (JIRA 2012-05-23T23:57:41 http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.devel/71691 <pre>Arun C Murthy created HADOOP-8429: ------------------------------------- Summary: Update index.html for docs site to reflect appropriate version in branch-2 Key: HADOOP-8429 URL: https://issues.apache.org/jira/browse/HADOOP-8429 Project: Hadoop Common Issue Type: Bug Reporter: Arun C Murthy Currently says 0.23, I noticed this while releasing 2.0.0-alpha. (For now, I'll manually fix it). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira </pre> Arun C Murthy (JIRA 2012-05-23T20:13:41 http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.devel/71690 <pre>Jeremy Hanna created HADOOP-8428: ------------------------------------ Summary: service commands don't actually shutdown the hadoop processes Key: HADOOP-8428 URL: https://issues.apache.org/jira/browse/HADOOP-8428 Project: Hadoop Common Issue Type: Bug Affects Versions: 1.0.2 Reporter: Jeremy Hanna Using the debian package for hadoop 1.0.2, I try to do 'service hadoop-namenode stop' or 'service hadoop-jobtracker stop' and it outputs that it is trying to stop the service, e.g. "Stopping Apache Hadoop Job Tracker server: hadoop-jobtracker." However doing 'ps -ef | grep hadoop' still shows both of those still running even after a couple of minutes waiting. I have to manually kill the processes and delete the process id in order to restart them. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira </pre> Jeremy Hanna (JIRA 2012-05-23T17:35:40 http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.devel/71689 <pre>Eli Collins created HADOOP-8427: ----------------------------------- Summary: Convert Forrest docs to APT Key: HADOOP-8427 URL: https://issues.apache.org/jira/browse/HADOOP-8427 Project: Hadoop Common Issue Type: Task Components: documentation Affects Versions: 2.0.0 Reporter: Eli Collins Some of the forrest docs content in src/docs/src/documentation/content/xdocs has not yet been converted to APT and moved to src/site/apt. Let's convert the forrest docs that haven't been converted yet to new APT content in hadoop-common/src/site/apt (and link the new content into hadoop-project/src/site/apt/index.apt.vm) and remove all forrest dependencies. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira </pre> Eli Collins (JIRA 2012-05-23T17:29:42 http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.devel/71679 <pre>Hi, I'd like to apply for write permission for Hadoop wiki for account "Mikhail Yakshin" to add our company to Hadoop PoweredBy list at http://wiki.apache.org/hadoop/PoweredBy </pre> Mikhail Yakshin 2012-05-23T08:34:41 http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.devel/71678 <pre>Subroto Sanyal created HADOOP-8426: -------------------------------------- Summary: API to get info for deprecated key Key: HADOOP-8426 URL: https://issues.apache.org/jira/browse/HADOOP-8426 Project: Hadoop Common Issue Type: Bug Components: conf Affects Versions: 0.23.1 Reporter: Subroto Sanyal The current version of Hadoop deprecates many keys but, takes care of adding the new keys to the configuration accordingly. For the end user only logs are there which indicates the key is deprecated and the message also suggests the new key to be used. I was thinking; there should be an API/Utility which could probably provide the new key information when called with old key. Using this API the user can judge in runtime to use the old key or new key. Currently the Configuration provides an API only to check whether a key is deprecated or not but, doesn't provides a way to get the corresponding new key. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira </pre> Subroto Sanyal (JIRA 2012-05-23T07:37:41 http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.devel/71675 <pre>Luke Lu created HADOOP-8425: ------------------------------- Summary: Upgrade commons-math version to 2.2 Key: HADOOP-8425 URL: https://issues.apache.org/jira/browse/HADOOP-8425 Project: Hadoop Common Issue Type: Bug Components: metrics Affects Versions: 0.23.1, 1.0.3 Reporter: Luke Lu Assignee: Yu Li From commons math 2.2 release note: "This is primarily a maintenance release, but it also includes new features and enhancements. Users of version 2.1 are encouraged to upgrade to 2.2, as this release includes some important bug fixes." Some downstream projects also need some new features in 2.2. Until we have a clear user container story, upgrading the dependency in Hadoop core is the most painless solution. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira </pre> Luke Lu (JIRA 2012-05-22T21:36:41 http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.devel/71674 <pre>Bikas Saha created HADOOP-8424: ---------------------------------- Summary: Web UI broken on Windows because classpath not setup correctly Key: HADOOP-8424 URL: https://issues.apache.org/jira/browse/HADOOP-8424 Project: Hadoop Common Issue Type: Bug Affects Versions: 1.0.0 Reporter: Bikas Saha Assignee: Bikas Saha Fix For: 1.1.0 The classpath is setup to include the hadoop jars before the build webapps directory and that upsets jetty when it is trying to resolve the webapp classes. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira </pre> Bikas Saha (JIRA 2012-05-22T20:27:41 Search the mailing list at Gmane query http://search.gmane.org/?group=$group=gmane.comp.jakarta.lucene.hadoop.devel