gmane.comp.jakarta.lucene.hadoop.devel

[jira] Updated: (HADOOP-4734) Some lease recovery codes in 0.19 or trunk should also be committed in 0.18.

Tsz Wo (Nicholas), SZE (JIRA — 2008-12-04T03:46:44

[ https://issues.apache.org/jira/browse/HADOOP-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HADOOP-4734: ------------------------------------------- Hadoop Flags: [Reviewed] Created HADOOP-4769. Thanks, Hairong.

[jira] Created: (HADOOP-4769) DataNode should validate the data integrity of a block before updating it

Tsz Wo (Nicholas), SZE (JIRA — 2008-12-04T03:44:44

DataNode should validate the data integrity of a block before updating it ------------------------------------------------------------------------- Key: HADOOP-4769 URL: https://issues.apache.org/jira/browse/HADOOP-4769 Project: Hadoop Core Issue Type: Bug Reporter: Tsz Wo (Nicholas), SZE DataNode currently only validate the existence of the block and meta files before update. The data integrity of a block should also be validated.

[jira] Updated: (HADOOP-4576) Modify pending tasks count in the UI to pending jobs count in the UI

Sreekanth Ramakrishnan (JIRA — 2008-12-04T03:39:44

[ https://issues.apache.org/jira/browse/HADOOP-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreekanth Ramakrishnan updated HADOOP-4576: ------------------------------------------- Attachment: HADOOP-4576-3.patch Attaching a new patch merged with current trunk. Plus have removed the variable which I introduced in previous patch, it was not required as we can find out number of waiting jobs directly from size of the jobList instead of having a counter. Also added a note in scheduling information stating that scheduling information can be off at the maximum by polling interval of the job initialization poller which does clean up of the waiting jobs.

[jira] Updated: (HADOOP-4768) Dynamic Priority Scheduler that allows queue shares to be controlled dynamically by a currency

Thomas Sandholm (JIRA — 2008-12-04T02:15:44

[jira] Updated: (HADOOP-4768) Dynamic Priority Scheduler that allows queue shares to be controlled dynamically by a currency

Thomas Sandholm (JIRA — 2008-12-04T02:13:44

[ https://issues.apache.org/jira/browse/HADOOP-4768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Sandholm updated HADOOP-4768: ------------------------------------ Attachment: HADOOP-4768-fairshare.patch HADOOP-4768-capacity-scheduler.patch HADOOP-4768-dynamic-scheduler.patch Dynamic priority scheduler and test classes Capacity scheduler patch to use dynamic capacity guarantees Fairshare scheduler patch to use dynamic pool shares

[jira] Updated: (HADOOP-4768) Dynamic Priority Scheduler that allows queue shares to be controlled dynamically by a currency

Thomas Sandholm (JIRA — 2008-12-04T02:03:44

[ https://issues.apache.org/jira/browse/HADOOP-4768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Sandholm updated HADOOP-4768: ------------------------------------ Status: Patch Available (was: Open) New Dynamic Scheduler classes and test cases, patch against revision 722987

[jira] Created: (HADOOP-4768) Dynamic Priority Scheduler that allows queue shares to be controlled dynamically by a currency

Thomas Sandholm (JIRA — 2008-12-04T01:59:44

Dynamic Priority Scheduler that allows queue shares to be controlled dynamically by a currency ---------------------------------------------------------------------------------------------- Key: HADOOP-4768 URL: https://issues.apache.org/jira/browse/HADOOP-4768 Project: Hadoop Core Issue Type: New Feature Components: contrib/capacity-sched, contrib/fair-share Affects Versions: 0.20.0 Reporter: Thomas Sandholm Fix For: 0.20.0 Contribution based on work presented at the Hadoop User Group meeting in Santa Clara in September and the HadoopCamp in New Orleans in November. From README: This package implements dynamic priority scheduling for MapReduce jobs. Overview -------- The purpose of this scheduler is to allow users to increase and decrease their queue priorities continuosly to meet the requirements of their current workloads. The scheduler is aware of the current demand and makes it more expensive to boost th

[jira] Updated: (HADOOP-4690) fuse-dfs - create source file/function + utils + config + main source files

Mahadev konar (JIRA — 2008-12-04T01:45:47

[ https://issues.apache.org/jira/browse/HADOOP-4690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated HADOOP-4690: ---------------------------------- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) I just committed this. Thanks pete.

[jira] Created: (HADOOP-4767) Provide sample fair scheduler config file in conf/ and set config file property to point to this by default

Matei Zaharia (JIRA — 2008-12-04T01:39:44

Provide sample fair scheduler config file in conf/ and set config file property to point to this by default ----------------------------------------------------------------------------------------------------------- Key: HADOOP-4767 URL: https://issues.apache.org/jira/browse/HADOOP-4767 Project: Hadoop Core Issue Type: New Feature Components: contrib/fair-share Reporter: Matei Zaharia Priority: Minor The capacity scheduler includes a config file template in hadoop/conf, so it would make sense to create a similar one for the fair scheduler and mention it in the README.

[jira] Updated: (HADOOP-4717) Removal of default port# in NameNode.getUri() cause a map/reduce job failed to prompt temporay output

Hairong Kuang (JIRA — 2008-12-04T01:29:44

[ https://issues.apache.org/jira/browse/HADOOP-4717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HADOOP-4717: ---------------------------------- Attachment: relativePath.patch In addition to Doug's change, this patch 1. throws IOException if relativitize fails as Koji suggested; 2. add a unit test to make sure a map/reduce job with output path containing no port works.

[jira] Updated: (HADOOP-4722) adding tests for quotas command line error messages

Chris Douglas (JIRA — 2008-12-04T01:21:44

[ https://issues.apache.org/jira/browse/HADOOP-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-4722: ---------------------------------- Resolution: Fixed Fix Version/s: 0.20.0 Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Ran TestCLI, confirmed test output in logs. I just committed this. Thanks, Boris.

[jira] Commented: (HADOOP-4760) Configuration addResource(InputStream) fails with HDFS streams

Alejandro Abdelnur (JIRA — 2008-12-04T01:17:44

[ https://issues.apache.org/jira/browse/HADOOP-4760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12653105#action_12653105 ] Alejandro Abdelnur commented on HADOOP-4760: -------------------------------------------- Doug, you are correct, according to the {{Closeable}} API: Closes this stream and releases any system resources associated with it. If the stream is already closed then invoking this method has no effect.

[jira] Updated: (HADOOP-4758) Add a splitter for metrics contexts

Chris Douglas (JIRA — 2008-12-04T01:17:44

[ https://issues.apache.org/jira/browse/HADOOP-4758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-4758: ---------------------------------- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) I just committed this.

[jira] Commented: (HADOOP-4758) Add a splitter for metrics contexts

Chris Douglas (JIRA — 2008-12-04T01:07:44

[ https://issues.apache.org/jira/browse/HADOOP-4758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12653097#action_12653097 ] Chris Douglas commented on HADOOP-4758: --------------------------------------- {noformat} [exec] -1 overall. [exec] +1 < at >author. The patch does not contain any < at >author tags. [exec] -1 tests included. The patch doesn't appear to include any new or modified tests. [exec] Please justify why no tests are needed for this patch. [exec] +1 javadoc. The javadoc tool did not generate any warning messages. [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings. [exec] +1 findbugs. The patch does not introduce any new Findbugs warnings. [exec] +1 Eclipse classpath. The patch retains Eclipse classpath integrity. {noformat} There are no unit tests for metrics.

[jira] Updated: (HADOOP-4728) Tests for NameNode -checkpoint option with different configurations

Chris Douglas (JIRA — 2008-12-04T01:01:44

[ https://issues.apache.org/jira/browse/HADOOP-4728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-4728: ---------------------------------- Status: Open (was: Patch Available) According to [this|http://wiki.apache.org/hadoop/CodeReviewChecklist], servers should not be directly instantiated. Is it possible to implement these tests using MiniDFSCluster? Sorry for missing this in the original review.

[jira] Updated: (HADOOP-4753) gridmix2 code can be condensed

Chris Douglas (JIRA — 2008-12-04T00:47:44

[ https://issues.apache.org/jira/browse/HADOOP-4753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-4753: ---------------------------------- Attachment: 4753-1.patch Fix a bug in GridMixRunner::select

[jira] Commented: (HADOOP-4758) Add a splitter for metrics contexts

Eric Yang (JIRA — 2008-12-04T00:13:44

[ https://issues.apache.org/jira/browse/HADOOP-4758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12653077#action_12653077 ] Eric Yang commented on HADOOP-4758: ----------------------------------- The patch looks good. We manage to get simon and chukwa running in parallel. +1

[jira] Updated: (HADOOP-4742) Mistake delete replica in hadoop 0.18.1

Hairong Kuang (JIRA — 2008-12-03T23:59:44

[ https://issues.apache.org/jira/browse/HADOOP-4742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HADOOP-4742: ---------------------------------- Attachment: blockReceived-br18.patch This is the patch for branch 0.18.

[jira] Updated: (HADOOP-4742) Mistake delete replica in hadoop 0.18.1

Hairong Kuang (JIRA — 2008-12-03T23:59:44

[jira] Updated: (HADOOP-4742) Mistake delete replica in hadoop 0.18.1

Hairong Kuang (JIRA — 2008-12-03T23:59:44

[jira] Updated: (HADOOP-4742) Mistake delete replica in hadoop 0.18.1

Hairong Kuang (JIRA — 2008-12-03T23:55:44