http://blog.gmane.org/gmane.comp.java.hadoop.pig.devel hourly 1 1901-01-01T00:00+00:00 http://gmane.org/img/gmane-25t.png http://gmane.org http://comments.gmane.org/gmane.comp.java.hadoop.pig.devel/31181 <pre>Issue Subscription Filter: PIG patch available (19 issues) Subscriber: pigdaily Key Summary PIG-3335 TestErrorHandling.tesNegative7 fails on MR2 https://issues.apache.org/jira/browse/PIG-3335 PIG-3334 Fix Windows piggybank unit test failures https://issues.apache.org/jira/browse/PIG-3334 PIG-3333 Fix remaining Windows core unit test failures https://issues.apache.org/jira/browse/PIG-3333 PIG-3328 DataBags created with an initial list of tuples don't get registered as spillable https://issues.apache.org/jira/browse/PIG-3328 PIG-3318 AVRO: 'default value' not honored when merging schemas on load with AvroStorage https://issues.apache.org/jira/browse/PIG-3318 PIG-3295 Casting from bytearray failing after Union (even when each field is from a single Loader) https://issues.apache.org/jira/browse/PIG-3295 PIG-3285 Jobs using HBaseStorage fail to ship dependency jars https://issues.apache.org/jira/browse/PIG-3285 PIG-3258 Patch to allow MultiStorage to use more than one index to generate output tree https://issues.apache.org/jira/browse/PIG-3258 PIG-3257 Add unique identifier UDF https://issues.apache.org/jira/browse/PIG-3257 PIG-3247 Piggybank functions to mimic OVER clause in SQL https://issues.apache.org/jira/browse/PIG-3247 PIG-3210 Pig fails to start when it cannot write log to log files https://issues.apache.org/jira/browse/PIG-3210 PIG-3199 Expose LogicalPlan via PigServer API https://issues.apache.org/jira/browse/PIG-3199 PIG-3166 Update eclipse .classpath according to ivy library.properties https://issues.apache.org/jira/browse/PIG-3166 PIG-3123 Simplify Logical Plans By Removing Unneccessary Identity Projections https://issues.apache.org/jira/browse/PIG-3123 PIG-3088 Add a builtin udf which removes prefixes https://issues.apache.org/jira/browse/PIG-3088 PIG-3015 Rewrite of AvroStorage https://issues.apache.org/jira/browse/PIG-3015 PIG-2248 Pig parser does not detect when a macro name masks a UDF name https://issues.apache.org/jira/browse/PIG-2248 PIG-2244 Macros cannot be passed relation names https://issues.apache.org/jira/browse/PIG-2244 PIG-1914 Support load/store JSON data in Pig https://issues.apache.org/jira/browse/PIG-1914 You may edit this subscription at: https://issues.apache.org/jira/secure/FilterSubscription!default.jspa?subId=13225&amp;filterId=12322384 </pre> jira-1oDqGaOF3Lkdnm+yROfE0A< at >public.gmane.org 2013-05-23T01:01:59 http://comments.gmane.org/gmane.comp.java.hadoop.pig.devel/31168 <pre>Issue Subscription Filter: PIG patch available (19 issues) Subscriber: pigdaily Key Summary PIG-3335 TestErrorHandling.tesNegative7 fails on MR2 https://issues.apache.org/jira/browse/PIG-3335 PIG-3334 Fix Windows piggybank unit test failures https://issues.apache.org/jira/browse/PIG-3334 PIG-3333 Fix remaining Windows core unit test failures https://issues.apache.org/jira/browse/PIG-3333 PIG-3328 DataBags created with an initial list of tuples don't get registered as spillable https://issues.apache.org/jira/browse/PIG-3328 PIG-3318 AVRO: 'default value' not honored when merging schemas on load with AvroStorage https://issues.apache.org/jira/browse/PIG-3318 PIG-3295 Casting from bytearray failing after Union (even when each field is from a single Loader) https://issues.apache.org/jira/browse/PIG-3295 PIG-3285 Jobs using HBaseStorage fail to ship dependency jars https://issues.apache.org/jira/browse/PIG-3285 PIG-3258 Patch to allow MultiStorage to use more than one index to generate output tree https://issues.apache.org/jira/browse/PIG-3258 PIG-3257 Add unique identifier UDF https://issues.apache.org/jira/browse/PIG-3257 PIG-3247 Piggybank functions to mimic OVER clause in SQL https://issues.apache.org/jira/browse/PIG-3247 PIG-3210 Pig fails to start when it cannot write log to log files https://issues.apache.org/jira/browse/PIG-3210 PIG-3199 Expose LogicalPlan via PigServer API https://issues.apache.org/jira/browse/PIG-3199 PIG-3166 Update eclipse .classpath according to ivy library.properties https://issues.apache.org/jira/browse/PIG-3166 PIG-3123 Simplify Logical Plans By Removing Unneccessary Identity Projections https://issues.apache.org/jira/browse/PIG-3123 PIG-3088 Add a builtin udf which removes prefixes https://issues.apache.org/jira/browse/PIG-3088 PIG-3015 Rewrite of AvroStorage https://issues.apache.org/jira/browse/PIG-3015 PIG-2248 Pig parser does not detect when a macro name masks a UDF name https://issues.apache.org/jira/browse/PIG-2248 PIG-2244 Macros cannot be passed relation names https://issues.apache.org/jira/browse/PIG-2244 PIG-1914 Support load/store JSON data in Pig https://issues.apache.org/jira/browse/PIG-1914 You may edit this subscription at: https://issues.apache.org/jira/secure/FilterSubscription!default.jspa?subId=13225&amp;filterId=12322384 </pre> jira-1oDqGaOF3Lkdnm+yROfE0A< at >public.gmane.org 2013-05-22T01:00:45 http://comments.gmane.org/gmane.comp.java.hadoop.pig.devel/31162 <pre>Hi, How to read the string array using any pig parser {"string_array"}:["value1","value2"] does not With Regards Siva </pre> siva Reddy 2013-05-21T21:39:53 http://comments.gmane.org/gmane.comp.java.hadoop.pig.devel/31138 <pre>Issue Subscription Filter: PIG patch available (19 issues) Subscriber: pigdaily Key Summary PIG-3332 Upgrade Avro dependency to 1.7.4 https://issues.apache.org/jira/browse/PIG-3332 PIG-3328 DataBags created with an initial list of tuples don't get registered as spillable https://issues.apache.org/jira/browse/PIG-3328 PIG-3318 AVRO: 'default value' not honored when merging schemas on load with AvroStorage https://issues.apache.org/jira/browse/PIG-3318 PIG-3297 Avro files with stringType set to String cannot be read by the AvroStorage LoadFunc https://issues.apache.org/jira/browse/PIG-3297 PIG-3295 Casting from bytearray failing after Union (even when each field is from a single Loader) https://issues.apache.org/jira/browse/PIG-3295 PIG-3285 Jobs using HBaseStorage fail to ship dependency jars https://issues.apache.org/jira/browse/PIG-3285 PIG-3258 Patch to allow MultiStorage to use more than one index to generate output tree https://issues.apache.org/jira/browse/PIG-3258 PIG-3257 Add unique identifier UDF https://issues.apache.org/jira/browse/PIG-3257 PIG-3247 Piggybank functions to mimic OVER clause in SQL https://issues.apache.org/jira/browse/PIG-3247 PIG-3210 Pig fails to start when it cannot write log to log files https://issues.apache.org/jira/browse/PIG-3210 PIG-3199 Expose LogicalPlan via PigServer API https://issues.apache.org/jira/browse/PIG-3199 PIG-3166 Update eclipse .classpath according to ivy library.properties https://issues.apache.org/jira/browse/PIG-3166 PIG-3123 Simplify Logical Plans By Removing Unneccessary Identity Projections https://issues.apache.org/jira/browse/PIG-3123 PIG-3088 Add a builtin udf which removes prefixes https://issues.apache.org/jira/browse/PIG-3088 PIG-3024 TestEmptyInputDir unit test - hadoop version detection logic is brittle https://issues.apache.org/jira/browse/PIG-3024 PIG-3015 Rewrite of AvroStorage https://issues.apache.org/jira/browse/PIG-3015 PIG-2248 Pig parser does not detect when a macro name masks a UDF name https://issues.apache.org/jira/browse/PIG-2248 PIG-2244 Macros cannot be passed relation names https://issues.apache.org/jira/browse/PIG-2244 PIG-1914 Support load/store JSON data in Pig https://issues.apache.org/jira/browse/PIG-1914 You may edit this subscription at: https://issues.apache.org/jira/secure/FilterSubscription!default.jspa?subId=13225&amp;filterId=12322384 </pre> jira-1oDqGaOF3Lkdnm+yROfE0A< at >public.gmane.org 2013-05-21T01:02:24 http://comments.gmane.org/gmane.comp.java.hadoop.pig.devel/31119 <pre>Issue Subscription Filter: PIG patch available (17 issues) Subscriber: pigdaily Key Summary PIG-3328 DataBags created with an initial list of tuples don't get registered as spillable https://issues.apache.org/jira/browse/PIG-3328 PIG-3318 AVRO: 'default value' not honored when merging schemas on load with AvroStorage https://issues.apache.org/jira/browse/PIG-3318 PIG-3295 Casting from bytearray failing after Union (even when each field is from a single Loader) https://issues.apache.org/jira/browse/PIG-3295 PIG-3285 Jobs using HBaseStorage fail to ship dependency jars https://issues.apache.org/jira/browse/PIG-3285 PIG-3258 Patch to allow MultiStorage to use more than one index to generate output tree https://issues.apache.org/jira/browse/PIG-3258 PIG-3257 Add unique identifier UDF https://issues.apache.org/jira/browse/PIG-3257 PIG-3247 Piggybank functions to mimic OVER clause in SQL https://issues.apache.org/jira/browse/PIG-3247 PIG-3210 Pig fails to start when it cannot write log to log files https://issues.apache.org/jira/browse/PIG-3210 PIG-3199 Expose LogicalPlan via PigServer API https://issues.apache.org/jira/browse/PIG-3199 PIG-3166 Update eclipse .classpath according to ivy library.properties https://issues.apache.org/jira/browse/PIG-3166 PIG-3123 Simplify Logical Plans By Removing Unneccessary Identity Projections https://issues.apache.org/jira/browse/PIG-3123 PIG-3088 Add a builtin udf which removes prefixes https://issues.apache.org/jira/browse/PIG-3088 PIG-3024 TestEmptyInputDir unit test - hadoop version detection logic is brittle https://issues.apache.org/jira/browse/PIG-3024 PIG-3015 Rewrite of AvroStorage https://issues.apache.org/jira/browse/PIG-3015 PIG-2248 Pig parser does not detect when a macro name masks a UDF name https://issues.apache.org/jira/browse/PIG-2248 PIG-2244 Macros cannot be passed relation names https://issues.apache.org/jira/browse/PIG-2244 PIG-1914 Support load/store JSON data in Pig https://issues.apache.org/jira/browse/PIG-1914 You may edit this subscription at: https://issues.apache.org/jira/secure/FilterSubscription!default.jspa?subId=13225&amp;filterId=12322384 </pre> jira-1oDqGaOF3Lkdnm+yROfE0A< at >public.gmane.org 2013-05-20T01:02:23 http://comments.gmane.org/gmane.comp.java.hadoop.pig.devel/31117 <pre>Issue Subscription Filter: PIG patch available (17 issues) Subscriber: pigdaily Key Summary PIG-3328 DataBags created with an initial list of tuples don't get registered as spillable https://issues.apache.org/jira/browse/PIG-3328 PIG-3318 AVRO: 'default value' not honored when merging schemas on load with AvroStorage https://issues.apache.org/jira/browse/PIG-3318 PIG-3295 Casting from bytearray failing after Union (even when each field is from a single Loader) https://issues.apache.org/jira/browse/PIG-3295 PIG-3285 Jobs using HBaseStorage fail to ship dependency jars https://issues.apache.org/jira/browse/PIG-3285 PIG-3258 Patch to allow MultiStorage to use more than one index to generate output tree https://issues.apache.org/jira/browse/PIG-3258 PIG-3257 Add unique identifier UDF https://issues.apache.org/jira/browse/PIG-3257 PIG-3247 Piggybank functions to mimic OVER clause in SQL https://issues.apache.org/jira/browse/PIG-3247 PIG-3210 Pig fails to start when it cannot write log to log files https://issues.apache.org/jira/browse/PIG-3210 PIG-3199 Expose LogicalPlan via PigServer API https://issues.apache.org/jira/browse/PIG-3199 PIG-3166 Update eclipse .classpath according to ivy library.properties https://issues.apache.org/jira/browse/PIG-3166 PIG-3123 Simplify Logical Plans By Removing Unneccessary Identity Projections https://issues.apache.org/jira/browse/PIG-3123 PIG-3088 Add a builtin udf which removes prefixes https://issues.apache.org/jira/browse/PIG-3088 PIG-3024 TestEmptyInputDir unit test - hadoop version detection logic is brittle https://issues.apache.org/jira/browse/PIG-3024 PIG-3015 Rewrite of AvroStorage https://issues.apache.org/jira/browse/PIG-3015 PIG-2248 Pig parser does not detect when a macro name masks a UDF name https://issues.apache.org/jira/browse/PIG-2248 PIG-2244 Macros cannot be passed relation names https://issues.apache.org/jira/browse/PIG-2244 PIG-1914 Support load/store JSON data in Pig https://issues.apache.org/jira/browse/PIG-1914 You may edit this subscription at: https://issues.apache.org/jira/secure/FilterSubscription!default.jspa?subId=13225&amp;filterId=12322384 </pre> jira-1oDqGaOF3Lkdnm+yROfE0A< at >public.gmane.org 2013-05-19T01:02:23 http://comments.gmane.org/gmane.comp.java.hadoop.pig.devel/31113 <pre>Issue Subscription Filter: PIG patch available (17 issues) Subscriber: pigdaily Key Summary PIG-3328 DataBags created with an initial list of tuples don't get registered as spillable https://issues.apache.org/jira/browse/PIG-3328 PIG-3318 AVRO: 'default value' not honored when merging schemas on load with AvroStorage https://issues.apache.org/jira/browse/PIG-3318 PIG-3295 Casting from bytearray failing after Union (even when each field is from a single Loader) https://issues.apache.org/jira/browse/PIG-3295 PIG-3285 Jobs using HBaseStorage fail to ship dependency jars https://issues.apache.org/jira/browse/PIG-3285 PIG-3258 Patch to allow MultiStorage to use more than one index to generate output tree https://issues.apache.org/jira/browse/PIG-3258 PIG-3257 Add unique identifier UDF https://issues.apache.org/jira/browse/PIG-3257 PIG-3247 Piggybank functions to mimic OVER clause in SQL https://issues.apache.org/jira/browse/PIG-3247 PIG-3210 Pig fails to start when it cannot write log to log files https://issues.apache.org/jira/browse/PIG-3210 PIG-3199 Expose LogicalPlan via PigServer API https://issues.apache.org/jira/browse/PIG-3199 PIG-3166 Update eclipse .classpath according to ivy library.properties https://issues.apache.org/jira/browse/PIG-3166 PIG-3123 Simplify Logical Plans By Removing Unneccessary Identity Projections https://issues.apache.org/jira/browse/PIG-3123 PIG-3088 Add a builtin udf which removes prefixes https://issues.apache.org/jira/browse/PIG-3088 PIG-3024 TestEmptyInputDir unit test - hadoop version detection logic is brittle https://issues.apache.org/jira/browse/PIG-3024 PIG-3015 Rewrite of AvroStorage https://issues.apache.org/jira/browse/PIG-3015 PIG-2248 Pig parser does not detect when a macro name masks a UDF name https://issues.apache.org/jira/browse/PIG-2248 PIG-2244 Macros cannot be passed relation names https://issues.apache.org/jira/browse/PIG-2244 PIG-1914 Support load/store JSON data in Pig https://issues.apache.org/jira/browse/PIG-1914 You may edit this subscription at: https://issues.apache.org/jira/secure/FilterSubscription!default.jspa?subId=13225&amp;filterId=12322384 </pre> jira-1oDqGaOF3Lkdnm+yROfE0A< at >public.gmane.org 2013-05-18T01:02:25 http://comments.gmane.org/gmane.comp.java.hadoop.pig.devel/31096 <pre>See &lt;https://builds.apache.org/job/Pig-trunk/1476/changes&gt; Changes: [billgraham] PIG-3317: disable optimizations via pig properties (traviscrawford via billgraham) ------------------------------------------ [...truncated 2676 lines...] [ivy:resolve] found log4j#log4j;1.2.16 in fs [ivy:resolve] found org.slf4j#slf4j-log4j12;1.6.1 in fs [ivy:resolve] found org.apache.avro#avro;1.5.3 in fs [ivy:resolve] found com.thoughtworks.paranamer#paranamer;2.3 in fs [ivy:resolve] found org.xerial.snappy#snappy-java;1.0.3.2 in fs [ivy:resolve] found org.slf4j#slf4j-api;1.6.1 in fs [ivy:resolve] found com.googlecode.json-simple#json-simple;1.1 in fs [ivy:resolve] found com.jcraft#jsch;0.1.38 in fs [ivy:resolve] found jline#jline;0.9.94 in fs [ivy:resolve] found net.java.dev.javacc#javacc;4.2 in maven2 [ivy:resolve] found org.codehaus.groovy#groovy-all;1.8.6 in maven2 [ivy:resolve] found org.codehaus.jackson#jackson-mapper-asl;1.8.8 in fs [ivy:resolve] found org.codehaus.jackson#jackson-core-asl;1.8.8 in fs [ivy:resolve] found org.fusesource.jansi#jansi;1.9 in maven2 [ivy:resolve] found joda-time#joda-time;2.1 in maven2 [ivy:resolve] found com.google.guava#guava;11.0 in maven2 [ivy:resolve] found org.python#jython-standalone;2.5.3 in maven2 [ivy:resolve] found rhino#js;1.7R2 in maven2 [ivy:resolve] found org.antlr#antlr;3.4 in fs [ivy:resolve] found org.antlr#antlr-runtime;3.4 in fs [ivy:resolve] found org.antlr#stringtemplate;3.2.1 in fs [ivy:resolve] found antlr#antlr;2.7.7 in fs [ivy:resolve] found org.antlr#ST4;4.0.4 in fs [ivy:resolve] found org.apache.zookeeper#zookeeper;3.4.4 in maven2 [ivy:resolve] found dk.brics.automaton#automaton;1.11-8 in maven2 [ivy:resolve] found org.jruby#jruby-complete;1.6.7 in maven2 [ivy:resolve] found asm#asm;3.3.1 in fs [ivy:resolve] found org.apache.hbase#hbase;0.94.1 in maven2 [ivy:resolve] found org.vafer#jdeb;0.8 in maven2 [ivy:resolve] found org.mockito#mockito-all;1.8.4 in maven2 [ivy:resolve] found xalan#xalan;2.7.1 in maven2 [ivy:resolve] found xalan#serializer;2.7.1 in maven2 [ivy:resolve] found xml-apis#xml-apis;1.3.04 in fs [ivy:resolve] found xerces#xercesImpl;2.10.0 in maven2 [ivy:resolve] found xml-apis#xml-apis;1.4.01 in maven2 [ivy:resolve] found junit#junit;4.11 in maven2 [ivy:resolve] found org.hamcrest#hamcrest-core;1.3 in maven2 [ivy:resolve] found org.jboss.netty#netty;3.2.2.Final in fs [ivy:resolve] found com.github.stephenc.high-scale-lib#high-scale-lib;1.1.1 in fs [ivy:resolve] found com.google.protobuf#protobuf-java;2.4.0a in fs [ivy:resolve] found com.yammer.metrics#metrics-core;2.1.2 in fs [ivy:resolve] found org.slf4j#slf4j-api;1.6.4 in fs [ivy:resolve] found org.apache.hive#hive-exec;0.8.0 in maven2 [ivy:resolve] found junit#junit;3.8.1 in fs [ivy:resolve] found com.google.code.p.arat#rat-lib;0.5.1 in maven2 [ivy:resolve] found commons-collections#commons-collections;3.2 in fs [ivy:resolve] found commons-lang#commons-lang;2.1 in fs [ivy:resolve] found jdiff#jdiff;1.0.9 in fs [ivy:resolve] found checkstyle#checkstyle;4.2 in maven2 [ivy:resolve] found commons-beanutils#commons-beanutils-core;1.7.0 in fs [ivy:resolve] found commons-cli#commons-cli;1.0 in fs [ivy:resolve] found commons-logging#commons-logging;1.0.3 in fs [ivy:resolve] found org.codehaus.jackson#jackson-mapper-asl;1.0.1 in fs [ivy:resolve] found org.codehaus.jackson#jackson-core-asl;1.0.1 in fs [ivy:resolve] found com.sun.jersey#jersey-bundle;1.8 in maven2 [ivy:resolve] found com.sun.jersey#jersey-server;1.8 in fs [ivy:resolve] found com.sun.jersey.contribs#jersey-guice;1.8 in fs [ivy:resolve] found commons-httpclient#commons-httpclient;3.1 in fs [ivy:resolve] found javax.servlet#servlet-api;2.5 in fs [ivy:resolve] found javax.ws.rs#jsr311-api;1.1.1 in maven2 [ivy:resolve] found javax.inject#javax.inject;1 in fs [ivy:resolve] found javax.xml.bind#jaxb-api;2.2.2 in fs [ivy:resolve] found com.sun.xml.bind#jaxb-impl;2.2.3-1 in fs [ivy:resolve] found com.google.inject#guice;3.0 in fs [ivy:resolve] found com.google.inject.extensions#guice-servlet;3.0 in fs [ivy:resolve] found aopalliance#aopalliance;1.0 in fs [ivy:resolve] found org.apache.hadoop#hadoop-annotations;2.0.3-alpha in fs [ivy:resolve] found org.apache.hadoop#hadoop-auth;2.0.3-alpha in fs [ivy:resolve] found org.apache.hadoop#hadoop-common;2.0.3-alpha in fs [ivy:resolve] found org.apache.hadoop#hadoop-hdfs;2.0.3-alpha in fs [ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-core;2.0.3-alpha in fs [ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-jobclient;2.0.3-alpha in fs [ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-tests;2.0.3-alpha in fs [ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-app;2.0.3-alpha in fs [ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-shuffle;2.0.3-alpha in fs [ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-common;2.0.3-alpha in fs [ivy:resolve] found org.apache.hadoop#hadoop-yarn-api;2.0.3-alpha in fs [ivy:resolve] found org.apache.hadoop#hadoop-yarn-common;2.0.3-alpha in fs [ivy:resolve] found org.apache.hadoop#hadoop-yarn-server;2.0.3-alpha in fs [ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-web-proxy;2.0.3-alpha in fs [ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-common;2.0.3-alpha in fs [ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-nodemanager;2.0.3-alpha in fs [ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-resourcemanager;2.0.3-alpha in fs [ivy:resolve] found org.apache.hadoop#hadoop-yarn-client;2.0.3-alpha in fs [ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-hs;2.0.3-alpha in fs [ivy:resolve] :: resolution report :: resolve 4883ms :: artifacts dl 1325ms [ivy:resolve] :: evicted modules: [ivy:resolve] junit#junit;3.8.1 by [junit#junit;4.11] in [default, test, runtime, javadoc, buildJar] [ivy:resolve] commons-logging#commons-logging;1.0.3 by [commons-logging#commons-logging;1.1.1] in [default, hadoop20, test, compile, runtime, javadoc, buildJar] [ivy:resolve] commons-codec#commons-codec;1.2 by [commons-codec#commons-codec;1.4] in [default, hadoop20, test, compile, runtime, javadoc, buildJar] [ivy:resolve] commons-logging#commons-logging;1.1 by [commons-logging#commons-logging;1.1.1] in [default, hadoop20, test, compile, runtime, javadoc, buildJar] [ivy:resolve] commons-codec#commons-codec;1.3 by [commons-codec#commons-codec;1.4] in [default, hadoop20, test, compile, runtime, javadoc, buildJar] [ivy:resolve] commons-httpclient#commons-httpclient;3.1 by [commons-httpclient#commons-httpclient;3.0.1] in [default, hadoop20, test, compile, runtime, javadoc, buildJar] [ivy:resolve] org.codehaus.jackson#jackson-mapper-asl;1.0.1 by [org.codehaus.jackson#jackson-mapper-asl;1.8.8] in [default, test, compile, runtime, javadoc, buildJar] [ivy:resolve] org.slf4j#slf4j-api;1.5.2 by [org.slf4j#slf4j-api;1.6.1] in [default, test, compile, runtime, javadoc, buildJar] [ivy:resolve] org.apache.mina#mina-core;2.0.0-M4 by [org.apache.mina#mina-core;2.0.0-M5] in [default, hadoop20, test, compile, runtime, javadoc, buildJar] [ivy:resolve] org.apache.ftpserver#ftplet-api;1.0.0-M2 by [org.apache.ftpserver#ftplet-api;1.0.0] in [default, hadoop20, test, compile, runtime, javadoc, buildJar] [ivy:resolve] org.apache.ftpserver#ftpserver-core;1.0.0-M2 by [org.apache.ftpserver#ftpserver-core;1.0.0] in [default, hadoop20, test, compile, runtime, javadoc, buildJar] [ivy:resolve] org.apache.mina#mina-core;2.0.0-M2 by [org.apache.mina#mina-core;2.0.0-M5] in [default, hadoop20, test, compile, runtime, javadoc, buildJar] [ivy:resolve] commons-cli#commons-cli;1.0 by [commons-cli#commons-cli;1.2] in [default, test, compile, runtime, javadoc, buildJar] [ivy:resolve] org.codehaus.jackson#jackson-mapper-asl;1.7.3 by [org.codehaus.jackson#jackson-mapper-asl;1.8.8] in [default, test, compile, runtime, javadoc, buildJar] [ivy:resolve] org.slf4j#slf4j-api;1.6.1 by [org.slf4j#slf4j-api;1.6.4] in [default, test, runtime, javadoc, buildJar] [ivy:resolve] org.antlr#antlr-runtime;3.3 by [org.antlr#antlr-runtime;3.4] in [default, test, compile, runtime, javadoc, buildJar] [ivy:resolve] xml-apis#xml-apis;1.3.04 by [xml-apis#xml-apis;1.4.01] in [default, test, runtime, javadoc, buildJar] --------------------------------------------------------------------- | | modules || artifacts | | conf | number| search|dwnlded|evicted|| number|dwnlded| --------------------------------------------------------------------- | master | 0 | 0 | 0 | 0 || 0 | 0 | | default | 96 | 43 | 0 | 17 || 80 | 0 | | runtime | 96 | 43 | 0 | 17 || 80 | 0 | | compile | 83 | 40 | 0 | 14 || 70 | 0 | | test | 96 | 43 | 0 | 17 || 80 | 0 | | javadoc | 96 | 43 | 0 | 17 || 80 | 0 | | releaseaudit | 3 | 2 | 0 | 0 || 3 | 0 | | jdiff | 3 | 1 | 0 | 0 || 3 | 0 | | checkstyle | 6 | 5 | 0 | 0 || 6 | 0 | | buildJar | 96 | 43 | 0 | 17 || 80 | 0 | | hadoop20 | 48 | 28 | 0 | 9 || 39 | 0 | | hadoop23 | 40 | 17 | 0 | 0 || 42 | 0 | --------------------------------------------------------------------- ivy-compile: [ivy:retrieve] :: retrieving :: org.apache.pig#pig [ivy:retrieve] confs: [compile] [ivy:retrieve] 70 artifacts copied, 0 already retrieved (70456kB/920ms) [ivy:cachepath] DEPRECATED: 'ivy.conf.file' is deprecated, use 'ivy.settings.file' instead [ivy:cachepath] :: loading settings :: file = &lt;https://builds.apache.org/job/Pig-trunk/ws/trunk/ivy/ivysettings.xml&gt; init: [mkdir] Created dir: &lt;https://builds.apache.org/job/Pig-trunk/ws/trunk/src-gen/org/apache/pig/impl/logicalLayer/parser&gt; [mkdir] Created dir: &lt;https://builds.apache.org/job/Pig-trunk/ws/trunk/src-gen/org/apache/pig/tools/pigscript/parser&gt; [mkdir] Created dir: &lt;https://builds.apache.org/job/Pig-trunk/ws/trunk/src-gen/org/apache/pig/tools/parameters&gt; [mkdir] Created dir: &lt;https://builds.apache.org/job/Pig-trunk/ws/trunk/build/classes&gt; [mkdir] Created dir: &lt;https://builds.apache.org/job/Pig-trunk/ws/trunk/build/test/classes&gt; [mkdir] Created dir: &lt;https://builds.apache.org/job/Pig-trunk/ws/trunk/test/org/apache/pig/test/utils/dotGraph/parser&gt; [mkdir] Created dir: &lt;https://builds.apache.org/job/Pig-trunk/ws/trunk/src-gen/org/apache/pig/data/parser&gt; [move] Moving 1 file to &lt;https://builds.apache.org/job/Pig-trunk/ws/trunk/build/ivy/lib/Pig&gt; cc-compile: [javacc] Java Compiler Compiler Version 4.2 (Parser Generator) [javacc] (type "javacc" with no arguments for help) [javacc] Reading from file &lt;https://builds.apache.org/job/Pig-trunk/ws/trunk/src/org/apache/pig/tools/pigscript/parser/PigScriptParser.jj&gt; . . . [javacc] File "TokenMgrError.java" does not exist. Will create one. [javacc] File "ParseException.java" does not exist. Will create one. [javacc] File "Token.java" does not exist. Will create one. [javacc] File "JavaCharStream.java" does not exist. Will create one. [javacc] Parser generated successfully. [javacc] Java Compiler Compiler Version 4.2 (Parser Generator) [javacc] (type "javacc" with no arguments for help) [javacc] Reading from file &lt;https://builds.apache.org/job/Pig-trunk/ws/trunk/src/org/apache/pig/tools/parameters/PigFileParser.jj&gt; . . . [javacc] Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking. [javacc] File "TokenMgrError.java" does not exist. Will create one. [javacc] File "ParseException.java" does not exist. Will create one. [javacc] File "Token.java" does not exist. Will create one. [javacc] File "JavaCharStream.java" does not exist. Will create one. [javacc] Parser generated with 0 errors and 1 warnings. [javacc] Java Compiler Compiler Version 4.2 (Parser Generator) [javacc] (type "javacc" with no arguments for help) [javacc] Reading from file &lt;https://builds.apache.org/job/Pig-trunk/ws/trunk/src/org/apache/pig/tools/parameters/ParamLoader.jj&gt; . . . [javacc] File "TokenMgrError.java" is being rebuilt. [javacc] File "ParseException.java" is being rebuilt. [javacc] File "Token.java" is being rebuilt. [javacc] File "JavaCharStream.java" is being rebuilt. [javacc] Parser generated successfully. [jjtree] Java Compiler Compiler Version 4.2 (Tree Builder) [jjtree] (type "jjtree" with no arguments for help) [jjtree] Reading from file &lt;https://builds.apache.org/job/Pig-trunk/ws/trunk/test/org/apache/pig/test/utils/dotGraph/DOTParser.jjt&gt; . . . [jjtree] File "Node.java" does not exist. Will create one. [jjtree] File "SimpleNode.java" does not exist. Will create one. [jjtree] File "DOTParserTreeConstants.java" does not exist. Will create one. [jjtree] File "JJTDOTParserState.java" does not exist. Will create one. [jjtree] Annotated grammar generated successfully in &lt;https://builds.apache.org/job/Pig-trunk/ws/trunk/test/org/apache/pig/test/utils/dotGraph/parser/DOTParser.jj&gt; [javacc] Java Compiler Compiler Version 4.2 (Parser Generator) [javacc] (type "javacc" with no arguments for help) [javacc] Reading from file &lt;https://builds.apache.org/job/Pig-trunk/ws/trunk/test/org/apache/pig/test/utils/dotGraph/parser/DOTParser.jj&gt; . . . [javacc] File "TokenMgrError.java" does not exist. Will create one. [javacc] File "ParseException.java" does not exist. Will create one. [javacc] File "Token.java" does not exist. Will create one. [javacc] File "SimpleCharStream.java" does not exist. Will create one. [javacc] Parser generated successfully. prepare: [mkdir] Created dir: &lt;https://builds.apache.org/job/Pig-trunk/ws/trunk/src-gen/org/apache/pig/parser&gt; genLexer: genParser: genTreeParser: gen: compile: [echo] *** Building Main Sources *** [echo] *** To compile with all warnings enabled, supply -Dall.warnings=1 on command line *** [echo] *** Else, you will only be warned about deprecations *** [javac] Compiling 804 source files to &lt;https://builds.apache.org/job/Pig-trunk/ws/trunk/build/classes&gt; [javac] &lt;https://builds.apache.org/job/Pig-trunk/ws/trunk/src/org/apache/pig/Main.java&gt;:64: cannot find symbol [javac] symbol : class PigImplConstants [javac] location: package org.apache.pig.impl [javac] import org.apache.pig.impl.PigImplConstants; [javac] ^ [javac] &lt;https://builds.apache.org/job/Pig-trunk/ws/trunk/src/org/apache/pig/backend/hadoop/executionengine/HExecutionEngine.java&gt;:50: cannot find symbol [javac] symbol : class PigImplConstants [javac] location: package org.apache.pig.impl [javac] import org.apache.pig.impl.PigImplConstants; [javac] ^ [javac] &lt;https://builds.apache.org/job/Pig-trunk/ws/trunk/src/org/apache/pig/Main.java&gt;:398: cannot find symbol [javac] symbol : variable PigImplConstants [javac] location: class org.apache.pig.Main [javac] pigContext.getProperties().setProperty(PigImplConstants.PIG_OPTIMIZER_RULES_KEY, [javac] ^ [javac] &lt;https://builds.apache.org/job/Pig-trunk/ws/trunk/src/org/apache/pig/backend/hadoop/executionengine/HExecutionEngine.java&gt;:257: cannot find symbol [javac] symbol : variable PigImplConstants [javac] location: class org.apache.pig.backend.hadoop.executionengine.HExecutionEngine [javac] PigImplConstants.PIG_OPTIMIZER_RULES_KEY)); [javac] ^ [javac] Note: Some input files use or override a deprecated API. [javac] Note: Recompile with -Xlint:deprecation for details. [javac] Note: Some input files use unchecked or unsafe operations. [javac] Note: Recompile with -Xlint:unchecked for details. [javac] 4 errors BUILD FAILED &lt;https://builds.apache.org/job/Pig-trunk/ws/trunk/build.xml&gt;:520: The following error occurred while executing this line: &lt;https://builds.apache.org/job/Pig-trunk/ws/trunk/build.xml&gt;:558: Compile failed; see the compiler error output for details. Total time: 29 seconds ====================================================================== ====================================================================== STORE: saving artifacts ====================================================================== ====================================================================== mv: cannot stat `build/*.tar.gz': No such file or directory mv: cannot stat `build/*.jar': No such file or directory mv: cannot stat `build/test/findbugs': No such file or directory mv: cannot stat `build/docs/api': No such file or directory Build Failed Build step 'Execute shell' marked build as failure [FINDBUGS] Skipping publisher since build result is FAILURE Recording test results Publishing Javadoc Archiving artifacts Recording fingerprints </pre> Apache Jenkins Server 2013-05-17T10:06:49 http://comments.gmane.org/gmane.comp.java.hadoop.pig.devel/31088 <pre>Issue Subscription Filter: PIG patch available (18 issues) Subscriber: pigdaily Key Summary PIG-3328 DataBags created with an initial list of tuples don't get registered as spillable https://issues.apache.org/jira/browse/PIG-3328 PIG-3318 AVRO: 'default value' not honored when merging schemas on load with AvroStorage https://issues.apache.org/jira/browse/PIG-3318 PIG-3317 disable optimizations via pig properties https://issues.apache.org/jira/browse/PIG-3317 PIG-3295 Casting from bytearray failing after Union (even when each field is from a single Loader) https://issues.apache.org/jira/browse/PIG-3295 PIG-3285 Jobs using HBaseStorage fail to ship dependency jars https://issues.apache.org/jira/browse/PIG-3285 PIG-3258 Patch to allow MultiStorage to use more than one index to generate output tree https://issues.apache.org/jira/browse/PIG-3258 PIG-3257 Add unique identifier UDF https://issues.apache.org/jira/browse/PIG-3257 PIG-3247 Piggybank functions to mimic OVER clause in SQL https://issues.apache.org/jira/browse/PIG-3247 PIG-3210 Pig fails to start when it cannot write log to log files https://issues.apache.org/jira/browse/PIG-3210 PIG-3199 Expose LogicalPlan via PigServer API https://issues.apache.org/jira/browse/PIG-3199 PIG-3166 Update eclipse .classpath according to ivy library.properties https://issues.apache.org/jira/browse/PIG-3166 PIG-3123 Simplify Logical Plans By Removing Unneccessary Identity Projections https://issues.apache.org/jira/browse/PIG-3123 PIG-3088 Add a builtin udf which removes prefixes https://issues.apache.org/jira/browse/PIG-3088 PIG-3024 TestEmptyInputDir unit test - hadoop version detection logic is brittle https://issues.apache.org/jira/browse/PIG-3024 PIG-3015 Rewrite of AvroStorage https://issues.apache.org/jira/browse/PIG-3015 PIG-2248 Pig parser does not detect when a macro name masks a UDF name https://issues.apache.org/jira/browse/PIG-2248 PIG-2244 Macros cannot be passed relation names https://issues.apache.org/jira/browse/PIG-2244 PIG-1914 Support load/store JSON data in Pig https://issues.apache.org/jira/browse/PIG-1914 You may edit this subscription at: https://issues.apache.org/jira/secure/FilterSubscription!default.jspa?subId=13225&amp;filterId=12322384 </pre> jira-1oDqGaOF3Lkdnm+yROfE0A< at >public.gmane.org 2013-05-17T01:02:31 http://comments.gmane.org/gmane.comp.java.hadoop.pig.devel/31086 <pre> ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/11203/ ----------------------------------------------------------- Review request for pig, Daniel Dai, Dmitriy Ryaboy, Cheolsoo Park, and Bill Graham. Description ------- Refactor physical operators to remove methods parameters that are always null This addresses bug PIG-3307. https://issues.apache.org/jira/browse/PIG-3307 Diffs ----- src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MergeJoinIndexer.java d5aff3d src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigCombiner.java 6cfc8c0 src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigGenericMapBase.java 7c499f6 src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigGenericMapReduce.java 6145214 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/PhysicalOperator.java fc0112a src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Add.java 5bceca6 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/BinaryComparisonOperator.java 3e434f3 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/ComparisonOperator.java 51d9f34 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/ConstantExpression.java 7e4cffa src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Divide.java bdcc72b src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/EqualToExpr.java a767c36 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/ExpressionOperator.java 9cca2c3 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/GTOrEqualToExpr.java b5e3c83 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/GreaterThanExpr.java f3b5d44 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/LTOrEqualToExpr.java 35786c0 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/LessThanExpr.java c9b3157 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Mod.java 1108846 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Multiply.java 2795b78 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/NotEqualToExpr.java 294f84a src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POAnd.java f24c2ac src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POBinCond.java 312f3ac src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POCast.java 987cc21 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POIsNull.java 9ea89f7 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POMapLookUp.java fd5573f src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/PONegative.java 8d3fcb1 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/PONot.java 973dfc5 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POOr.java 498eb12 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POProject.java 8886df7 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/PORegexp.java 6634915 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/PORelationToExprProject.java e400a95 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserComparisonFunc.java 1aa1671 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserFunc.java 167cf06 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Subtract.java 4999995 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POCollectedGroup.java a5adaf7 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POCombinerPackage.java 4a58a7e src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POCounter.java 30dcea2 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POCross.java b90b0a2 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/PODemux.java e26c611 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/PODistinct.java ed2d39e src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POFRJoin.java a4abdd8 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POFilter.java 552d6fa src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POForEach.java 45de398 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POGlobalRearrange.java 5fac709 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POJoinPackage.java 7e357ec src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLimit.java 3a2542b src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLoad.java 55bd896 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLocalRearrange.java 88621ba src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POMergeCogroup.java eea840a src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POMergeJoin.java b6a4d96 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POMultiQueryPackage.java 57a56fa src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POOptimizedForEach.java 91b3f00 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPackage.java e755e2a src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPackageLite.java e17d547 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPartialAgg.java b909dc0 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPartitionRearrange.java 5227d55 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPreCombinerLocalRearrange.java 59b032f src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/PORank.java 9e3d1eb src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POSort.java c76236b src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POSortedDistinct.java 8000c9a src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POSplit.java de2c972 src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POStore.java 249aecb src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POStream.java 894dc7d src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POUnion.java 508daef src/org/apache/pig/impl/builtin/DefaultIndexableLoader.java e2d3b86 test/org/apache/pig/test/PORead.java e4a07dd test/org/apache/pig/test/TestAdd.java a80ef81 test/org/apache/pig/test/TestBoolean.java 4e70e21 test/org/apache/pig/test/TestCharArrayToNumeric.java 473599d test/org/apache/pig/test/TestConstExpr.java d18c419 test/org/apache/pig/test/TestDivide.java 48b1591 test/org/apache/pig/test/TestEqualTo.java 2e3584b test/org/apache/pig/test/TestFRJoin.java 2bf868e test/org/apache/pig/test/TestFilter.java 9e6ce32 test/org/apache/pig/test/TestForEach.java 317b9e7 test/org/apache/pig/test/TestGTOrEqual.java c1a3f6d test/org/apache/pig/test/TestGreaterThan.java 77bd3f0 test/org/apache/pig/test/TestLTOrEqual.java 84a72ee test/org/apache/pig/test/TestLessThan.java d57cbb7 test/org/apache/pig/test/TestLoad.java 6faf94e test/org/apache/pig/test/TestLocalRearrange.java b471463 test/org/apache/pig/test/TestMod.java 995a6ba test/org/apache/pig/test/TestMultiply.java deeba8b test/org/apache/pig/test/TestNotEqualTo.java 6417d68 test/org/apache/pig/test/TestNull.java 17f4408 test/org/apache/pig/test/TestPOBinCond.java 65c6a0d test/org/apache/pig/test/TestPOCast.java 1d5f7e9 test/org/apache/pig/test/TestPODistinct.java 3168486 test/org/apache/pig/test/TestPOGenerate.java cfe2347 test/org/apache/pig/test/TestPOMapLookUp.java 7c6cd64 test/org/apache/pig/test/TestPONegative.java 2e06947 test/org/apache/pig/test/TestPOPartialAgg.java 6645952 test/org/apache/pig/test/TestPOSort.java 756865e test/org/apache/pig/test/TestPOSplit.java 71fb089 test/org/apache/pig/test/TestPOUserFunc.java 77eab4e test/org/apache/pig/test/TestPackage.java 984cd49 test/org/apache/pig/test/TestProject.java ff7eedf test/org/apache/pig/test/TestRegexp.java 0737f5e test/org/apache/pig/test/TestSubtract.java f0a253b test/org/apache/pig/test/TestUnion.java 339b459 test/org/apache/pig/test/utils/POCastDummy.java b83ed51 test/org/apache/pig/test/utils/TestHelper.java 1efabbe Diff: https://reviews.apache.org/r/11203/diff/ Testing ------- test-commit Thanks, Julien Le Dem </pre> Julien Le Dem 2013-05-16T21:35:41 http://comments.gmane.org/gmane.comp.java.hadoop.pig.devel/31076 <pre>Issue Subscription Filter: PIG patch available (17 issues) Subscriber: pigdaily Key Summary PIG-3318 AVRO: 'default value' not honored when merging schemas on load with AvroStorage https://issues.apache.org/jira/browse/PIG-3318 PIG-3317 disable optimizations via pig properties https://issues.apache.org/jira/browse/PIG-3317 PIG-3295 Casting from bytearray failing after Union (even when each field is from a single Loader) https://issues.apache.org/jira/browse/PIG-3295 PIG-3285 Jobs using HBaseStorage fail to ship dependency jars https://issues.apache.org/jira/browse/PIG-3285 PIG-3258 Patch to allow MultiStorage to use more than one index to generate output tree https://issues.apache.org/jira/browse/PIG-3258 PIG-3257 Add unique identifier UDF https://issues.apache.org/jira/browse/PIG-3257 PIG-3247 Piggybank functions to mimic OVER clause in SQL https://issues.apache.org/jira/browse/PIG-3247 PIG-3210 Pig fails to start when it cannot write log to log files https://issues.apache.org/jira/browse/PIG-3210 PIG-3199 Expose LogicalPlan via PigServer API https://issues.apache.org/jira/browse/PIG-3199 PIG-3166 Update eclipse .classpath according to ivy library.properties https://issues.apache.org/jira/browse/PIG-3166 PIG-3123 Simplify Logical Plans By Removing Unneccessary Identity Projections https://issues.apache.org/jira/browse/PIG-3123 PIG-3088 Add a builtin udf which removes prefixes https://issues.apache.org/jira/browse/PIG-3088 PIG-3024 TestEmptyInputDir unit test - hadoop version detection logic is brittle https://issues.apache.org/jira/browse/PIG-3024 PIG-3015 Rewrite of AvroStorage https://issues.apache.org/jira/browse/PIG-3015 PIG-2248 Pig parser does not detect when a macro name masks a UDF name https://issues.apache.org/jira/browse/PIG-2248 PIG-2244 Macros cannot be passed relation names https://issues.apache.org/jira/browse/PIG-2244 PIG-1914 Support load/store JSON data in Pig https://issues.apache.org/jira/browse/PIG-1914 You may edit this subscription at: https://issues.apache.org/jira/secure/FilterSubscription!default.jspa?subId=13225&amp;filterId=12322384 </pre> jira-1oDqGaOF3Lkdnm+yROfE0A< at >public.gmane.org 2013-05-16T01:02:30 http://comments.gmane.org/gmane.comp.java.hadoop.pig.devel/31048 <pre>Dear Pig I'm a junior of Pig. Is there any way to implement the process below by pig? split by " " input 1 line and 3 cols: a b 1,2,3 output 3 lines and 3 cols: a b 1 a b 2 a b 3 many thanks! Goose</pre> Goose 2013-05-15T02:56:53 http://comments.gmane.org/gmane.comp.java.hadoop.pig.devel/31044 <pre>Issue Subscription Filter: PIG patch available (17 issues) Subscriber: pigdaily Key Summary PIG-3318 AVRO: 'default value' not honored when merging schemas on load with AvroStorage https://issues.apache.org/jira/browse/PIG-3318 PIG-3317 disable optimizations via pig properties https://issues.apache.org/jira/browse/PIG-3317 PIG-3295 Casting from bytearray failing after Union (even when each field is from a single Loader) https://issues.apache.org/jira/browse/PIG-3295 PIG-3285 Jobs using HBaseStorage fail to ship dependency jars https://issues.apache.org/jira/browse/PIG-3285 PIG-3258 Patch to allow MultiStorage to use more than one index to generate output tree https://issues.apache.org/jira/browse/PIG-3258 PIG-3257 Add unique identifier UDF https://issues.apache.org/jira/browse/PIG-3257 PIG-3247 Piggybank functions to mimic OVER clause in SQL https://issues.apache.org/jira/browse/PIG-3247 PIG-3210 Pig fails to start when it cannot write log to log files https://issues.apache.org/jira/browse/PIG-3210 PIG-3199 Expose LogicalPlan via PigServer API https://issues.apache.org/jira/browse/PIG-3199 PIG-3166 Update eclipse .classpath according to ivy library.properties https://issues.apache.org/jira/browse/PIG-3166 PIG-3123 Simplify Logical Plans By Removing Unneccessary Identity Projections https://issues.apache.org/jira/browse/PIG-3123 PIG-3088 Add a builtin udf which removes prefixes https://issues.apache.org/jira/browse/PIG-3088 PIG-3024 TestEmptyInputDir unit test - hadoop version detection logic is brittle https://issues.apache.org/jira/browse/PIG-3024 PIG-3015 Rewrite of AvroStorage https://issues.apache.org/jira/browse/PIG-3015 PIG-2248 Pig parser does not detect when a macro name masks a UDF name https://issues.apache.org/jira/browse/PIG-2248 PIG-2244 Macros cannot be passed relation names https://issues.apache.org/jira/browse/PIG-2244 PIG-1914 Support load/store JSON data in Pig https://issues.apache.org/jira/browse/PIG-1914 You may edit this subscription at: https://issues.apache.org/jira/secure/FilterSubscription!default.jspa?subId=13225&amp;filterId=12322384 </pre> jira-1oDqGaOF3Lkdnm+yROfE0A< at >public.gmane.org 2013-05-15T01:02:29 http://comments.gmane.org/gmane.comp.java.hadoop.pig.devel/31010 <pre> ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/11135/ ----------------------------------------------------------- Review request for pig. Description ------- Default values are not honoured when merging default schema This addresses bug PIG-3318. https://issues.apache.org/jira/browse/PIG-3318 Diffs ----- http://svn.apache.org/repos/asf/pig/trunk/contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/AvroStorage.java 1481245 http://svn.apache.org/repos/asf/pig/trunk/contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/AvroStorageUtils.java 1481245 http://svn.apache.org/repos/asf/pig/trunk/contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/PigAvroInputFormat.java 1481245 http://svn.apache.org/repos/asf/pig/trunk/contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/PigAvroRecordReader.java 1481245 http://svn.apache.org/repos/asf/pig/trunk/contrib/piggybank/java/src/test/java/org/apache/pig/piggybank/test/storage/avro/TestAvroStorage.java 1481245 Diff: https://reviews.apache.org/r/11135/diff/ Testing ------- Yes Thanks, Viraj Bhat </pre> Viraj Bhat 2013-05-14T01:09:11 http://comments.gmane.org/gmane.comp.java.hadoop.pig.devel/31007 <pre>Issue Subscription Filter: PIG patch available (23 issues) Subscriber: pigdaily Key Summary PIG-3318 AVRO: 'default value' not honored when merging schemas on load with AvroStorage https://issues.apache.org/jira/browse/PIG-3318 PIG-3317 disable optimizations via pig properties https://issues.apache.org/jira/browse/PIG-3317 PIG-3295 Casting from bytearray failing after Union (even when each field is from a single Loader) https://issues.apache.org/jira/browse/PIG-3295 PIG-3291 TestExampleGenerator fails on Windows because of lack of file name escaping https://issues.apache.org/jira/browse/PIG-3291 PIG-3285 Jobs using HBaseStorage fail to ship dependency jars https://issues.apache.org/jira/browse/PIG-3285 PIG-3258 Patch to allow MultiStorage to use more than one index to generate output tree https://issues.apache.org/jira/browse/PIG-3258 PIG-3257 Add unique identifier UDF https://issues.apache.org/jira/browse/PIG-3257 PIG-3247 Piggybank functions to mimic OVER clause in SQL https://issues.apache.org/jira/browse/PIG-3247 PIG-3210 Pig fails to start when it cannot write log to log files https://issues.apache.org/jira/browse/PIG-3210 PIG-3199 Expose LogicalPlan via PigServer API https://issues.apache.org/jira/browse/PIG-3199 PIG-3166 Update eclipse .classpath according to ivy library.properties https://issues.apache.org/jira/browse/PIG-3166 PIG-3123 Simplify Logical Plans By Removing Unneccessary Identity Projections https://issues.apache.org/jira/browse/PIG-3123 PIG-3088 Add a builtin udf which removes prefixes https://issues.apache.org/jira/browse/PIG-3088 PIG-3069 Native Windows Compatibility for Pig E2E Tests and Harness https://issues.apache.org/jira/browse/PIG-3069 PIG-3026 Pig checked-in baseline comparisons need a pre-filter to address OS-specific newline differences https://issues.apache.org/jira/browse/PIG-3026 PIG-3025 TestPruneColumn unit test - SimpleEchoStreamingCommand perl inline script needs simplification https://issues.apache.org/jira/browse/PIG-3025 PIG-3024 TestEmptyInputDir unit test - hadoop version detection logic is brittle https://issues.apache.org/jira/browse/PIG-3024 PIG-3015 Rewrite of AvroStorage https://issues.apache.org/jira/browse/PIG-3015 PIG-2959 Add a pig.cmd for Pig to run under Windows https://issues.apache.org/jira/browse/PIG-2959 PIG-2955 Fix bunch of Pig e2e tests on Windows https://issues.apache.org/jira/browse/PIG-2955 PIG-2248 Pig parser does not detect when a macro name masks a UDF name https://issues.apache.org/jira/browse/PIG-2248 PIG-2244 Macros cannot be passed relation names https://issues.apache.org/jira/browse/PIG-2244 PIG-1914 Support load/store JSON data in Pig https://issues.apache.org/jira/browse/PIG-1914 You may edit this subscription at: https://issues.apache.org/jira/secure/FilterSubscription!default.jspa?subId=13225&amp;filterId=12322384 </pre> jira-1oDqGaOF3Lkdnm+yROfE0A< at >public.gmane.org 2013-05-14T01:02:25 http://comments.gmane.org/gmane.comp.java.hadoop.pig.devel/30975 <pre>Issue Subscription Filter: PIG patch available (23 issues) Subscriber: pigdaily Key Summary PIG-3318 AVRO: 'default value' not honored when merging schemas on load with AvroStorage https://issues.apache.org/jira/browse/PIG-3318 PIG-3317 disable optimizations via pig properties https://issues.apache.org/jira/browse/PIG-3317 PIG-3295 Casting from bytearray failing after Union (even when each field is from a single Loader) https://issues.apache.org/jira/browse/PIG-3295 PIG-3291 TestExampleGenerator fails on Windows because of lack of file name escaping https://issues.apache.org/jira/browse/PIG-3291 PIG-3285 Jobs using HBaseStorage fail to ship dependency jars https://issues.apache.org/jira/browse/PIG-3285 PIG-3258 Patch to allow MultiStorage to use more than one index to generate output tree https://issues.apache.org/jira/browse/PIG-3258 PIG-3257 Add unique identifier UDF https://issues.apache.org/jira/browse/PIG-3257 PIG-3247 Piggybank functions to mimic OVER clause in SQL https://issues.apache.org/jira/browse/PIG-3247 PIG-3210 Pig fails to start when it cannot write log to log files https://issues.apache.org/jira/browse/PIG-3210 PIG-3199 Expose LogicalPlan via PigServer API https://issues.apache.org/jira/browse/PIG-3199 PIG-3166 Update eclipse .classpath according to ivy library.properties https://issues.apache.org/jira/browse/PIG-3166 PIG-3123 Simplify Logical Plans By Removing Unneccessary Identity Projections https://issues.apache.org/jira/browse/PIG-3123 PIG-3088 Add a builtin udf which removes prefixes https://issues.apache.org/jira/browse/PIG-3088 PIG-3069 Native Windows Compatibility for Pig E2E Tests and Harness https://issues.apache.org/jira/browse/PIG-3069 PIG-3026 Pig checked-in baseline comparisons need a pre-filter to address OS-specific newline differences https://issues.apache.org/jira/browse/PIG-3026 PIG-3025 TestPruneColumn unit test - SimpleEchoStreamingCommand perl inline script needs simplification https://issues.apache.org/jira/browse/PIG-3025 PIG-3024 TestEmptyInputDir unit test - hadoop version detection logic is brittle https://issues.apache.org/jira/browse/PIG-3024 PIG-3015 Rewrite of AvroStorage https://issues.apache.org/jira/browse/PIG-3015 PIG-2959 Add a pig.cmd for Pig to run under Windows https://issues.apache.org/jira/browse/PIG-2959 PIG-2955 Fix bunch of Pig e2e tests on Windows https://issues.apache.org/jira/browse/PIG-2955 PIG-2248 Pig parser does not detect when a macro name masks a UDF name https://issues.apache.org/jira/browse/PIG-2248 PIG-2244 Macros cannot be passed relation names https://issues.apache.org/jira/browse/PIG-2244 PIG-1914 Support load/store JSON data in Pig https://issues.apache.org/jira/browse/PIG-1914 You may edit this subscription at: https://issues.apache.org/jira/secure/FilterSubscription!default.jspa?subId=13225&amp;filterId=12322384 </pre> jira-1oDqGaOF3Lkdnm+yROfE0A< at >public.gmane.org 2013-05-13T01:02:22 http://comments.gmane.org/gmane.comp.java.hadoop.pig.devel/30964 <pre>Issue Subscription Filter: PIG patch available (22 issues) Subscriber: pigdaily Key Summary PIG-3317 disable optimizations via pig properties https://issues.apache.org/jira/browse/PIG-3317 PIG-3295 Casting from bytearray failing after Union (even when each field is from a single Loader) https://issues.apache.org/jira/browse/PIG-3295 PIG-3291 TestExampleGenerator fails on Windows because of lack of file name escaping https://issues.apache.org/jira/browse/PIG-3291 PIG-3285 Jobs using HBaseStorage fail to ship dependency jars https://issues.apache.org/jira/browse/PIG-3285 PIG-3258 Patch to allow MultiStorage to use more than one index to generate output tree https://issues.apache.org/jira/browse/PIG-3258 PIG-3257 Add unique identifier UDF https://issues.apache.org/jira/browse/PIG-3257 PIG-3247 Piggybank functions to mimic OVER clause in SQL https://issues.apache.org/jira/browse/PIG-3247 PIG-3210 Pig fails to start when it cannot write log to log files https://issues.apache.org/jira/browse/PIG-3210 PIG-3199 Expose LogicalPlan via PigServer API https://issues.apache.org/jira/browse/PIG-3199 PIG-3166 Update eclipse .classpath according to ivy library.properties https://issues.apache.org/jira/browse/PIG-3166 PIG-3123 Simplify Logical Plans By Removing Unneccessary Identity Projections https://issues.apache.org/jira/browse/PIG-3123 PIG-3088 Add a builtin udf which removes prefixes https://issues.apache.org/jira/browse/PIG-3088 PIG-3069 Native Windows Compatibility for Pig E2E Tests and Harness https://issues.apache.org/jira/browse/PIG-3069 PIG-3026 Pig checked-in baseline comparisons need a pre-filter to address OS-specific newline differences https://issues.apache.org/jira/browse/PIG-3026 PIG-3025 TestPruneColumn unit test - SimpleEchoStreamingCommand perl inline script needs simplification https://issues.apache.org/jira/browse/PIG-3025 PIG-3024 TestEmptyInputDir unit test - hadoop version detection logic is brittle https://issues.apache.org/jira/browse/PIG-3024 PIG-3015 Rewrite of AvroStorage https://issues.apache.org/jira/browse/PIG-3015 PIG-2959 Add a pig.cmd for Pig to run under Windows https://issues.apache.org/jira/browse/PIG-2959 PIG-2955 Fix bunch of Pig e2e tests on Windows https://issues.apache.org/jira/browse/PIG-2955 PIG-2248 Pig parser does not detect when a macro name masks a UDF name https://issues.apache.org/jira/browse/PIG-2248 PIG-2244 Macros cannot be passed relation names https://issues.apache.org/jira/browse/PIG-2244 PIG-1914 Support load/store JSON data in Pig https://issues.apache.org/jira/browse/PIG-1914 You may edit this subscription at: https://issues.apache.org/jira/secure/FilterSubscription!default.jspa?subId=13225&amp;filterId=12322384 </pre> jira-1oDqGaOF3Lkdnm+yROfE0A< at >public.gmane.org 2013-05-12T01:02:23 http://comments.gmane.org/gmane.comp.java.hadoop.pig.devel/30960 <pre>Issue Subscription Filter: PIG patch available (22 issues) Subscriber: pigdaily Key Summary PIG-3317 disable optimizations via pig properties https://issues.apache.org/jira/browse/PIG-3317 PIG-3295 Casting from bytearray failing after Union (even when each field is from a single Loader) https://issues.apache.org/jira/browse/PIG-3295 PIG-3291 TestExampleGenerator fails on Windows because of lack of file name escaping https://issues.apache.org/jira/browse/PIG-3291 PIG-3285 Jobs using HBaseStorage fail to ship dependency jars https://issues.apache.org/jira/browse/PIG-3285 PIG-3258 Patch to allow MultiStorage to use more than one index to generate output tree https://issues.apache.org/jira/browse/PIG-3258 PIG-3257 Add unique identifier UDF https://issues.apache.org/jira/browse/PIG-3257 PIG-3247 Piggybank functions to mimic OVER clause in SQL https://issues.apache.org/jira/browse/PIG-3247 PIG-3210 Pig fails to start when it cannot write log to log files https://issues.apache.org/jira/browse/PIG-3210 PIG-3199 Expose LogicalPlan via PigServer API https://issues.apache.org/jira/browse/PIG-3199 PIG-3166 Update eclipse .classpath according to ivy library.properties https://issues.apache.org/jira/browse/PIG-3166 PIG-3123 Simplify Logical Plans By Removing Unneccessary Identity Projections https://issues.apache.org/jira/browse/PIG-3123 PIG-3088 Add a builtin udf which removes prefixes https://issues.apache.org/jira/browse/PIG-3088 PIG-3069 Native Windows Compatibility for Pig E2E Tests and Harness https://issues.apache.org/jira/browse/PIG-3069 PIG-3026 Pig checked-in baseline comparisons need a pre-filter to address OS-specific newline differences https://issues.apache.org/jira/browse/PIG-3026 PIG-3025 TestPruneColumn unit test - SimpleEchoStreamingCommand perl inline script needs simplification https://issues.apache.org/jira/browse/PIG-3025 PIG-3024 TestEmptyInputDir unit test - hadoop version detection logic is brittle https://issues.apache.org/jira/browse/PIG-3024 PIG-3015 Rewrite of AvroStorage https://issues.apache.org/jira/browse/PIG-3015 PIG-2959 Add a pig.cmd for Pig to run under Windows https://issues.apache.org/jira/browse/PIG-2959 PIG-2955 Fix bunch of Pig e2e tests on Windows https://issues.apache.org/jira/browse/PIG-2955 PIG-2248 Pig parser does not detect when a macro name masks a UDF name https://issues.apache.org/jira/browse/PIG-2248 PIG-2244 Macros cannot be passed relation names https://issues.apache.org/jira/browse/PIG-2244 PIG-1914 Support load/store JSON data in Pig https://issues.apache.org/jira/browse/PIG-1914 You may edit this subscription at: https://issues.apache.org/jira/secure/FilterSubscription!default.jspa?subId=13225&amp;filterId=12322384 </pre> jira-1oDqGaOF3Lkdnm+yROfE0A< at >public.gmane.org 2013-05-11T01:02:25 http://comments.gmane.org/gmane.comp.java.hadoop.pig.devel/30947 <pre>Please pardon the basic question. I'm building Pig 0.11.2-SNAPSHOT against Hadoop 2.0.4. 'ant package' and full cluster tests work fine, but I'm not having much luck with running the unit tests, 'ant test-core' or 'ant test'. The problem looks to be a MR app classpath issue. Sometimes: java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/client/YarnClientImpl Sometimes: java.lang.NoClassDefFoundError: org/apache/hadoop/mapred/ResourceMgrDelegate A few Google searches have turned up no useful pointers. Maybe there is something simple I am missing? How do you set up for running unit tests on your dev boxes? </pre> Andrew Purtell 2013-05-10T10:39:49 http://comments.gmane.org/gmane.comp.java.hadoop.pig.devel/30944 <pre>At Hack Reactor, we are setting up a computationally heavy MapReduce job across a 1,000 machine cluster. It is an algorithmic tree traversal expected to run over several hours, comprising over 10 quintillion computations, and occupying at least a few petabytes of storage across HDFS. We plan to run the job using a Java implementation of our functions. The original, however, is in JavaScript, and I noticed that JavaScript UDFs are still considered experimental for want of additional testing. If our project could be of any use in testing edge cases or proving out the JavaScript UDF functionality in Pig, we would be more than happy to help. Cheers, RP </pre> Ruan Pethiyagoda 2013-05-10T02:29:32 http://comments.gmane.org/gmane.comp.java.hadoop.pig.devel/30941 <pre>Issue Subscription Filter: PIG patch available (23 issues) Subscriber: pigdaily Key Summary PIG-3317 disable optimizations via pig properties https://issues.apache.org/jira/browse/PIG-3317 PIG-3316 Pig failed to interpret DateTime values in some special cases https://issues.apache.org/jira/browse/PIG-3316 PIG-3295 Casting from bytearray failing after Union (even when each field is from a single Loader) https://issues.apache.org/jira/browse/PIG-3295 PIG-3291 TestExampleGenerator fails on Windows because of lack of file name escaping https://issues.apache.org/jira/browse/PIG-3291 PIG-3285 Jobs using HBaseStorage fail to ship dependency jars https://issues.apache.org/jira/browse/PIG-3285 PIG-3258 Patch to allow MultiStorage to use more than one index to generate output tree https://issues.apache.org/jira/browse/PIG-3258 PIG-3257 Add unique identifier UDF https://issues.apache.org/jira/browse/PIG-3257 PIG-3247 Piggybank functions to mimic OVER clause in SQL https://issues.apache.org/jira/browse/PIG-3247 PIG-3210 Pig fails to start when it cannot write log to log files https://issues.apache.org/jira/browse/PIG-3210 PIG-3199 Expose LogicalPlan via PigServer API https://issues.apache.org/jira/browse/PIG-3199 PIG-3166 Update eclipse .classpath according to ivy library.properties https://issues.apache.org/jira/browse/PIG-3166 PIG-3123 Simplify Logical Plans By Removing Unneccessary Identity Projections https://issues.apache.org/jira/browse/PIG-3123 PIG-3088 Add a builtin udf which removes prefixes https://issues.apache.org/jira/browse/PIG-3088 PIG-3069 Native Windows Compatibility for Pig E2E Tests and Harness https://issues.apache.org/jira/browse/PIG-3069 PIG-3026 Pig checked-in baseline comparisons need a pre-filter to address OS-specific newline differences https://issues.apache.org/jira/browse/PIG-3026 PIG-3025 TestPruneColumn unit test - SimpleEchoStreamingCommand perl inline script needs simplification https://issues.apache.org/jira/browse/PIG-3025 PIG-3024 TestEmptyInputDir unit test - hadoop version detection logic is brittle https://issues.apache.org/jira/browse/PIG-3024 PIG-3015 Rewrite of AvroStorage https://issues.apache.org/jira/browse/PIG-3015 PIG-2959 Add a pig.cmd for Pig to run under Windows https://issues.apache.org/jira/browse/PIG-2959 PIG-2955 Fix bunch of Pig e2e tests on Windows https://issues.apache.org/jira/browse/PIG-2955 PIG-2248 Pig parser does not detect when a macro name masks a UDF name https://issues.apache.org/jira/browse/PIG-2248 PIG-2244 Macros cannot be passed relation names https://issues.apache.org/jira/browse/PIG-2244 PIG-1914 Support load/store JSON data in Pig https://issues.apache.org/jira/browse/PIG-1914 You may edit this subscription at: https://issues.apache.org/jira/secure/FilterSubscription!default.jspa?subId=13225&amp;filterId=12322384 </pre> jira-1oDqGaOF3Lkdnm+yROfE0A< at >public.gmane.org 2013-05-10T01:02:27 Search the mailing list at Gmane query http://search.gmane.org/?group=$group=gmane.comp.java.hadoop.pig.devel