http://blog.gmane.org/gmane.comp.java.hadoop.hbase.user hourly 1 1901-01-01T00:00+00:00 http://gmane.org/img/gmane-25t.png http://gmane.org http://comments.gmane.org/gmane.comp.java.hadoop.hbase.user/35824 <pre>Hi, All, Our use case requires to persist a stream into system like HBase. The stream data is in format of &lt;timestamp, value&gt;. In other word, timestamp is used as rowkey. We want to explore whether HBase is suitable for such kind of data. The problem is that the domain of row key (or timestamp) grow constantly. For example, given 3 nodes, n1 n2 n3, they are resp. hosting row key partition [0,4], [5, 9], [10,12]. Currently it is the last node n3 who is busy receiving upcoming writes (of row key 13 and 14). This continues until the region reaches max size 5 (that is, partition grows to [10,14]) and potentially splits. I am not expert on HBase split, but I am wondering after split, will the new writes still go to node n3 (for [10,14]) or the write stream can be intelligently redirected to other less busy node, like n1. In case HBase can't do things like this, how easy is it to extend HBase for such functionality? Thanks... Yun </pre> yun peng 2013-06-19T20:04:36 http://comments.gmane.org/gmane.comp.java.hadoop.hbase.user/35815 <pre>Here is a problem that I am facing while creating an HFile outside of a MR job. My column family is "sd" For a given rowKey=10011-2-0000000000000000703, this is the sequence in which I am writing KeyValue pairs to the HFile, key=sd:dt, value="dummy value 1" key=sd:dth, value="dummy value 2" When I print the keys it prints the following for the above 2 entries \x00\x1B10011-2-0000000000000000703\x02sddt\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x04 \x00\x1B10011-2-0000000000000000703\x02sddth\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x04 When I write the KV to HFile it throws an IOException: Added a key not lexically larger than previous key=\x00\x1B10011-2-0000000000000000703\x02sddth\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x04, lastkey=\x00\x1B10011-2-0000000000000000703\x02sddt\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x04 Lexically "sd:dt" is smaller than "sd:dth" then why should HFile (AbstractHFileWriter.checkKey) complain? The checkKey method is using the hadoop RawComparator Am I missing something? - R </pre> Rohit Kelkar 2013-06-19T17:05:46 http://comments.gmane.org/gmane.comp.java.hadoop.hbase.user/35814 <pre>Hi, I am trying to do some performance testing, and want to test when the WAL is turned off. I know there is API writeToWAL(false) to do this, but if I want to just change the setting and use the performanceEvaluation tool to run the test with WAL off. Is there a way in HBase shell, or a config key in hbase-site.xml to do that? Thanks Tian-Ying </pre> Tianying Chang 2013-06-19T17:00:59 http://comments.gmane.org/gmane.comp.java.hadoop.hbase.user/35807 <pre>hi every one, i am quite new to base and java. I have a few questions. 1. on the web ui for hbase i have the following entry in the region server mining,60020,13711358624Fri Jun 14 00:04:22 GMT 2013requestsPerSecond=0, numberOfOnlineRegions=106, usedHeapMB=5577, maxHeapMB=7933 when the hbase is idle with no requests the usedHeapMB hovers around 5000MB, shouldn't it go down after some idle time? what is occupying the heap when no requests are being made? 2. I have assigned 8GB for heap on a 48GB machine, i dont mind assigning more of it to hbase. What is the recommended size for the heap? Sincerely, Prakash </pre> prakash kadel 2013-06-19T13:17:11 http://comments.gmane.org/gmane.comp.java.hadoop.hbase.user/35799 <pre>From the HBase Web site, we can see two different links for API docs. HBase 0.94.6 API https://hbase.apache.org/0.94/apidocs/index.html HBase 0.97.0-SNAPSHOT API https://hbase.apache.org/apidocs/index.html Which one to choose? I have a running HBase cluster with a version number *0.94.7*, r1471806 ​ Regards, Joarder Kamal </pre> Joarder KAMAL 2013-06-19T02:02:08 http://comments.gmane.org/gmane.comp.java.hadoop.hbase.user/35795 <pre>Hi, If I wanted to write to write a unit test against HTable/HBase, is there an already available utility to that for unit testing my application logic. I don't want to write code that either touches production or requires me to mock an HTable. I am looking for a test htable object which behaves pretty close to a real HTable. Thanks </pre> Varun Sharma 2013-06-18T23:17:37 http://comments.gmane.org/gmane.comp.java.hadoop.hbase.user/35793 <pre>Hello, We use hbase 0.94.2 and we are seeing (mostly reading) latency issues, and with an interesting twist: client (100 threads) get stuck waiting on HBase, then stops sending RPC's and then seems to be freed. When freed, while trying to flush all request it had queued, it causes another vicious cycle of burst - drop - burst. I am seeing about 40K requests per seconds per RS. The cluster is mostly read, no compaction and split storms. Just bursts and bursts. We set 30 rpc handlers per RS (avg scan size is 5K) and they most of the time seem to be WAITING. IPC at DEBUG revealed (see below) that sometimes the queueTime is very big and sometimes the responseTime is very big, but at a very low percentage. The burst seem to be periodic and uncorrelated to GC activity or CPU (the burst appear the moment the RS is onlined and the heap is free) The row keys are murmur3 hashed, and I don't really see any hotspoting Any idea what might cause those bursts ? Thanks, Amit </pre> Amit Mor 2013-06-18T21:48:12 http://comments.gmane.org/gmane.comp.java.hadoop.hbase.user/35789 <pre>Hi, We had a brute force cluster shutdown event that was followed by log recovery when the cluster went back online. The cluster took hours to split the logs and recover the regions, all of which might have made sense since we have quite a lot of regions (around 13K) but the weird thing is that there was no obvious bottleneck during the recovery process. CPU was almost idle on all the nodes, IO was on 5-20% utilization, memory was OK, network wasn't overloaded, but still it was slow. Any idea what can be slowing it down? Thanks. -eran </pre> Eran Kutner 2013-06-18T12:11:16 http://comments.gmane.org/gmane.comp.java.hadoop.hbase.user/35788 <pre>Hi, I noticed that when a Region Server takes over a dead region server replication queue, the ageOfLastShippedOp is reported of the latter. For instance, I had an age of 500ms, and when I shutdown region server 2, then region server took over the queue, and suddenly I had an age of 700k ms. When you peek the metrics using JConsole and not Graphite, you see two entries under Replication, thus we have two ageOfLastShippedOp. Does HBase Region Server arbitrarily chooses which one to publish to its Metrics Context? Thank you, Asaf </pre> Asaf Mesika 2013-06-18T08:09:06 http://comments.gmane.org/gmane.comp.java.hadoop.hbase.user/35787 <pre>Hi, I have two cluster setup in a lab, each has 1 Master and 3 RS. I'm inserting roughly 15GB into the master cluster, but I see between 5 - 10 minutes delay between master and slave cluster (ageOfLastShippedOp) them. On my Graphite I see that replicateLogEntries_num_ops is increasing in one region server (IP 85) of the slave cluster, out of 3 (IPs 83,84,85). I ran a grep on the logs of each region server of the master, and saw Chosen peer message saying the following: RS ip 74: Chosen peer 83 RS ip 75: Chosen peer 85 RS ip 76: Chosen peer 85 So first problem: Why only two slave RS (83,85) are receiving replicated log entries instead of 3? Second and biggest problem: I ran netstat -tnp and grepped for 83,84,85 on the RS ip 74, and saw that it is in fact talking with RS 85! This was correlated with the Graphite graph of replicateLogEntries_num_ops which showed that only RS 85 was receiving replicated log entries. For me it looks like a bug. Anyone has any ideas how to solve those two issues? </pre> Asaf Mesika 2013-06-18T06:48:44 http://comments.gmane.org/gmane.comp.java.hadoop.hbase.user/35785 <pre>Is running MR job and the Incremental bulk load simultaneously on the same hbase table going to affect each other? If yes then can you suggest strategies to make bulk load and MR jobs mutually exclusive? - R </pre> Rohit Kelkar 2013-06-17T21:41:45 http://comments.gmane.org/gmane.comp.java.hadoop.hbase.user/35782 <pre>Context: I'm working on getting replication set up, and a prerequisite for me is to rename the table (since you have to replicate to the same name as the source). For this, I'm testing a CopyTable strategy, since there doesn't seem to be a good way to rename a table (please correct me if I'm wrong). My question: According to [1], the CopyTable job takes an argument "all.cells" which "Also copy delete markers and uncollected deleted cells (advanced option)." I'm confused by the "advanced option" bit. When would you not want to copy deletes over to a new table? Without that, it seems like you could end up with more data than you were expecting in the target table. Any info would be helpful. Thanks, Patrick [1] http://hbase.apache.org/book/ops_mgt.html#copytable </pre> Patrick Schless 2013-06-17T19:20:31 http://comments.gmane.org/gmane.comp.java.hadoop.hbase.user/35781 <pre>Working on setting up HBase replication across a VPN tunnel, and following the docs here: [1] (and here: [2]). Two questions, regarding firewall allowances required: 1) The docs say that the zookeeper clusters must be able to reach each other. I don't see any docs on why this is (the high-level diagram doesn't even show a ZK ensemble on the client side). Is it correct that the ZK ensembles need to communicate with each other? 2) What ports are required to be open for inter-cluster Region Server communication? Is it only the slave that needs to accept requests from the master, or does the master also accept incoming requests from the slaves? Thanks, Patrick [1] http://hbase.apache.org/replication.html [2] http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/replication/package-summary.html#requirements </pre> Patrick Schless 2013-06-17T19:06:15 http://comments.gmane.org/gmane.comp.java.hadoop.hbase.user/35777 <pre>Hi All, I am trying to connect to a secure Hadoop/HBase cluster. I wrote a java class that connects to the secure cluster and creates a table with presplit regions. I am running this class from eclipse itself. But, i keep on getting the following exception: *Caused by: KrbException: Could not load configuration from SCDynamicStore at sun.security.krb5.SCDynamicStoreConfig.getConfig(SCDynamicStoreConfig.java:64) at sun.security.krb5.Config.loadStanzaTable(Config.java:125) at sun.security.krb5.Config.&lt;init&gt;(Config.java:176) at sun.security.krb5.Config.getInstance(Config.java:79)* I have googled this problem but i cannot find a solution for fixing "* SCDynamicStore*" related problem in Eclipse on Mac. I want to run this code from eclipse. Please let me know if anyone knows the trick to resolve this problem on Mac. This is really annoying problem. </pre> anil gupta 2013-06-17T04:26:08 http://comments.gmane.org/gmane.comp.java.hadoop.hbase.user/35773 <pre>My cluster's master log contains this infinite repetition: 2013-06-16 10:38:13,651 INFO org.apache.hadoop.hbase.HBaseFileSystem: Delete File, sleeping 1000 times 1 2013-06-16 10:38:14,654 INFO org.apache.hadoop.hbase.HBaseFileSystem: Delete File, sleeping 1000 times 2 2013-06-16 10:38:16,657 INFO org.apache.hadoop.hbase.HBaseFileSystem: Delete File, sleeping 1000 times 3 2013-06-16 10:38:19,659 INFO org.apache.hadoop.hbase.HBaseFileSystem: Delete File, sleeping 1000 times 4 2013-06-16 10:38:23,662 INFO org.apache.hadoop.hbase.HBaseFileSystem: Delete File, sleeping 1000 times 5 2013-06-16 10:38:28,665 INFO org.apache.hadoop.hbase.HBaseFileSystem: Delete File, sleeping 1000 times 6 2013-06-16 10:38:34,668 INFO org.apache.hadoop.hbase.HBaseFileSystem: Delete File, sleeping 1000 times 7 2013-06-16 10:38:41,671 INFO org.apache.hadoop.hbase.HBaseFileSystem: Delete File, sleeping 1000 times 8 2013-06-16 10:38:49,673 INFO org.apache.hadoop.hbase.HBaseFileSystem: Delete File, sleeping 1000 times 9 2013-06-16 10:38:5</pre> Chip Salzenberg 2013-06-16T17:44:10 http://comments.gmane.org/gmane.comp.java.hadoop.hbase.user/35769 <pre> Compacting f in cdr,\x00\x00\x01?B\xF5\x8D\xED\x7F\xFF\xFF\xFF\xFF\xF8\xDF\xCD,1371285718429.d508ac045fb11810ee73794c808df935.RUNNING (since 23mins, 19sec ago) Compacting store f (since 23mins, 19sec ago) why the region compact spend 24 minute?? 2013-06-15 thank you!! 发件人："jingangyh"&lt;jingangyh&lt; at &gt;gmail.com&gt; 发送时间：2013-06-15 15:13 主题：转发: 回复: hbase region don't split ? 收件人："hbase"&lt;hbase&lt; at &gt;apache.org&gt; 抄送： 2013-06-15 thank you!! 发件人："jingangyh"&lt;jingangyh&lt; at &gt;gmail.com&gt; 发送时间：2013-06-15 15:05 主题：回复: hbase region don't split ? 收件人："cdh-user"&lt;cdh-user&lt; at &gt;cloudera.org&gt; 抄送： why the region is not split more than 4g? numberOfStores=1, numberOfStorefiles=1, storefileUncompressedSizeMB=58767, storefileSizeMB=58767, compressionRatio=1.0000, memstoreSizeMB=0, 2013-06-15 thank you!! 发件人："jingangyh"&lt;jingangyh&lt; at &gt;gmail.com&gt; 发送时间：2013-06-13 23:45 </pre> jingangyh 2013-06-15T15:27:44 http://comments.gmane.org/gmane.comp.java.hadoop.hbase.user/35765 <pre>HI, we use CDH 4.2.0, find that some of the regions stop spliting and increase contiusuly under heavy load. some regions become much bigger than the setting value(4G),reaches 46g. any reason or bugs? Thansk! beatls </pre> hua beatls 2013-06-15T15:00:03 http://comments.gmane.org/gmane.comp.java.hadoop.hbase.user/35762 <pre>Hello Experts, Can you please provide link for HBASECON 2013 videos? Thank you. -- View this message in context: http://apache-hbase.679495.n3.nabble.com/HBASECON-2013-tp4046309.html Sent from the HBase User mailing list archive at Nabble.com. </pre> karunakar 2013-06-14T17:36:24 http://comments.gmane.org/gmane.comp.java.hadoop.hbase.user/35754 <pre>Hello, When doing the basic test after installing, the scan request is really slow (~5sec). There are no errors in the logs. Is it normal ? Why it is so ? Simon </pre> Simon Majou 2013-06-14T14:39:25 http://comments.gmane.org/gmane.comp.java.hadoop.hbase.user/35752 <pre>Hi all, I am curious if it is possible to have a version(0.94.7) deployed on cluster and use 0.94.1 version on client to access it. Thanks in advance! </pre> Ionut Ignatescu 2013-06-13T15:57:52 http://comments.gmane.org/gmane.comp.java.hadoop.hbase.user/35751 <pre>Hi all, I am curious if it is possible to have a version(0.94.7) deployed on cluster and use 0.94.1 version on client to access it. Thanks in advance! </pre> Ionut Ignatescu 2013-06-13T21:05:13 Search the mailing list at Gmane query http://search.gmane.org/?group=$group=gmane.comp.java.hadoop.hbase.user