http://permalink.gmane.org/gmane.comp.db.mongodb.user hourly 1 1901-01-01T00:00+00:00 http://gmane.org/img/gmane-25t.png http://gmane.org http://permalink.gmane.org/gmane.comp.db.mongodb.user/93709 <pre>what's the version of mongod you use? if the version is 2.4.0, you can upgrade the mongod to the latest stable version, remove the data of the third node, and re-sync the node. I have meet this error before, and upgrading the version of the mongod works fine, maybe you can try this way. On Wed, Jun 19, 2013 at 10:12 AM, Aboo soyeed &lt;soyeed2000-Re5JQEeQqe8AvxtiuMwx3w&lt; at &gt;public.gmane.org&gt; wrote: </pre> LiangQing 2013-06-19T05:19:48 http://permalink.gmane.org/gmane.comp.db.mongodb.user/93708 <pre> Hi, I have some questions for you about roadmap.. Please give me some advice. 1. Could you explain your public or private roadmap for years to come? We expect to know your development plan by year as detail as possible. (If you have no plan, please tell me your opinion.) 2. Could you describe the list of technologies in your open source? Please describe as detail as possible. 3. What technologies do you need more in your open source project? Why? 4. What new open source project do you want to create in Big Data? Why? 5. Could you explain major changes of your open source since open source was created? 6. Do you have a plan to co-operate with other open source communities? Thank you for giving me your time. </pre> blueskygreenlandtoyou-Re5JQEeQqe8AvxtiuMwx3w< at >public.gmane.org 2013-06-19T03:46:43 http://permalink.gmane.org/gmane.comp.db.mongodb.user/93707 <pre>Hi All, I want to convert mongodb query into of type Query() To get a list list using mongotemplate example query: db.fbads_hourly_period_ads_stats.aggregate( [ { $match: { adgroup_id: '1447'} }, { $group: { _id: {"adgroup_id":"$adgroup_id","step":"$step","sub":"$sub"}, Impressions: { $sum: "$imp" }, Clicks: { $sum: "$clicks" }, Installs: { $sum: "$installs" }, Spent: { $sum: "$spent" },Earn: { $sum: "$earn" } } }] ); into Query query = new Query(Criteria.where("adgroup_id").is("20348")); </pre> avinash reddy 2013-06-19T04:22:21 http://permalink.gmane.org/gmane.comp.db.mongodb.user/93706 <pre> have 3 node replica set setup . However my third node keeps crashing while syncing . i have tried seperate systems but the third node always ends up crashing. here are the logs Wed Jun 19 01:27:38.514 [rsSync] Socket recv() timeout 109.123.100.239:27017 Wed Jun 19 01:27:38.514 [rsSync] SocketException: remote: 109.123.100.239:27017 error: 9001 socket exception [3] server [109.123.100.239:27017] Wed Jun 19 01:27:38.514 [rsSync] DBClientCursor::init call() failed Wed Jun 19 01:27:38.524 [rsSync] replSet initial sync exception: 10276 DBClientBase::findN: transport error: twitnot.es:27017 ns: local.oplog.rs query: { query: {}, orderby: { $natural: -1 } } 9 attempts remaining </pre> Aboo soyeed 2013-06-19T02:12:31 http://permalink.gmane.org/gmane.comp.db.mongodb.user/93705 <pre>Hi All, I have Ubuntu 12.04.1 LTS on which mongo 2.4.3 version is installed. I have uncomment the auth in /etc/mongodb.conf file. After that login into mongo shell, use DB, then db.addUser({user: "readonly", pwd: "readonly", roles: ["readOnly:true"]}) Also db.addUser("abc","abc") but when I try to login mongo -u readonly -p readonly DB, db.test.insert("x:1") , it is writting in the database. Can anyone help me out ? </pre> Vaneet Gupta 2013-06-19T04:46:19 http://permalink.gmane.org/gmane.comp.db.mongodb.user/93704 <pre>Hi Asya, It's just I think it supposed to be more stable than 2.4. I used java driver version 2.10.1. I closed my connection to mongod by calling the close() method on Mongo class. At the beginning, I saw in the netstat command output, there are 5 connections and right now is 12. I don't really know why it keeps bigger. Any idea what can caused this? Thanks. Martinus On Mon, Jun 17, 2013 at 6:48 PM, Asya Kamsky &lt;asya-Ot75HdpNzd8AvxtiuMwx3w&lt; at &gt;public.gmane.org&gt; wrote: </pre> Martinus Martinus 2013-06-19T04:28:46 http://permalink.gmane.org/gmane.comp.db.mongodb.user/93703 <pre>Thank you very much. On Wednesday, June 19, 2013 2:25:08 AM UTC+8, Mike Friedman wrote: </pre> jwu-mZajXfQ+BZE< at >public.gmane.org 2013-06-19T00:29:36 http://permalink.gmane.org/gmane.comp.db.mongodb.user/93702 <pre>This was an authentication problem, somehow. A normal mongodump also failed, but when running as an adminy-account it works. That seems incorrect, but at least it's working. Wes On Tuesday, June 18, 2013 4:08:26 PM UTC-4, Wes wrote: </pre> Wes 2013-06-18T22:13:18 http://permalink.gmane.org/gmane.comp.db.mongodb.user/93701 <pre>Correction: Sorry, the times were 11 am to 1 pm.. On Tuesday, June 18, 2013 3:11:37 PM UTC-7, PaulKE wrote: </pre> PaulKE 2013-06-18T22:12:13 http://permalink.gmane.org/gmane.comp.db.mongodb.user/93700 <pre>Thanks, Sammaye, I have noticed that between 11 am to 1 am are busiest. Still, I worried since memory kept being eaten away. So, eventually, the system runs out of memory. This is the first time I am running mongo db on large system. So, I wasn't sure about behaviour. The memory jumped big time when I added a new field yesterday as I posted on another thread. The average object size got twice bigger ( ~1.5 KB compared to 0.7 kb ) after I updated all records with another field called 'ltime' with year, month, day as sub data to 'group' them on local time (I found out that Mongo does not support 'group' operates on local time. It's tricky up to day resolution. Up to hours would be fine since I can convert back) anyway, after that, the data grew significantly, and made me worry about memory usage, and need to learn what to do when the system goes down due to this issue. Paul On Tuesday, June 18, 2013 2:30:12 PM UTC-7, Sammaye wrote: </pre> PaulKE 2013-06-18T22:11:37 http://permalink.gmane.org/gmane.comp.db.mongodb.user/93699 <pre>82% RAM isn't odd, it is actually perfectly normal. If the OS allows MongoDB to take that much then it must be ok. is there any particular times of the day when the memory gets to 80MB before it is full? This seems like possibly a working set issue, possibly. On 18 June 2013 22:22, PaulKE &lt;paul.ku-MlD/Ji4NWKf8uuBqx+HG89vLeJWuRmrY&lt; at &gt;public.gmane.org&gt; wrote: </pre> Sam Millman 2013-06-18T21:30:12 http://permalink.gmane.org/gmane.comp.db.mongodb.user/93698 <pre>Anyone? Now, i am getting very slim on memory from Mongo on EC2.. On Tuesday, June 18, 2013 12:17:30 PM UTC-7, PaulKE wrote: </pre> PaulKE 2013-06-18T21:22:56 http://permalink.gmane.org/gmane.comp.db.mongodb.user/93697 <pre>Hi, I have a three node replica set for which the initial sync is very slow. The data size is only around 10 gb but the servers are distributed around the world with delays of 100 ms and 400 ms. CPU usage seems fairly low but I see that the replica's are syncing by looking at the mongod log 1. How can I get a % progress of this initial sync operation? 2. Does the initial sync use the oplog? Will increasing the oplog size speed up the replication? 3. Will it attempt to recreate indexes on the secondary after initial sync is complete? My primary already has all the indexes build. 4. Will it faster to just scp over the files to the secondary? If I manually scp the datbase files over from the primary to the secondary will it still work? regards, Adam </pre> laphotog1-Re5JQEeQqe8AvxtiuMwx3w< at >public.gmane.org 2013-06-18T21:18:32 http://permalink.gmane.org/gmane.comp.db.mongodb.user/93696 <pre>Hello! I have 2 shard, for every shard has 3 replica set. In shared collection count 50000000 record. I remove 7000000 for cleaning collection with old value. After remove record all query as more slow! Help me! Tnx. </pre> Marco Berri 2013-06-18T20:41:47 http://permalink.gmane.org/gmane.comp.db.mongodb.user/93695 <pre>Howdy, Mike. I'm trying that now, actually. This VPN *should* be reliable; it's over leased lines using real gear. But if not, at least I can yell at the network guy. If the VPN theory is correct, would you expect it to be related to latency or straight packet loss? We're doing a ton of other traffic that's been reliable over the same link (like SAN replication) so I'm hesitant to blame the VPN. Yet.. : ) Thanks! Wes On Tuesday, June 18, 2013 2:34:08 PM UTC-4, Mike Friedman wrote: </pre> Wes 2013-06-18T20:08:26 http://permalink.gmane.org/gmane.comp.db.mongodb.user/93694 <pre>Feeling slightly guilty so here is a full example of the problem and the solution. So here is the initial valid document db.test.insert ({ "identity":"1", "a" : [ { "identifier":"10", "b" : [ { "identifier":"11"}, { "identifier":"12"} ] }, { "identifier":"20", "b" : [ { "identifier":"21"}, { "identifier":"22"} ] } ] }) Now I want to add an identifier to the b array which has the a.identifier = 20 db.test.update ({'a.identifier':'20'},{$push:{'a.$.b':{'identifier':'99'}}}) the insert happens correctly and you get "identity":"1", "a" : [ { "identifier":"10", "b" : [ </pre> Paul Clements 2013-06-18T19:49:19 http://permalink.gmane.org/gmane.comp.db.mongodb.user/93693 <pre>I believe that $addToSet, in aggregation framework, tries to push one object to an array. It's complaining because ('$lat','$lon') appears to be two objects not a single tuple (if that's what you'd intended). If you're trying to $addToSet one value after another, $addToSet now has an operator "each" which accepts an array of values. { $addToSet: { &lt;array name&gt; : { $each: [ value1, value2, etc ] } } } Gary R. </pre> Gary R 2013-06-18T19:45:59 http://permalink.gmane.org/gmane.comp.db.mongodb.user/93692 <pre>I think you will need to look in the logs at this point - you may have a slow-running operation (something like an update that's not using an index efficiently, or update that grows document causing it to move). Your mongod log has all of the operations that take longer than 100ms - I would look at those. In addition, check what your readahead is set to (sudo blockdev --report - see the RA column). If it's too high it may be causing lower RAM utilization due to paging in stuff you don't need... Check out mongotop and mongotop --locks in conjunction with mongostat to see what exactly is causing the traffic too... Asya On Tue, Jun 18, 2013 at 2:51 PM, Gabriel Brunacci &lt;gbrunacci-Re5JQEeQqe8AvxtiuMwx3w&lt; at &gt;public.gmane.org&gt; wrote: </pre> Asya Kamsky 2013-06-18T19:37:02 http://permalink.gmane.org/gmane.comp.db.mongodb.user/93691 <pre>HI Gary, Apologies, as you point out the document is incorrect, I was trying to show what I was trying to achieve rather than give the actual document. However, have now cracked it with the use of the '$' so my push is to array1.$.array2. Clemo On 18 June 2013 20:19, Gary R &lt;grechonline-Re5JQEeQqe8AvxtiuMwx3w&lt; at &gt;public.gmane.org&gt; wrote: </pre> Paul Clements 2013-06-18T19:25:10 http://permalink.gmane.org/gmane.comp.db.mongodb.user/93690 <pre>To begin, I'm surprised that you were able to actually use this document. I don't believe that field names can contain a "." Is array2_1 always the 0th element in array1? Gary R. On Monday, June 17, 2013 1:40:47 PM UTC-6, Clemo wrote: </pre> Gary R 2013-06-18T19:19:37 http://permalink.gmane.org/gmane.comp.db.mongodb.user/93689 <pre>This is from my 'top' command result now on my master (two mongod, one with configsvr) Note that 82% mem usage for my mongod, and now, I still have tons of storage leff (about 86%) PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 16812 mongod 20 0 108g 6.0g 5.9g S 1.3* 82.2* 142:26.58 mongod 16979 root 20 0 424m 56m 24m S 0.3 0.8 65:43.88 mongod 1 root 20 0 19356 1548 1240 S 0.0 0.0 0:01.83 init 2 root 20 0 0 0 0 S 0.0 0.0 0:00.00 kthreadd On Tuesday, June 18, 2013 12:12:00 PM UTC-7, PaulKE wrote: </pre> PaulKE 2013-06-18T19:17:30 Search the mailing list at Gmane query http://search.gmane.org/?group=$group=gmane.comp.db.mongodb.user