gmane.comp.jakarta.lucene.devel

[jira] [Commented] (LUCENE-5016) Sampling can break FacetResult labeling

Rob Audenaerde (JIRA — 2013-05-24T15:46:23

    [ https://issues.apache.org/jira/browse/LUCENE-5016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13666401#comment-13666401 ] 

Rob Audenaerde commented on LUCENE-5016:
----------------------------------------

Now that I wrote the tests, I realise that maybe the behaviour of the StandardFacetAccumulator is incorrect, as it labels a FacetResult of a Facet that does not exist in the taxonomy...

The behaviour of the SamplingAccumulator and the Standard differ.

For my use case, it is very helpful if all the FacetRequests return a FacetResult with the same label as the request, but I can imagine that this is not desired.
                

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (LUCENE-5016) Sampling can break FacetResult labeling

Rob Audenaerde (JIRA — 2013-05-24T15:42:20

     [ https://issues.apache.org/jira/browse/LUCENE-5016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rob Audenaerde updated LUCENE-5016:
-----------------------------------

    Attachment: test-labels.zip
    

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (SOLR-4470) Support for basic http auth in internal solr requests

Mark Miller (JIRA — 2013-05-24T15:34:35

    [ https://issues.apache.org/jira/browse/SOLR-4470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13666397#comment-13666397 ] 

Mark Miller commented on SOLR-4470:
-----------------------------------

bq. Personally I do not understand why a serious project would stay out of security

It's simply the current stance of the project. Like I said, if a majority of Solr devs disagree with me and want to move down this road, I'm not very likely to stand in their way. But I want to see the dev/pmc support for a change in a very long standing policy to stay out of security code. 
                

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (SOLR-4470) Support for basic http auth in internal solr requests

Per Steffensen (JIRA — 2013-05-24T15:06:21

    [ https://issues.apache.org/jira/browse/SOLR-4470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13666385#comment-13666385 ] 

Per Steffensen commented on SOLR-4470:
--------------------------------------

Will respond to you comments and questions monday (its late i europe now), but in the mean-time, can I ask you, Mark, to point out the exact comment you are referring to, so that I am sure I will address your exact concern. Doing a quick search I was not able to locate the place you are referring to. Thanks.
                

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.7.0_21) - Build # 2856 - Still Failing!

Policeman Jenkins Server — 2013-05-24T14:55:46

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/2856/
Java: 32bit/jdk1.7.0_21 -server -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 230 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 230 seconds
at __randomizedtesting.SeedInfo.seed([A980456175399E58:2866CB790266FE64]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:173)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:131)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:126)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:512)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:146)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 9573 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4:junit4]   2> 1380798 T4666 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /xr_/
[junit4:junit4]   2> 1380803 T4666 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-CollectionsAPIDistributedZkTest-1369406146006
[junit4:junit4]   2> 1380804 T4666 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 1380805 T4667 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 1380895 T4666 oasc.ZkTestServer.run start zk server on port:54304
[junit4:junit4]   2> 1380897 T4666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1380907 T4673 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >6d10f1 name:ZooKeeperConnection Watcher:127.0.0.1:54304 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1380907 T4666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1380908 T4666 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 1380913 T4668 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13ed6f785df0000, likely client has closed socket
[junit4:junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4]   2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4]   2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 
[junit4:junit4]   2> 1380915 T4666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1380918 T4675 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >123c29d name:ZooKeeperConnection Watcher:127.0.0.1:54304/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1380918 T4666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1380919 T4666 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 1380925 T4666 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 1380928 T4666 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 1380932 T4666 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 1380938 T4666 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 1380939 T4666 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 1380947 T4666 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 1380948 T4666 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 1380953 T4666 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 1380954 T4666 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 1380959 T4666 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 1380959 T4666 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 1380964 T4666 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 1380964 T4666 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 1380969 T4666 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 1380969 T4666 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 1380973 T4666 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 1380974 T4666 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 1380979 T4666 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 1380979 T4666 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 1380984 T4666 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 1380985 T4666 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 1381420 T4666 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 1381426 T4666 oejs.AbstractConnector.doStart Started SelectChannelConnector< at >127.0.0.1:54311
[junit4:junit4]   2> 1381427 T4666 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 1381427 T4666 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1381427 T4666 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196
[junit4:junit4]   2> 1381427 T4666 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\solr.xml
[junit4:junit4]   2> 1381427 T4666 oasc.CoreContainer.<init> New CoreContainer 32066812
[junit4:junit4]   2> 1381427 T4666 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\'
[junit4:junit4]   2> 1381428 T4666 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\'
[junit4:junit4]   2> 1381513 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196
[junit4:junit4]   2> 1381515 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\collection1
[junit4:junit4]   2> 1381517 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\collection1\conf
[junit4:junit4]   2> 1381752 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\collection1\conf\xslt
[junit4:junit4]   2> 1381765 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\collection1\lib
[junit4:junit4]   2> 1381770 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\collection1\lib\classes
[junit4:junit4]   2> 1381781 T4666 oasc.SolrCoreDiscoverer.addCore Discovered properties file C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\conf\core.properties, adding to cores
[junit4:junit4]   2> 1381807 T4666 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 1381808 T4666 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 1381809 T4666 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 1381809 T4666 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 1381810 T4666 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 1381810 T4666 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 1381811 T4666 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 1381811 T4666 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 1381812 T4666 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 1381812 T4666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 1381822 T4666 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 1381823 T4666 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54304/solr
[junit4:junit4]   2> 1381823 T4666 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 1381824 T4666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1381838 T4686 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >d6a5ee name:ZooKeeperConnection Watcher:127.0.0.1:54304 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1381838 T4666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1381841 T4666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 1381847 T4666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1381850 T4688 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >1584507 name:ZooKeeperConnection Watcher:127.0.0.1:54304/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1381850 T4666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1381853 T4666 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4]   2> 1381859 T4666 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4]   2> 1381863 T4666 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 1381866 T4666 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54311_xr_
[junit4:junit4]   2> 1381869 T4666 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54311_xr_
[junit4:junit4]   2> 1381873 T4666 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 1381882 T4666 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 1381888 T4666 oasc.Overseer.start Overseer (id=89745401185239043-127.0.0.1:54311_xr_-n_0000000000) starting
[junit4:junit4]   2> 1381894 T4666 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4]   2> 1381902 T4690 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 1381903 T4666 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 1381907 T4666 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 1381910 T4666 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 1381915 T4689 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 1381918 T4666 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 1381918 T4666 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 1381918 T4666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1381923 T4666 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 1381925 T4666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1381929 T4693 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >122109a name:ZooKeeperConnection Watcher:127.0.0.1:54304/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1381930 T4666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1381930 T4666 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 1381935 T4666 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 1382402 T4666 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 1382406 T4666 oejs.AbstractConnector.doStart Started SelectChannelConnector< at >127.0.0.1:54323
[junit4:junit4]   2> 1382407 T4666 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 1382407 T4666 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1382408 T4666 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137
[junit4:junit4]   2> 1382408 T4666 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\solr.xml
[junit4:junit4]   2> 1382408 T4666 oasc.CoreContainer.<init> New CoreContainer 18916263
[junit4:junit4]   2> 1382409 T4666 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\'
[junit4:junit4]   2> 1382409 T4666 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\'
[junit4:junit4]   2> 1382492 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137
[junit4:junit4]   2> 1382493 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\collection1
[junit4:junit4]   2> 1382495 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\collection1\conf
[junit4:junit4]   2> 1382789 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\collection1\conf\xslt
[junit4:junit4]   2> 1382801 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\collection1\lib
[junit4:junit4]   2> 1382807 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\collection1\lib\classes
[junit4:junit4]   2> 1382817 T4666 oasc.SolrCoreDiscoverer.addCore Discovered properties file C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\conf\core.properties, adding to cores
[junit4:junit4]   2> 1382841 T4666 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 1382842 T4666 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 1382842 T4666 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 1382843 T4666 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 1382843 T4666 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 1382843 T4666 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 1382844 T4666 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 1382845 T4666 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 1382845 T4666 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 1382845 T4666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 1382854 T4666 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 1382855 T4666 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54304/solr
[junit4:junit4]   2> 1382855 T4666 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 1382857 T4666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1382871 T4704 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >185d704 name:ZooKeeperConnection Watcher:127.0.0.1:54304 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1382871 T4666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1382874 T4666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 1382881 T4666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1382885 T4706 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >1035106 name:ZooKeeperConnection Watcher:127.0.0.1:54304/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1382885 T4666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1382893 T4666 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 1383789 T4666 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54323_xr_
[junit4:junit4]   2> 1383792 T4666 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54323_xr_
[junit4:junit4]   2> 1383798 T4693 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 1383798 T4688 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 1383799 T4706 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 1383807 T4666 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 1383807 T4666 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 1383808 T4666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1384401 T4666 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 1384406 T4666 oejs.AbstractConnector.doStart Started SelectChannelConnector< at >127.0.0.1:54332
[junit4:junit4]   2> 1384407 T4666 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 1384407 T4666 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1384408 T4666 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369406149014
[junit4:junit4]   2> 1384408 T4666 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369406149014\solr.xml
[junit4:junit4]   2> 1384408 T4666 oasc.CoreContainer.<init> New CoreContainer 21391501
[junit4:junit4]   2> 1384409 T4666 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369406149014\'
[junit4:junit4]   2> 1384410 T4666 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369406149014\'
[junit4:junit4]   2> 1384508 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369406149014
[junit4:junit4]   2> 1384509 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369406149014\collection1
[junit4:junit4]   2> 1384511 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369406149014\collection1\conf
[junit4:junit4]   2> 1384744 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369406149014\collection1\conf\xslt
[junit4:junit4]   2> 1384756 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369406149014\collection1\lib
[junit4:junit4]   2> 1384760 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369406149014\collection1\lib\classes
[junit4:junit4]   2> 1384766 T4666 oasc.SolrCoreDiscoverer.addCore Discovered properties file C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369406149014\conf\core.properties, adding to cores
[junit4:junit4]   2> 1384784 T4666 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 1384784 T4666 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 1384784 T4666 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 1384784 T4666 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 1384784 T4666 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 1384785 T4666 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 1384785 T4666 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 1384786 T4666 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 1384787 T4666 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 1384787 T4666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 1384795 T4666 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 1384796 T4666 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54304/solr
[junit4:junit4]   2> 1384796 T4666 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 1384797 T4666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1384814 T4718 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >4a793a name:ZooKeeperConnection Watcher:127.0.0.1:54304 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1384814 T4666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1384817 T4666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 1384826 T4666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1384830 T4720 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >1e5184c name:ZooKeeperConnection Watcher:127.0.0.1:54304/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1384831 T4666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1384840 T4666 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 1385736 T4666 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54332_xr_
[junit4:junit4]   2> 1385741 T4666 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54332_xr_
[junit4:junit4]   2> 1385749 T4706 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 1385750 T4688 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 1385750 T4720 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 1385750 T4693 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 1385760 T4666 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 1385761 T4666 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 1385761 T4666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1386243 T4666 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 1386248 T4666 oejs.AbstractConnector.doStart Started SelectChannelConnector< at >127.0.0.1:54341
[junit4:junit4]   2> 1386248 T4666 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 1386249 T4666 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1386249 T4666 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970
[junit4:junit4]   2> 1386250 T4666 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\solr.xml
[junit4:junit4]   2> 1386250 T4666 oasc.CoreContainer.<init> New CoreContainer 8125483
[junit4:junit4]   2> 1386250 T4666 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\'
[junit4:junit4]   2> 1386250 T4666 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\'
[junit4:junit4]   2> 1386337 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970
[junit4:junit4]   2> 1386337 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\collection1
[junit4:junit4]   2> 1386339 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\collection1\conf
[junit4:junit4]   2> 1386527 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\collection1\conf\xslt
[junit4:junit4]   2> 1386533 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\collection1\lib
[junit4:junit4]   2> 1386536 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\collection1\lib\classes
[junit4:junit4]   2> 1386541 T4666 oasc.SolrCoreDiscoverer.addCore Discovered properties file C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\conf\core.properties, adding to cores
[junit4:junit4]   2> 1386556 T4666 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 1386556 T4666 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 1386557 T4666 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 1386557 T4666 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 1386558 T4666 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 1386558 T4666 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 1386558 T4666 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 1386558 T4666 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 1386559 T4666 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 1386559 T4666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 1386566 T4666 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 1386567 T4666 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54304/solr
[junit4:junit4]   2> 1386567 T4666 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 1386570 T4666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1386589 T4732 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >1e00076 name:ZooKeeperConnection Watcher:127.0.0.1:54304 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1386590 T4666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1386593 T4666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 1386600 T4666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1386604 T4734 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >11e5d8e name:ZooKeeperConnection Watcher:127.0.0.1:54304/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1386605 T4666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1386612 T4666 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 1387572 T4666 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54341_xr_
[junit4:junit4]   2> 1387575 T4666 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54341_xr_
[junit4:junit4]   2> 1387584 T4693 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 1387585 T4734 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 1387585 T4720 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 1387585 T4688 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 1387586 T4706 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 1387597 T4666 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 1387597 T4666 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 1387598 T4666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1388166 T4666 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 1388173 T4666 oejs.AbstractConnector.doStart Started SelectChannelConnector< at >127.0.0.1:54350
[junit4:junit4]   2> 1388174 T4666 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 1388174 T4666 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1388175 T4666 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807
[junit4:junit4]   2> 1388175 T4666 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\solr.xml
[junit4:junit4]   2> 1388176 T4666 oasc.CoreContainer.<init> New CoreContainer 4807293
[junit4:junit4]   2> 1388176 T4666 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\'
[junit4:junit4]   2> 1388177 T4666 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\'
[junit4:junit4]   2> 1388300 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807
[junit4:junit4]   2> 1388302 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\collection1
[junit4:junit4]   2> 1388304 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\collection1\conf
[junit4:junit4]   2> 1388508 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\collection1\conf\xslt
[junit4:junit4]   2> 1388516 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\collection1\lib
[junit4:junit4]   2> 1388518 T4666 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\collection1\lib\classes
[junit4:junit4]   2> 1388524 T4666 oasc.SolrCoreDiscoverer.addCore Discovered properties file C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\conf\core.properties, adding to cores
[junit4:junit4]   2> 1388540 T4666 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 1388542 T4666 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 1388542 T4666 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 1388543 T4666 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 1388543 T4666 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 1388543 T4666 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 1388543 T4666 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 1388544 T4666 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 1388545 T4666 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 1388545 T4666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 1388552 T4666 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 1388553 T4666 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54304/solr
[junit4:junit4]   2> 1388553 T4666 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 1388556 T4666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1388574 T4746 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >9ebf73 name:ZooKeeperConnection Watcher:127.0.0.1:54304 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1388575 T4666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1388578 T4666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 1388587 T4666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1388590 T4748 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >12fa8ab name:ZooKeeperConnection Watcher:127.0.0.1:54304/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1388591 T4666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1388599 T4666 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 1389584 T4666 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54350_xr_
[junit4:junit4]   2> 1389588 T4666 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54350_xr_
[junit4:junit4]   2> 1389594 T4748 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 1389594 T4720 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 1389594 T4706 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 1389595 T4688 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 1389595 T4734 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 1389595 T4693 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 1389604 T4666 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 1389605 T4666 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 1389605 T4666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1389611 T4666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1389617 T4701 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2
[junit4:junit4]   2> 1389620 T4688 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4]   2> 1389624 T4690 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4:junit4]   2>   "operation":"createcollection",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "maxShardsPerNode":null,
[junit4:junit4]   2>   "createNodeSet":null,
[junit4:junit4]   2>   "name":"nodes_used_collection",
[junit4:junit4]   2>   "replicationFactor":"2"}
[junit4:junit4]   2> 1389625 T4690 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica1 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:54323_xr_
[junit4:junit4]   2> 1389625 T4690 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica2 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:54311_xr_
[junit4:junit4]   2> 1389626 T4690 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica1 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:54341_xr_
[junit4:junit4]   2> 1389628 T4690 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica2 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:54350_xr_
[junit4:junit4]   2> 1389630 T4702 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\nodes_used_collection_shard1_replica1
[junit4:junit4]   2> 1389631 T4702 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4]   2> 1389632 T4729 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\nodes_used_collection_shard2_replica1
[junit4:junit4]   2> 1389633 T4729 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4]   2> 1389632 T4684 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica2' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\nodes_used_collection_shard1_replica2
[junit4:junit4]   2> 1389634 T4684 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4]   2> 1389635 T4702 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4]   2> 1389634 T4740 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica2' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\nodes_used_collection_shard2_replica2
[junit4:junit4]   2> 1389637 T4740 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4]   2> 1389635 T4702 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 1389638 T4684 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4]   2> 1389638 T4684 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 1389639 T4740 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4]   2> 1389635 T4729 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4]   2> 1389639 T4729 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 1389639 T4740 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 1389641 T4702 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 1389641 T4702 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4]   2> 1389643 T4684 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 1389643 T4684 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4]   2> 1389645 T4729 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 1389645 T4729 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4]   2> 1389646 T4740 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 1389647 T4740 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4]   2> 1389653 T4684 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4]   2> 1389653 T4702 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4]   2> 1389656 T4729 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4]   2> 1389658 T4740 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4]   2> 1389662 T4702 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\nodes_used_collection_shard1_replica1\'
[junit4:junit4]   2> 1389662 T4729 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\nodes_used_collection_shard2_replica1\'
[junit4:junit4]   2> 1389664 T4684 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\nodes_used_collection_shard1_replica2\'
[junit4:junit4]   2> 1389666 T4740 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\nodes_used_collection_shard2_replica2\'
[junit4:junit4]   2> 1389796 T4729 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 1389814 T4684 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 1389862 T4702 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 1389868 T4740 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 1389953 T4729 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1389957 T4729 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 1389963 T4729 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica1] Schema name=test
[junit4:junit4]   2> 1390015 T4684 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1390042 T4684 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 1390050 T4684 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica2] Schema name=test
[junit4:junit4]   2> 1390064 T4740 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1390076 T4740 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 1390086 T4740 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica2] Schema name=test
[junit4:junit4]   2> 1390094 T4702 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1390113 T4702 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 1390121 T4702 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica1] Schema name=test
[junit4:junit4]   2> 1391215 T4729 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1391259 T4729 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1391263 T4729 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1391451 T4740 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1391480 T4740 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1391484 T4740 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1391705 T4702 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1391715 T4702 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1391721 T4702 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1391749 T4729 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1391757 T4729 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1391758 T4740 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1391764 T4740 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1391765 T4729 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1391771 T4740 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1391772 T4729 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1391773 T4729 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1391772 T4702 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1391774 T4740 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1391777 T4740 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1391778 T4740 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1391773 T4729 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1391781 T4702 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1391785 T4740 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1391785 T4740 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1391786 T4740 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1391786 T4740 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica2] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\nodes_used_collection_shard2_replica2\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\nodes_used_collection_shard2_replica2\data\
[junit4:junit4]   2> 1391786 T4740 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >258ed1
[junit4:junit4]   2> 1391787 T4740 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1391787 T4740 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\nodes_used_collection_shard2_replica2\data\
[junit4:junit4]   2> 1391791 T4702 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1391792 T4740 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\nodes_used_collection_shard2_replica2\data\index/
[junit4:junit4]   2> 1391792 T4740 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica2] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\nodes_used_collection_shard2_replica2\data\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1391792 T4740 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\nodes_used_collection_shard2_replica2\data\index
[junit4:junit4]   2> 1391793 T4729 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1391793 T4729 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1391794 T4729 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1391795 T4729 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\nodes_used_collection_shard2_replica1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\nodes_used_collection_shard2_replica1\data\
[junit4:junit4]   2> 1391796 T4729 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >258ed1
[junit4:junit4]   2> 1391796 T4729 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1391797 T4729 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\nodes_used_collection_shard2_replica1\data\
[junit4:junit4]   2> 1391797 T4729 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\nodes_used_collection_shard2_replica1\data\index/
[junit4:junit4]   2> 1391798 T4729 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\nodes_used_collection_shard2_replica1\data\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1391798 T4729 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\nodes_used_collection_shard2_replica1\data\index
[junit4:junit4]   2> 1391804 T4729 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >8d08e9 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >615fb1),segFN=segments_1,generation=1}
[junit4:junit4]   2> 1391805 T4729 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 1391809 T4702 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1391809 T4702 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1391810 T4702 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1391813 T4729 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1391814 T4729 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1391815 T4729 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1391816 T4729 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1391816 T4729 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1391816 T4729 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1391818 T4729 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1391818 T4729 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1391819 T4729 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1391825 T4740 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >cf653c lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >1e02ee4),segFN=segments_1,generation=1}
[junit4:junit4]   2> 1391825 T4740 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 1391828 T4740 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1391828 T4740 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1391829 T4740 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1391829 T4740 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1391830 T4740 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1391831 T4740 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1391831 T4740 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1391831 T4740 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1391832 T4740 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1391836 T4702 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1391836 T4702 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1391837 T4702 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1391837 T4702 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\nodes_used_collection_shard1_replica1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\nodes_used_collection_shard1_replica1\data\
[junit4:junit4]   2> 1391837 T4702 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >258ed1
[junit4:junit4]   2> 1391837 T4702 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1391838 T4702 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\nodes_used_collection_shard1_replica1\data\
[junit4:junit4]   2> 1391840 T4702 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\nodes_used_collection_shard1_replica1\data\index/
[junit4:junit4]   2> 1391840 T4702 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\nodes_used_collection_shard1_replica1\data\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1391840 T4702 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\nodes_used_collection_shard1_replica1\data\index
[junit4:junit4]   2> 1391843 T4729 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1391850 T4729 oass.SolrIndexSearcher.<init> Opening Searcher< at >2818ba main
[junit4:junit4]   2> 1391851 T4729 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\nodes_used_collection_shard2_replica1\data\tlog
[junit4:junit4]   2> 1391853 T4729 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1391854 T4729 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1391860 T4740 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1391862 T4702 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >1cc2ed8 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >167822d),segFN=segments_1,generation=1}
[junit4:junit4]   2> 1391867 T4702 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 1391871 T4702 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1391871 T4702 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1391872 T4702 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1391872 T4702 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1391873 T4702 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1391873 T4702 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1391873 T4702 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1391874 T4702 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1391874 T4702 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1391876 T4684 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1391880 T4740 oass.SolrIndexSearcher.<init> Opening Searcher< at >4c439d main
[junit4:junit4]   2> 1391880 T4740 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\nodes_used_collection_shard2_replica2\data\tlog
[junit4:junit4]   2> 1391882 T4740 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1391882 T4740 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1391885 T4702 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1391890 T4702 oass.SolrIndexSearcher.<init> Opening Searcher< at >1b379e9 main
[junit4:junit4]   2> 1391890 T4702 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\nodes_used_collection_shard1_replica1\data\tlog
[junit4:junit4]   2> 1391890 T4684 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1391892 T4702 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1391892 T4702 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1391894 T4684 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1391897 T4755 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica2] Registered new searcher Searcher< at >4c439d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1391899 T4740 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=down
[junit4:junit4]   2> 1391901 T4754 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica1] Registered new searcher Searcher< at >2818ba main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1391901 T4756 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica1] Registered new searcher Searcher< at >1b379e9 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1391902 T4702 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=down
[junit4:junit4]   2> 1391904 T4729 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=down
[junit4:junit4]   2> 1391931 T4684 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1391943 T4684 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1391949 T4684 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1391952 T4684 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1391952 T4684 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1391952 T4684 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1391954 T4684 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1391954 T4684 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1391954 T4684 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1391955 T4684 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica2] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\nodes_used_collection_shard1_replica2\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\nodes_used_collection_shard1_replica2\data\
[junit4:junit4]   2> 1391955 T4684 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >258ed1
[junit4:junit4]   2> 1391955 T4684 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1391956 T4684 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\nodes_used_collection_shard1_replica2\data\
[junit4:junit4]   2> 1391957 T4684 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\nodes_used_collection_shard1_replica2\data\index/
[junit4:junit4]   2> 1391957 T4684 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica2] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\nodes_used_collection_shard1_replica2\data\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1391958 T4684 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\nodes_used_collection_shard1_replica2\data\index
[junit4:junit4]   2> 1391963 T4684 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >f5ef4c lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >136ebbb),segFN=segments_1,generation=1}
[junit4:junit4]   2> 1391963 T4684 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 1391968 T4684 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1391968 T4684 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1391969 T4684 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1391969 T4684 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1391970 T4684 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1391970 T4684 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1391970 T4684 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1391971 T4684 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1391971 T4684 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1391982 T4684 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1391989 T4684 oass.SolrIndexSearcher.<init> Opening Searcher< at >119e3ab main
[junit4:junit4]   2> 1391989 T4684 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\nodes_used_collection_shard1_replica2\data\tlog
[junit4:junit4]   2> 1391991 T4684 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1391991 T4684 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1391995 T4757 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica2] Registered new searcher Searcher< at >119e3ab main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1391996 T4684 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=down
[junit4:junit4]   2> 1392012 T4689 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1392012 T4689 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":null,
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":"shard2",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"nodes_used_collection_shard2_replica2",
[junit4:junit4]   2>   "collection":"nodes_used_collection",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:54350_xr_",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:54350/xr_"}
[junit4:junit4]   2> 1392013 T4689 oasc.Overseer$ClusterStateUpdater.createCollection Create collection nodes_used_collection with numShards 2
[junit4:junit4]   2> 1392022 T4689 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":null,
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"nodes_used_collection_shard1_replica1",
[junit4:junit4]   2>   "collection":"nodes_used_collection",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:54323_xr_",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:54323/xr_"}
[junit4:junit4]   2> 1392041 T4689 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":null,
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":"shard2",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"nodes_used_collection_shard2_replica1",
[junit4:junit4]   2>   "collection":"nodes_used_collection",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:54341_xr_",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:54341/xr_"}
[junit4:junit4]   2> 1392073 T4689 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":null,
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"nodes_used_collection_shard1_replica2",
[junit4:junit4]   2>   "collection":"nodes_used_collection",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:54311_xr_",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:54311/xr_"}
[junit4:junit4]   2> 1392087 T4734 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1392087 T4720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1392088 T4688 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1392087 T4693 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1392088 T4748 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1392089 T4706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1392894 T4740 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica2
[junit4:junit4]   2> 1392895 T4740 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica2 address:http://127.0.0.1:54350/xr_ collection:nodes_used_collection shard:shard2
[junit4:junit4]   2> 1392896 T4702 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica1
[junit4:junit4]   2> 1392897 T4702 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica1 address:http://127.0.0.1:54323/xr_ collection:nodes_used_collection shard:shard1
[junit4:junit4]   2> 1392896 T4729 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica1
[junit4:junit4]   2> 1392898 T4729 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica1 address:http://127.0.0.1:54341/xr_ collection:nodes_used_collection shard:shard2
[junit4:junit4]   2> 1392898 T4740 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard2/election
[junit4:junit4]   2> 1392900 T4729 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard2/election
[junit4:junit4]   2> 1392900 T4702 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard1/election
[junit4:junit4]   2> 1392925 T4729 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 1392927 T4702 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 1392937 T4729 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 1392938 T4729 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 1392938 T4729 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54341/xr_/nodes_used_collection_shard2_replica1/
[junit4:junit4]   2> 1392938 T4702 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=179999
[junit4:junit4]   2> 1392939 T4729 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica1 url=http://127.0.0.1:54341/xr_ START replicas=[http://127.0.0.1:54350/xr_/nodes_used_collection_shard2_replica2/] nUpdates=100
[junit4:junit4]   2> 1392941 T4729 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica1 url=http://127.0.0.1:54341/xr_ DONE.  We have no versions.  sync failed.
[junit4:junit4]   2> 1392941 T4729 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4]   2> 1392941 T4729 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4]   2> 1392941 T4729 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54341/xr_/nodes_used_collection_shard2_replica1/
[junit4:junit4]   2> 1392941 T4729 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard2
[junit4:junit4]   2> ASYNC  NEW_CORE C1361 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore< at >139e28e url=http://127.0.0.1:54350/xr_/nodes_used_collection_shard2_replica2 node=127.0.0.1:54350_xr_ C1361_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{shard=shard2, state=down, core=nodes_used_collection_shard2_replica2, collection=nodes_used_collection, node_name=127.0.0.1:54350_xr_, base_url=http://127.0.0.1:54350/xr_}
[junit4:junit4]   2> 1392953 T4741 C1361 P54350 oasc.SolrCore.execute [nodes_used_collection_shard2_replica2] webapp=/xr_ path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=2 
[junit4:junit4]   2> 1392980 T4684 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica2
[junit4:junit4]   2> 1392980 T4684 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica2 address:http://127.0.0.1:54311/xr_ collection:nodes_used_collection shard:shard1
[junit4:junit4]   2> 1393430 T4702 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 1393431 T4702 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 1393431 T4702 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54323/xr_/nodes_used_collection_shard1_replica1/
[junit4:junit4]   2> 1393431 T4702 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica1 url=http://127.0.0.1:54323/xr_ START replicas=[http://127.0.0.1:54311/xr_/nodes_used_collection_shard1_replica2/] nUpdates=100
[junit4:junit4]   2> 1393432 T4702 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica1 url=http://127.0.0.1:54323/xr_ DONE.  We have no versions.  sync failed.
[junit4:junit4]   2> 1393432 T4702 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4]   2> 1393432 T4702 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4]   2> 1393432 T4702 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54323/xr_/nodes_used_collection_shard1_replica1/
[junit4:junit4]   2> 1393433 T4702 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard1
[junit4:junit4]   2> ASYNC  NEW_CORE C1362 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore< at >44e2c4 url=http://127.0.0.1:54311/xr_/nodes_used_collection_shard1_replica2 node=127.0.0.1:54311_xr_ C1362_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=down, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:54311_xr_, base_url=http://127.0.0.1:54311/xr_}
[junit4:junit4]   2> 1393449 T4679 C1362 P54311 oasc.SolrCore.execute [nodes_used_collection_shard1_replica2] webapp=/xr_ path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1 
[junit4:junit4]   2> 1393584 T4689 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1393652 T4693 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1393652 T4734 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1393653 T4720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1393653 T4688 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1393653 T4706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1393653 T4748 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1393667 T4702 oasc.ZkController.register We are http://127.0.0.1:54323/xr_/nodes_used_collection_shard1_replica1/ and leader is http://127.0.0.1:54323/xr_/nodes_used_collection_shard1_replica1/
[junit4:junit4]   2> 1393667 T4702 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard1_replica1 baseURL=http://127.0.0.1:54323/xr_
[junit4:junit4]   2> 1393669 T4702 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 1393670 T4702 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=active
[junit4:junit4]   2> 1393677 T4702 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1393678 T4702 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=4049 
[junit4:junit4]   2> 1393706 T4729 oasc.ZkController.register We are http://127.0.0.1:54341/xr_/nodes_used_collection_shard2_replica1/ and leader is http://127.0.0.1:54341/xr_/nodes_used_collection_shard2_replica1/
[junit4:junit4]   2> 1393706 T4729 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard2_replica1 baseURL=http://127.0.0.1:54341/xr_
[junit4:junit4]   2> 1393706 T4729 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 1393707 T4729 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=active
[junit4:junit4]   2> 1393711 T4729 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1393713 T4729 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=4081 
[junit4:junit4]   2> 1393911 T4740 oasc.ZkController.register We are http://127.0.0.1:54350/xr_/nodes_used_collection_shard2_replica2/ and leader is http://127.0.0.1:54341/xr_/nodes_used_collection_shard2_replica1/
[junit4:junit4]   2> 1393912 T4740 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard2_replica2 baseURL=http://127.0.0.1:54350/xr_
[junit4:junit4]   2> 1393912 T4740 oasc.ZkController.checkRecovery Core needs to recover:nodes_used_collection_shard2_replica2
[junit4:junit4]   2> 1393912 T4740 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> 1393914 T4740 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1393914 T4740 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=4280 
[junit4:junit4]   2> 1393938 T4760 C1361 P54350 oasc.RecoveryStrategy.run Starting recovery process.  core=nodes_used_collection_shard2_replica2 recoveringAfterStartup=true
[junit4:junit4]   2> 1393938 T4760 C1361 P54350 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 1393938 T4760 C1361 P54350 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=recovering
[junit4:junit4]   2> 1393943 T4760 C1361 P54350 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1393959 T4725 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:54350_xr__nodes_used_collection_shard2_replica2, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   2> 1393973 T4684 oasc.ZkController.register We are http://127.0.0.1:54311/xr_/nodes_used_collection_shard1_replica2/ and leader is http://127.0.0.1:54323/xr_/nodes_used_collection_shard1_replica1/
[junit4:junit4]   2> 1393974 T4684 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard1_replica2 baseURL=http://127.0.0.1:54311/xr_
[junit4:junit4]   2> 1393974 T4684 oasc.ZkController.checkRecovery Core needs to recover:nodes_used_collection_shard1_replica2
[junit4:junit4]   2> 1393974 T4684 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> 1393977 T4761 C1362 P54311 oasc.RecoveryStrategy.run Starting recovery process.  core=nodes_used_collection_shard1_replica2 recoveringAfterStartup=true
[junit4:junit4]   2> 1393977 T4761 C1362 P54311 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 1393977 T4761 C1362 P54311 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=recovering
[junit4:junit4]   2> 1393977 T4684 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1393981 T4761 C1362 P54311 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1393982 T4684 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=4350 
[junit4:junit4]   2> 1393983 T4690 oasc.OverseerCollectionProcessor.createCollection Finished create command on all shards for collection: nodes_used_collection
[junit4:junit4]   2> 1393989 T4699 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:54311_xr__nodes_used_collection_shard1_replica2, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   2> 1393990 T4706 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work/qnr-0000000000 state: SyncConnected type NodeDataChanged
[junit4:junit4]   2> 1393996 T4688 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4]   2> 1393996 T4690 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Message id:/overseer/collection-queue-work/qn-0000000000 complete, response:{success={null={responseHeader={status=0,QTime=4049},core=nodes_used_collection_shard1_replica1},null={responseHeader={status=0,QTime=4081},core=nodes_used_collection_shard2_replica1},null={responseHeader={status=0,QTime=4280},core=nodes_used_collection_shard2_replica2},null={responseHeader={status=0,QTime=4350},core=nodes_used_collection_shard1_replica2}}}
[junit4:junit4]   2> 1394000 T4701 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2} status=0 QTime=4383 
[junit4:junit4]   2> 1394001 T4666 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 1394003 T4666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1394008 T4763 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >fedfa5 name:ZooKeeperConnection Watcher:127.0.0.1:54304/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1394009 T4666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1394011 T4666 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 1394015 T4666 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 1394020 T4666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1394030 T4765 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >14c51d6 name:ZooKeeperConnection Watcher:127.0.0.1:54304/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1394031 T4666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1394033 T4666 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 1394045 T4726 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=2&maxShardsPerNode=3&name=awholynewcollection_0&replicationFactor=5&action=CREATE&wt=javabin&version=2
[junit4:junit4]   2> 1394048 T4688 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4]   2> 1394052 T4690 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000002 message:{
[junit4:junit4]   2>   "operation":"createcollection",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "maxShardsPerNode":"3",
[junit4:junit4]   2>   "createNodeSet":null,
[junit4:junit4]   2>   "name":"awholynewcollection_0",
[junit4:junit4]   2>   "replicationFactor":"5"}
[junit4:junit4]   2> 1394052 T4690 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica1 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:54311_xr_
[junit4:junit4]   2> 1394052 T4690 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica2 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:54332_xr_
[junit4:junit4]   2> 1394052 T4690 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica3 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:54323_xr_
[junit4:junit4]   2> 1394053 T4690 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica4 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:54341_xr_
[junit4:junit4]   2> 1394053 T4690 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica5 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:54350_xr_
[junit4:junit4]   2> 1394054 T4690 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica1 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:54311_xr_
[junit4:junit4]   2> 1394056 T4711 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica2' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369406149014\awholynewcollection_0_shard1_replica2
[junit4:junit4]   2> 1394056 T4711 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4]   2> 1394056 T4690 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica2 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:54332_xr_
[junit4:junit4]   2> 1394057 T4700 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica3' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\awholynewcollection_0_shard1_replica3
[junit4:junit4]   2> 1394058 T4700 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4]   2> 1394059 T4727 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica4' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\awholynewcollection_0_shard1_replica4
[junit4:junit4]   2> 1394059 T4727 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4]   2> 1394055 T4681 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\awholynewcollection_0_shard1_replica1
[junit4:junit4]   2> 1394061 T4681 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4]   2> 1394064 T4700 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4]   2> 1394064 T4700 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 1394057 T4690 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica3 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:54323_xr_
[junit4:junit4]   2> 1394065 T4713 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica2' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369406149014\awholynewcollection_0_shard2_replica2
[junit4:junit4]   2> 1394066 T4713 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4]   2> 1394067 T4690 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica4 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:54341_xr_
[junit4:junit4]   2> 1394068 T4727 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4]   2> 1394068 T4727 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 1394069 T4690 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica5 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:54350_xr_
[junit4:junit4]   2> 1394070 T4681 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4]   2> 1394070 T4681 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 1394064 T4711 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4]   2> 1394072 T4711 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 1394063 T4683 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\awholynewcollection_0_shard2_replica1
[junit4:junit4]   2> 1394074 T4683 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4]   2> 1394076 T4713 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4]   2> 1394076 T4713 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 1394062 T4744 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica5' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\awholynewcollection_0_shard1_replica5
[junit4:junit4]   2> 1394077 T4744 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4]   2> 1394076 T4700 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 1394078 T4700 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4]   2> 1394079 T4744 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4]   2> 1394080 T4744 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 1394079 T4683 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4]   2> 1394081 T4683 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 1394083 T4727 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 1394083 T4727 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4]   2> 1394084 T4711 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 1394084 T4711 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4]   2> 1394087 T4713 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 1394087 T4713 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4]   2> 1394088 T4681 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 1394089 T4681 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4]   2> 1394098 T4744 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 1394099 T4744 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4]   2> 1394100 T4728 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica4' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\awholynewcollection_0_shard2_replica4
[junit4:junit4]   2> 1394100 T4728 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4]   2> 1394098 T4698 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica3' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\awholynewcollection_0_shard2_replica3
[junit4:junit4]   2> 1394101 T4698 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4]   2> 1394102 T4700 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4]   2> 1394104 T4739 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica5' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\awholynewcollection_0_shard2_replica5
[junit4:junit4]   2> 1394105 T4739 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4]   2> 1394106 T4728 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 1394106 T4728 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4]   2> 1394106 T4683 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 1394109 T4683 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4]   2> 1394110 T4698 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 1394110 T4698 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4]   2> 1394110 T4739 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 1394112 T4739 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4]   2> 1394114 T4711 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4]   2> 1394110 T4727 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4]   2> 1394117 T4713 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4]   2> 1394118 T4681 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4]   2> 1394120 T4700 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\awholynewcollection_0_shard1_replica3\'
[junit4:junit4]   2> 1394123 T4744 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4]   2> 1394127 T4728 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\awholynewcollection_0_shard2_replica4\'
[junit4:junit4]   2> 1394128 T4698 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\awholynewcollection_0_shard2_replica3\'
[junit4:junit4]   2> 1394134 T4739 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\awholynewcollection_0_shard2_replica5\'
[junit4:junit4]   2> 1394137 T4713 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369406149014\awholynewcollection_0_shard2_replica2\'
[junit4:junit4]   2> 1394143 T4683 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4]   2> 1394148 T4711 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369406149014\awholynewcollection_0_shard1_replica2\'
[junit4:junit4]   2> 1394149 T4727 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\awholynewcollection_0_shard1_replica4\'
[junit4:junit4]   2> 1394152 T4681 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\awholynewcollection_0_shard1_replica1\'
[junit4:junit4]   2> 1394152 T4744 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\awholynewcollection_0_shard1_replica5\'
[junit4:junit4]   2> 1394161 T4683 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\awholynewcollection_0_shard2_replica1\'
[junit4:junit4]   2> 1394362 T4700 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 1394479 T4711 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 1394479 T4728 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 1394501 T4683 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 1394504 T4681 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 1394509 T4713 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 1394515 T4698 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 1394520 T4744 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 1394521 T4727 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 1394528 T4739 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 1394781 T4700 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1394792 T4700 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 1394807 T4700 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica3] Schema name=test
[junit4:junit4]   2> 1394845 T4698 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1394871 T4744 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1394878 T4728 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1394882 T4698 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 1394894 T4698 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica3] Schema name=test
[junit4:junit4]   2> 1394898 T4728 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 1394899 T4744 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 1394904 T4739 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1394905 T4744 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica5] Schema name=test
[junit4:junit4]   2> 1394906 T4711 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1394918 T4739 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 1394919 T4711 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 1394924 T4681 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1394957 T4727 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1394966 T4739 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica5] Schema name=test
[junit4:junit4]   2> 1395009 T4728 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica4] Schema name=test
[junit4:junit4]   2> 1395048 T4713 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1395074 T4683 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1395082 T4711 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica2] Schema name=test
[junit4:junit4]   2> 1395170 T4727 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 1395260 T4713 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 1395265 T4713 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica2] Schema name=test
[junit4:junit4]   2> 1395280 T4727 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica4] Schema name=test
[junit4:junit4]   2> 1395292 T4681 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 1395293 T4683 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 1395441 T4681 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica1] Schema name=test
[junit4:junit4]   2> 1395482 T4683 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica1] Schema name=test
[junit4:junit4]   2> 1395634 T4689 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1395636 T4689 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"127.0.0.1:54323_xr__nodes_used_collection_shard1_replica1",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"active",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"nodes_used_collection_shard1_replica1",
[junit4:junit4]   2>   "collection":"nodes_used_collection",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:54323_xr_",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:54323/xr_"}
[junit4:junit4]   2> 1395744 T4689 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"127.0.0.1:54341_xr__nodes_used_collection_shard2_replica1",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":"shard2",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"active",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"nodes_used_collection_shard2_replica1",
[junit4:junit4]   2>   "collection":"nodes_used_collection",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:54341_xr_",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:54341/xr_"}
[junit4:junit4]   2> 1395781 T4689 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"127.0.0.1:54350_xr__nodes_used_collection_shard2_replica2",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":"shard2",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"recovering",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"nodes_used_collection_shard2_replica2",
[junit4:junit4]   2>   "collection":"nodes_used_collection",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:54350_xr_",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:54350/xr_"}
[junit4:junit4]   2> 1395848 T4689 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"127.0.0.1:54311_xr__nodes_used_collection_shard1_replica2",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"recovering",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"nodes_used_collection_shard1_replica2",
[junit4:junit4]   2>   "collection":"nodes_used_collection",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:54311_xr_",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:54311/xr_"}
[junit4:junit4]   2> 1395887 T4720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1395887 T4706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1395887 T4734 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1395888 T4688 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1395888 T4748 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1395896 T4693 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1395898 T4765 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1395900 T4763 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1395984 T4725 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:54350_xr__nodes_used_collection_shard2_replica2, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4]   2> 1395984 T4725 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:54350_xr__nodes_used_collection_shard2_replica2&state=recovering&nodeName=127.0.0.1:54350_xr_&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard2_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2025 
[junit4:junit4]   2> 1396004 T4699 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:54311_xr__nodes_used_collection_shard1_replica2, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4]   2> 1396005 T4699 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:54311_xr__nodes_used_collection_shard1_replica2&state=recovering&nodeName=127.0.0.1:54311_xr_&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard1_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2016 
[junit4:junit4]   2> 1397792 T4744 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1397836 T4744 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1397862 T4744 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1397929 T4744 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1397950 T4744 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1397965 T4744 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1397971 T4744 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1397971 T4744 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1397971 T4744 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1397976 T4744 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1397976 T4744 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1397977 T4744 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1397978 T4744 oasc.SolrCore.<init> [awholynewcollection_0_shard1_replica5] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\awholynewcollection_0_shard1_replica5\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\awholynewcollection_0_shard1_replica5\data\
[junit4:junit4]   2> 1397978 T4744 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >258ed1
[junit4:junit4]   2> 1397979 T4744 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1397980 T4744 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\awholynewcollection_0_shard1_replica5\data\
[junit4:junit4]   2> 1397981 T4744 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\awholynewcollection_0_shard1_replica5\data\index/
[junit4:junit4]   2> 1397981 T4744 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard1_replica5] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\awholynewcollection_0_shard1_replica5\data\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1397982 T4744 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\awholynewcollection_0_shard1_replica5\data\index
[junit4:junit4]   2> 1397997 T4744 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >9f65d0 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >1fdda06),segFN=segments_1,generation=1}
[junit4:junit4]   2> 1397998 T4744 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 1398020 T4744 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1398021 T4744 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1398021 T4744 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1398022 T4744 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1398023 T4744 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1398023 T4744 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1398023 T4744 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1398024 T4744 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1398029 T4744 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1398115 T4728 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> ASYNC  NEW_CORE C1363 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore< at >44e2c4 url=http://127.0.0.1:54311/xr_/nodes_used_collection_shard1_replica2 node=127.0.0.1:54311_xr_ C1363_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=recovering, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:54311_xr_, base_url=http://127.0.0.1:54311/xr_}
[junit4:junit4]   2> 1398124 T4761 C1363 P54311 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:54323/xr_/nodes_used_collection_shard1_replica1/ core=nodes_used_collection_shard1_replica2 - recoveringAfterStartup=true
[junit4:junit4]   2> 1398125 T4761 C1363 P54311 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica2 url=http://127.0.0.1:54311/xr_ START replicas=[http://127.0.0.1:54323/xr_/nodes_used_collection_shard1_replica1/] nUpdates=100
[junit4:junit4]   2> ASYNC  NEW_CORE C1364 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore< at >139e28e url=http://127.0.0.1:54350/xr_/nodes_used_collection_shard2_replica2 node=127.0.0.1:54350_xr_ C1364_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica2, collection=nodes_used_collection, node_name=127.0.0.1:54350_xr_, base_url=http://127.0.0.1:54350/xr_}
[junit4:junit4]   2> 1398124 T4760 C1364 P54350 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:54341/xr_/nodes_used_collection_shard2_replica1/ core=nodes_used_collection_shard2_replica2 - recoveringAfterStartup=true
[junit4:junit4]   2> 1398126 T4761 C1363 P54311 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 1398126 T4761 C1363 P54311 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=nodes_used_collection_shard1_replica2
[junit4:junit4]   2> 1398126 T4761 C1363 P54311 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=nodes_used_collection_shard1_replica2
[junit4:junit4]   2> 1398126 T4761 C1363 P54311 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=nodes_used_collection_shard1_replica2
[junit4:junit4]   2> 1398126 T4761 C1363 P54311 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 1398127 T4761 C1363 P54311 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:54323/xr_/nodes_used_collection_shard1_replica1/. core=nodes_used_collection_shard1_replica2
[junit4:junit4]   2> 1398127 T4761 C1363 P54311 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1398126 T4760 C1364 P54350 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica2 url=http://127.0.0.1:54350/xr_ START replicas=[http://127.0.0.1:54341/xr_/nodes_used_collection_shard2_replica1/] nUpdates=100
[junit4:junit4]   2> 1398133 T4760 C1364 P54350 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 1398133 T4760 C1364 P54350 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=nodes_used_collection_shard2_replica2
[junit4:junit4]   2> 1398133 T4760 C1364 P54350 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=nodes_used_collection_shard2_replica2
[junit4:junit4]   2> 1398134 T4760 C1364 P54350 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=nodes_used_collection_shard2_replica2
[junit4:junit4]   2> 1398134 T4760 C1364 P54350 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 1398134 T4760 C1364 P54350 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:54341/xr_/nodes_used_collection_shard2_replica1/. core=nodes_used_collection_shard2_replica2
[junit4:junit4]   2> 1398134 T4760 C1364 P54350 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1398273 T4728 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> ASYNC  NEW_CORE C1365 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore< at >edad24 url=http://127.0.0.1:54341/xr_/nodes_used_collection_shard2_replica1 node=127.0.0.1:54341_xr_ C1365_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=active, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:54341_xr_, base_url=http://127.0.0.1:54341/xr_, leader=true}
[junit4:junit4]   2> 1398289 T4730 C1365 P54341 oasc.SolrCore.execute [nodes_used_collection_shard2_replica1] webapp=/xr_ path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=3 
[junit4:junit4]   2> 1398274 T4729 C1365 P54341 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 1398329 T4744 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1398388 T4744 oass.SolrIndexSearcher.<init> Opening Searcher< at >851272 main
[junit4:junit4]   2> 1398479 T4744 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\awholynewcollection_0_shard1_replica5\data\tlog
[junit4:junit4]   2> 1398484 T4744 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1398484 T4744 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> ASYNC  NEW_CORE C1366 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore< at >edad24 url=http://127.0.0.1:54341/xr_/nodes_used_collection_shard2_replica1 node=127.0.0.1:54341_xr_ C1366_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=active, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:54341_xr_, base_url=http://127.0.0.1:54341/xr_, leader=true}
[junit4:junit4]   2> 1398492 T4729 C1366 P54341 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >8d08e9 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >615fb1),segFN=segments_1,generation=1}
[junit4:junit4]   2> 1398493 T4729 C1366 P54341 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 1398516 T4729 C1366 P54341 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >8d08e9 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >615fb1),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >8d08e9 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >615fb1),segFN=segments_2,generation=2}
[junit4:junit4]   2> 1398518 T4729 C1366 P54341 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 1398518 T4729 C1366 P54341 oass.SolrIndexSearcher.<init> Opening Searcher< at >950e8a realtime
[junit4:junit4]   2> 1398518 T4729 C1366 P54341 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 1398519 T4729 C1366 P54341 oasup.LogUpdateProcessor.finish [nodes_used_collection_shard2_replica1] webapp=/xr_ path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 246
[junit4:junit4]   2> 1398515 T4744 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica5 state=down
[junit4:junit4]   2> 1398494 T4774 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard1_replica5] Registered new searcher Searcher< at >851272 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1398620 T4728 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> ASYNC  NEW_CORE C1367 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore< at >139e28e url=http://127.0.0.1:54350/xr_/nodes_used_collection_shard2_replica2 node=127.0.0.1:54350_xr_ C1367_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica2, collection=nodes_used_collection, node_name=127.0.0.1:54350_xr_, base_url=http://127.0.0.1:54350/xr_}
[junit4:junit4]   2> 1398620 T4760 C1367 P54350 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 1398623 T4760 C1367 P54350 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 1398522 T4681 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> ASYNC  NEW_CORE C1368 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore< at >edad24 url=http://127.0.0.1:54341/xr_/nodes_used_collection_shard2_replica1 node=127.0.0.1:54341_xr_ C1368_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=active, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:54341_xr_, base_url=http://127.0.0.1:54341/xr_, leader=true}
[junit4:junit4]   2> 1398862 T4729 C1368 P54341 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 1398864 T4729 C1368 P54341 oasc.SolrCore.execute [nodes_used_collection_shard2_replica1] webapp=/xr_ path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> ASYNC  NEW_CORE C1369 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore< at >139e28e url=http://127.0.0.1:54350/xr_/nodes_used_collection_shard2_replica2 node=127.0.0.1:54350_xr_ C1369_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica2, collection=nodes_used_collection, node_name=127.0.0.1:54350_xr_, base_url=http://127.0.0.1:54350/xr_}
[junit4:junit4]   2> 1398867 T4760 C1369 P54350 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 1398867 T4760 C1369 P54350 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 1398867 T4760 C1369 P54350 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 1398871 T4725 C1368 P54341 oasc.SolrCore.execute [nodes_used_collection_shard2_replica1] webapp=/xr_ path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1 
[junit4:junit4]   2> 1398872 T4760 C1369 P54350 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 1398873 T4760 C1369 P54350 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\nodes_used_collection_shard2_replica2\data\index.20130525013604074
[junit4:junit4]   2> 1398873 T4760 C1369 P54350 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >10c4ef lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >14542) fullCopy=false
[junit4:junit4]   2> ASYNC  NEW_CORE C1370 name=nodes_used_collection_shard1_replica1 org.apache.solr.core.SolrCore< at >1b94c8c url=http://127.0.0.1:54323/xr_/nodes_used_collection_shard1_replica1 node=127.0.0.1:54323_xr_ C1370_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica1 props:{shard=shard1, state=active, core=nodes_used_collection_shard1_replica1, collection=nodes_used_collection, node_name=127.0.0.1:54323_xr_, base_url=http://127.0.0.1:54323/xr_, leader=true}
[junit4:junit4]   2> 1398879 T4701 C1370 P54323 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp=/xr_ path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=3 
[junit4:junit4]   2> 1398882 T4730 C1368 P54341 oasc.SolrCore.execute [nodes_used_collection_shard2_replica1] webapp=/xr_ path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=1 
[junit4:junit4]   2> 1398886 T4760 C1369 P54350 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 1398940 T4699 C1370 P54323 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 1398951 T4681 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1398957 T4681 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1399014 T4760 C1369 P54350 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 1399015 T4760 C1369 P54350 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=nodes_used_collection_shard2_replica2
[junit4:junit4]   2> 1399086 T4700 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1399093 T4700 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1399097 T4700 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1399112 T4760 C1369 P54350 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >cf653c lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >1e02ee4),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >cf653c lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >1e02ee4),segFN=segments_2,generation=2}
[junit4:junit4]   2> 1399116 T4760 C1369 P54350 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 1399116 T4760 C1369 P54350 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 1399117 T4760 C1369 P54350 oass.SolrIndexSearcher.<init> Opening Searcher< at >189247 main
[junit4:junit4]   2> 1399213 T4683 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1399225 T4683 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1399233 T4755 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica2] Registered new searcher Searcher< at >189247 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 1399234 T4760 C1369 P54350 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\nodes_used_collection_shard2_replica2\data\index.20130525013604074 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\nodes_used_collection_shard2_replica2\data\index.20130525013604074;done=true>>]
[junit4:junit4]   2> 1399234 T4760 C1369 P54350 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\nodes_used_collection_shard2_replica2\data\index.20130525013604074
[junit4:junit4]   2> 1399235 T4760 C1369 P54350 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\nodes_used_collection_shard2_replica2\data\index.20130525013604074
[junit4:junit4]   2> 1399235 T4760 C1369 P54350 oasc.RecoveryStrategy.replay No replay needed. core=nodes_used_collection_shard2_replica2
[junit4:junit4]   2> 1399236 T4760 C1369 P54350 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=nodes_used_collection_shard2_replica2
[junit4:junit4]   2> 1399236 T4760 C1369 P54350 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=active
[junit4:junit4]   2> 1399272 T4683 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1399351 T4698 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1399359 T4698 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1399363 T4698 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> ASYNC  NEW_CORE C1371 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore< at >139e28e url=http://127.0.0.1:54350/xr_/nodes_used_collection_shard2_replica2 node=127.0.0.1:54350_xr_ C1371_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica2, collection=nodes_used_collection, node_name=127.0.0.1:54350_xr_, base_url=http://127.0.0.1:54350/xr_}
[junit4:junit4]   2> 1399369 T4760 C1371 P54350 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=nodes_used_collection_shard2_replica2
[junit4:junit4]   2> 1399401 T4739 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1399408 T4739 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1399412 T4739 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1399499 T4713 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1399511 T4713 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1399517 T4713 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1399582 T4728 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1399606 T4728 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1399633 T4711 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1399640 T4711 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1399645 T4711 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> ASYNC  NEW_CORE C1372 name=nodes_used_collection_shard1_replica1 org.apache.solr.core.SolrCore< at >1b94c8c url=http://127.0.0.1:54323/xr_/nodes_used_collection_shard1_replica1 node=127.0.0.1:54323_xr_ C1372_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica1 props:{shard=shard1, state=active, core=nodes_used_collection_shard1_replica1, collection=nodes_used_collection, node_name=127.0.0.1:54323_xr_, base_url=http://127.0.0.1:54323/xr_, leader=true}
[junit4:junit4]   2> 1399656 T4699 C1372 P54323 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >1cc2ed8 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >167822d),segFN=segments_1,generation=1}
[junit4:junit4]   2> 1399659 T4699 C1372 P54323 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 1399660 T4699 C1372 P54323 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >1cc2ed8 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >167822d),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >1cc2ed8 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >167822d),segFN=segments_2,generation=2}
[junit4:junit4]   2> 1399660 T4699 C1372 P54323 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 1399661 T4699 C1372 P54323 oass.SolrIndexSearcher.<init> Opening Searcher< at >18711fc realtime
[junit4:junit4]   2> 1399661 T4699 C1372 P54323 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 1399662 T4699 C1372 P54323 oasup.LogUpdateProcessor.finish [nodes_used_collection_shard1_replica1] webapp=/xr_ path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 723
[junit4:junit4]   2> ASYNC  NEW_CORE C1373 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore< at >44e2c4 url=http://127.0.0.1:54311/xr_/nodes_used_collection_shard1_replica2 node=127.0.0.1:54311_xr_ C1373_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=recovering, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:54311_xr_, base_url=http://127.0.0.1:54311/xr_}
[junit4:junit4]   2> 1399664 T4761 C1373 P54311 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 1399664 T4761 C1373 P54311 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 1399672 T4728 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1399679 T4702 C1372 P54323 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 1399680 T4702 C1372 P54323 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp=/xr_ path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 1399680 T4761 C1373 P54311 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 1399680 T4761 C1373 P54311 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 1399680 T4761 C1373 P54311 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 1399684 T4697 C1372 P54323 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp=/xr_ path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=2 
[junit4:junit4]   2> 1399684 T4761 C1373 P54311 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 1399685 T4761 C1373 P54311 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\nodes_used_collection_shard1_replica2\data\index.20130525013604886
[junit4:junit4]   2> 1399694 T4761 C1373 P54311 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >b32dd1 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >43b226) fullCopy=false
[junit4:junit4]   2> 1399696 T4728 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1399697 T4728 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1399697 T4728 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1399698 T4699 C1372 P54323 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp=/xr_ path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
[junit4:junit4]   2> 1399707 T4728 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1399707 T4683 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1399708 T4728 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1399708 T4728 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1399709 T4689 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1399710 T4728 oasc.SolrCore.<init> [awholynewcollection_0_shard2_replica4] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\awholynewcollection_0_shard2_replica4\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\awholynewcollection_0_shard2_replica4\data\
[junit4:junit4]   2> 1399710 T4728 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >258ed1
[junit4:junit4]   2> 1399711 T4728 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1399712 T4728 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\awholynewcollection_0_shard2_replica4\data\
[junit4:junit4]   2> 1399713 T4698 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1399716 T4689 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":null,
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"awholynewcollection_0_shard1_replica5",
[junit4:junit4]   2>   "collection":"awholynewcollection_0",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:54350_xr_",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:54350/xr_"}
[junit4:junit4]   2> 1399716 T4689 oasc.Overseer$ClusterStateUpdater.createCollection Create collection awholynewcollection_0 with numShards 2
[junit4:junit4]   2> 1399717 T4739 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1399721 T4683 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1399722 T4700 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1399716 T4728 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\awholynewcollection_0_shard2_replica4\data\index/
[junit4:junit4]   2> 1399721 T4698 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1399724 T4728 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard2_replica4] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\awholynewcollection_0_shard2_replica4\data\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1399725 T4728 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\awholynewcollection_0_shard2_replica4\data\index
[junit4:junit4]   2> 1399730 T4761 C1373 P54311 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 1399732 T4761 C1373 P54311 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 1399738 T4681 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1399739 T4761 C1373 P54311 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=nodes_used_collection_shard1_replica2
[junit4:junit4]   2> 1399747 T4700 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1399753 T4698 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1399776 T4728 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >1a574df lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >299e2b),segFN=segments_1,generation=1}
[junit4:junit4]   2> 1399776 T4728 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 1399779 T4728 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1399780 T4728 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1399781 T4728 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1399781 T4728 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1399782 T4728 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1399782 T4728 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1399782 T4728 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1399784 T4728 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1399785 T4728 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1399792 T4689 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"127.0.0.1:54350_xr__nodes_used_collection_shard2_replica2",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":"shard2",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"active",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"nodes_used_collection_shard2_replica2",
[junit4:junit4]   2>   "collection":"nodes_used_collection",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:54350_xr_",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:54350/xr_"}
[junit4:junit4]   2> 1399793 T4698 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1399793 T4698 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1399794 T4698 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1399806 T4698 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1399807 T4698 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1399807 T4698 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1399808 T4698 oasc.SolrCore.<init> [awholynewcollection_0_shard2_replica3] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\awholynewcollection_0_shard2_replica3\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\awholynewcollection_0_shard2_replica3\data\
[junit4:junit4]   2> 1399808 T4698 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >258ed1
[junit4:junit4]   2> 1399809 T4698 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1399810 T4698 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\awholynewcollection_0_shard2_replica3\data\
[junit4:junit4]   2> 1399817 T4681 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1399817 T4728 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1399819 T4683 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1399820 T4711 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1399821 T4713 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1399823 T4739 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1399824 T4700 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1399831 T4720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1399831 T4706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1399832 T4734 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1399832 T4688 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1399832 T4748 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1399833 T4681 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1399836 T4698 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\awholynewcollection_0_shard2_replica3\data\index/
[junit4:junit4]   2> 1399837 T4698 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard2_replica3] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\awholynewcollection_0_shard2_replica3\data\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1399837 T4698 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\awholynewcollection_0_shard2_replica3\data\index
[junit4:junit4]   2> 1399840 T4713 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1399841 T4683 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1399841 T4683 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1399841 T4683 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1399843 T4693 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1399843 T4763 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1399844 T4765 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1399836 T4711 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1399849 T4681 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1399849 T4681 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1399849 T4681 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1399851 T4700 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1399851 T4700 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1399852 T4700 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1399855 T4728 oass.SolrIndexSearcher.<init> Opening Searcher< at >22e61d main
[junit4:junit4]   2> 1399855 T4683 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1399856 T4683 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1399856 T4683 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1399856 T4683 oasc.SolrCore.<init> [awholynewcollection_0_shard2_replica1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\awholynewcollection_0_shard2_replica1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\awholynewcollection_0_shard2_replica1\data\
[junit4:junit4]   2> 1399856 T4683 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >258ed1
[junit4:junit4]   2> 1399857 T4683 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1399857 T4683 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\awholynewcollection_0_shard2_replica1\data\
[junit4:junit4]   2> 1399859 T4739 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1399864 T4711 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1399865 T4700 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1399865 T4700 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1399866 T4681 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1399866 T4681 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1399867 T4681 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1399867 T4739 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1399868 T4739 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1399868 T4739 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1399855 T4713 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1399868 T4711 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1399870 T4711 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1399870 T4711 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1399867 T4681 oasc.SolrCore.<init> [awholynewcollection_0_shard1_replica1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\awholynewcollection_0_shard1_replica1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\awholynewcollection_0_shard1_replica1\data\
[junit4:junit4]   2> 1399871 T4681 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >258ed1
[junit4:junit4]   2> 1399866 T4700 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1399872 T4700 oasc.SolrCore.<init> [awholynewcollection_0_shard1_replica3] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\awholynewcollection_0_shard1_replica3\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\awholynewcollection_0_shard1_replica3\data\
[junit4:junit4]   2> 1399873 T4700 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >258ed1
[junit4:junit4]   2> 1399873 T4700 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1399873 T4683 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\awholynewcollection_0_shard2_replica1\data\index/
[junit4:junit4]   2> 1399873 T4683 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard2_replica1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\awholynewcollection_0_shard2_replica1\data\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1399875 T4683 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\awholynewcollection_0_shard2_replica1\data\index
[junit4:junit4]   2> 1399855 T4698 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >73fe66 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >120636a),segFN=segments_1,generation=1}
[junit4:junit4]   2> 1399877 T4698 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 1399855 T4728 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369406150970\awholynewcollection_0_shard2_replica4\data\tlog
[junit4:junit4]   2> 1399876 T4711 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1399878 T4711 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1399879 T4711 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1399879 T4711 oasc.SolrCore.<init> [awholynewcollection_0_shard1_replica2] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369406149014\awholynewcollection_0_shard1_replica2\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369406149014\awholynewcollection_0_shard1_replica2\data\
[junit4:junit4]   2> 1399879 T4711 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >258ed1
[junit4:junit4]   2> 1399880 T4711 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1399880 T4711 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369406149014\awholynewcollection_0_shard1_replica2\data\
[junit4:junit4]   2> 1399876 T4713 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1399881 T4713 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1399883 T4713 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1399875 T4739 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1399873 T4700 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369406147137\awholynewcollection_0_shard1_replica3\data\
[junit4:junit4]   2> 1399872 T4681 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1399884 T4681 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369406146196\awholynewcollection_0_shard1_replica1\data\
[junit4:junit4]   2> 1399883 T4739 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1399879 T4728 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1399885 T4739 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1399885 T4728 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1399886 T4713 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1399886 T4713 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1399896 T4713 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1399898 T4713 oasc.SolrCore.<init> [awholynewcollection_0_shard2_replica2] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369406149014\awholynewcollection_0_shard2_replica2\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369406149014\awholynewcollection_0_shard2_replica2\data\
[junit4:junit4]   2> 1399898 T4713 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >258ed1
[junit4:junit4]   2> 1399899 T4713 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1399899 T4713 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369406149014\awholynewcollection_0_shard2_replica2\data\
[junit4:junit4]   2> 1399886 T4739 oasc.SolrCore.<init> [awholynewcollection_0_shard2_replica5] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\awholynewcollection_0_shard2_replica5\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\awholynewcollection_0_shard2_replica5\data\
[junit4:junit4]   2> 1399900 T4739 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >258ed1
[junit4:junit4]   2> 1399901 T4739 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1399901 T4739 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369406152807\awholynewcollection_0_shard2_replica5\data\
[junit4:junit4]   2> 1399896 T4777 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard2_replica4] Registered new searcher Searcher< at >22e61d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1399903 T4713 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369406149014\awholynewcollection_0_shard2_replica2\data\index/
[junit4:junit4]   2> 1399903 T4713 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard2_replica2] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369406149014\awholynewcollection_0_shard2_replica2\data\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1399894 T4728 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica4 state=down
[junit4:junit4]   2> 1399904 T4683 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >92221 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >1fbf01f),segFN=segments_1,generation=1}
[junit4:junit4]   2> 1399893 T4698 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1399905 T4698 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1399905 T4698 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1399907 T4698 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1399907 T4698 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1399907 T4698 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1399908 T4698 oasc.RequestHandlers.ini

[...truncated too long message...]

collections/awholynewcollection_1/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"awholynewcollection_1_shard1_replica1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:54311_xr_",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:54311/xr_"}
[junit4:junit4]   1>      /solr/collections/awholynewcollection_1/leaders/shard4 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"awholynewcollection_1_shard4_replica2",
[junit4:junit4]   1>            "node_name":"127.0.0.1:54311_xr_",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:54311/xr_"}
[junit4:junit4]   1>      /solr/collections/awholynewcollection_1/leaders/shard5 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"awholynewcollection_1_shard5_replica3",
[junit4:junit4]   1>            "node_name":"127.0.0.1:54332_xr_",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:54332/xr_"}
[junit4:junit4]   1>      /solr/collections/awholynewcollection_1/leaders/shard2 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"awholynewcollection_1_shard2_replica1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:54323_xr_",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:54323/xr_"}
[junit4:junit4]   1>      /solr/collections/awholynewcollection_1/leaders/shard3 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"awholynewcollection_1_shard3_replica2",
[junit4:junit4]   1>            "node_name":"127.0.0.1:54341_xr_",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:54341/xr_"}
[junit4:junit4]   1>   /solr/overseer_elect (2)
[junit4:junit4]   1>    /solr/overseer_elect/election (5)
[junit4:junit4]   1>     /solr/overseer_elect/election/89745401185239043-127.0.0.1:54311_xr_-n_0000000000 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89745401185239052-127.0.0.1:54350_xr_-n_0000000004 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89745401185239048-127.0.0.1:54332_xr_-n_0000000002 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89745401185239050-127.0.0.1:54341_xr_-n_0000000003 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89745401185239046-127.0.0.1:54323_xr_-n_0000000001 (0)
[junit4:junit4]   1>    /solr/overseer_elect/leader (0)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"id":"89745401185239043-127.0.0.1:54311_xr_-n_0000000000"}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=A980456175399E58 -Dtests.slow=true -Dtests.locale=ms -Dtests.timezone=Pacific/Noumea -Dtests.file.encoding=Cp1252
[junit4:junit4] FAILURE  297s | CollectionsAPIDistributedZkTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 230 seconds
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([A980456175399E58:2866CB790266FE64]:0)
[junit4:junit4]    > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:173)
[junit4:junit4]    > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:131)
[junit4:junit4]    > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:126)
[junit4:junit4]    > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:512)
[junit4:junit4]    > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:146)
[junit4:junit4]    > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4]    > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 1677566 T4666 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene42: {timestamp=PostingsFormat(name=NestedPulsing), range_facet_l=PostingsFormat(name=NestedPulsing), id=PostingsFormat(name=Direct), range_facet_sl=PostingsFormat(name=Direct), a_t=PostingsFormat(name=NestedPulsing), text=PostingsFormat(name=Memory doPackFST= true), range_facet_si=PostingsFormat(name=NestedPulsing), _version_=Pulsing41(freqCutoff=4 minBlockSize=52 maxBlockSize=106), other_tl1=Pulsing41(freqCutoff=4 minBlockSize=52 maxBlockSize=106), multiDefault=PostingsFormat(name=NestedPulsing), a_si=Pulsing41(freqCutoff=4 minBlockSize=52 maxBlockSize=106), intDefault=Pulsing41(freqCutoff=4 minBlockSize=52 maxBlockSize=106)}, docValues:{timestamp=DocValuesFormat(name=CheapBastard)}, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=ms, timezone=Pacific/Noumea
[junit4:junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_21 (32-bit)/cpus=2,threads=1,free=98350736,total=334954496
[junit4:junit4]   2> NOTE: All tests run in this JVM: [FastVectorHighlighterTest, TestBinaryResponseWriter, TestSolrIndexConfig, RecoveryZkTest, ShardSplitTest, SuggesterTSTTest, AliasIntegrationTest, UniqFieldsUpdateProcessorFactoryTest, XmlUpdateRequestHandlerTest, TestAtomicUpdateErrorCases, TestElisionMultitermQuery, OpenCloseCoreStressTest, MultiTermTest, StandardRequestHandlerTest, ResponseLogComponentTest, TestCoreContainer, TestCollationField, IndexSchemaRuntimeFieldTest, NotRequiredUniqueKeyTest, DefaultValueUpdateProcessorTest, TestFieldCollectionResource, ZkSolrClientTest, HighlighterTest, CurrencyFieldXmlFileTest, AnalysisAfterCoreReloadTest, QueryElevationComponentTest, TestJmxMonitoredMap, TestZkChroot, TestSearchPerf, DirectUpdateHandlerOptimizeTest, TestIndexSearcher, JsonLoaderTest, TestFieldResource, MinimalSchemaTest, TestReplicationHandler, HardAutoCommitTest, TestPropInjectDefaults, TestIndexingPerformance, SpellingQueryConverterTest, PrimitiveFieldTypeTest, ChaosMonkeySafeLeaderTest, TestUpdate, DistanceFunctionTest, TestNumberUtils, TestSchemaSimilarityResource, TestSystemIdResolver, IndexBasedSpellCheckerTest, SynonymTokenizerTest, BadCopyFieldTest, TermVectorComponentTest, DistributedTermsComponentTest, TestClassNameShortening, DOMUtilTest, DocValuesMultiTest, TestManagedSchema, TestQueryUtils, SimpleFacetsTest, DirectSolrConnectionTest, TestRealTimeGet, TestSurroundQueryParser, TestFunctionQuery, TestJmxIntegration, CoreContainerCoreInitFailuresTest, SampleTest, OutputWriterTest, TestAddFieldRealTimeGet, LeaderElectionTest, SuggesterFSTTest, BasicDistributedZk2Test, TestQueryTypes, PolyFieldTest, UUIDFieldTest, SolrRequestParserTest, TermsComponentTest, OverseerTest, DebugComponentTest, DisMaxRequestHandlerTest, DateMathParserTest, AutoCommitTest, UpdateRequestProcessorFactoryTest, TestFieldTypeResource, DocumentBuilderTest, TestLMJelinekMercerSimilarityFactory, TestDFRSimilarityFactory, CopyFieldTest, RegexBoostProcessorTest, PrimUtilsTest, URLClassifyProcessorTest, QueryParsingTest, DistributedQueryElevationComponentTest, ReturnFieldsTest, TestMaxScoreQueryParser, TestFastWriter, UnloadDistributedZkTest, PeerSyncTest, TestMergePolicyConfig, SolrInfoMBeanTest, IndexSchemaTest, TestAnalyzedSuggestions, SimplePostToolTest, LegacyHTMLStripCharFilterTest, TestFuzzyAnalyzedSuggestions, CachingDirectoryFactoryTest, DocValuesTest, PathHierarchyTokenizerFactoryTest, TestSolrQueryParserResource, TestJoin, TestShardHandlerFactory, TestCloudManagedSchema, TestRTGBase, SolrCoreTest, TestLMDirichletSimilarityFactory, TestIBSimilarityFactory, TestSolrDeletionPolicy2, TestRecovery, TestDynamicFieldResource, SolrTestCaseJ4Test, TestStressReorder, TestStressLucene, SoftAutoCommitTest, SolrCmdDistributorTest, TestPhraseSuggestions, TestSchemaVersionResource, TestValueSourceCache, TestGroupingSearch, TestCSVResponseWriter, TestSweetSpotSimilarityFactory, TestBadConfig, CoreAdminHandlerTest, QueryEqualityTest, TestXIncludeConfig, TestLRUCache, FullSolrCloudDistribCmdsTest, ExternalFileFieldSortTest, ChaosMonkeyShardSplitTest, OpenExchangeRatesOrgProviderTest, QueryResultKeyTest, TestBinaryField, FieldMutatingUpdateProcessorTest, TestPseudoReturnFields, SolrIndexSplitterTest, TestSolrJ, TestDefaultSimilarityFactory, BasicDistributedZkTest, CollectionsAPIDistributedZkTest]
[junit4:junit4] Completed in 296.80s, 1 test, 1 failure <<< FAILURES!

[...truncated 456 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:380: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:360: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:181: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:437: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1240: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:884: There were test failures: 295 suites, 1231 tests, 1 failure, 18 ignored (12 assumptions)

Total time: 65 minutes 36 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_21 -server -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe< at >lucene.apache.org
For additional commands, e-mail: dev-help< at >lucene.apache.org

[jira] [Commented] (LUCENE-5013) ScandinavianInterintelligableASCIIFoldingFilter

Steve Rowe (JIRA — 2013-05-24T14:36:48

    [ https://issues.apache.org/jira/browse/LUCENE-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13666363#comment-13666363 ] 

Steve Rowe commented on LUCENE-5013:
------------------------------------

bq. I need help with the TestFilterFactories, they throw SPI exceptions stating the factories are not available in the classpath via lookup. I shouldn't have to register them somewhere, right?

The following lines need to be added to {{src/resources/META-INF/services/org.apache.lucene.analysis.util.TokenFilterFactory}} - all tests pass for me when I do this:

{noformat}
org.apache.lucene.analysis.miscellaneous.ScandinavianFoldingFilterFactory
org.apache.lucene.analysis.miscellaneous.ScandinavianNormalizationFilterFactory
{noformat}

                

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (SOLR-1913) QParserPlugin plugin for Search Results Filtering Based on Bitwise Operations on Integer Fields

Deepthi Sigireddi (JIRA — 2013-05-24T14:34:22

    [ https://issues.apache.org/jira/browse/SOLR-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13666359#comment-13666359 ] 

Deepthi Sigireddi commented on SOLR-1913:
-----------------------------------------

Christopher,
Glad to hear that it worked for you. Please vote for this issue to increase its chances of getting into 4.4.
                

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.7.0_21) - Build # 5747 - Still Failing!

Policeman Jenkins Server — 2013-05-24T14:26:17

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/5747/
Java: 64bit/jdk1.7.0_21 -XX:-UseCompressedOops -XX:+UseSerialGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 230 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 230 seconds
at __randomizedtesting.SeedInfo.seed([5662BDE050A999FE:D78433F827F6F9C2]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:173)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:131)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:126)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:512)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:146)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 9609 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4:junit4]   2> 438274 T1559 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /m_/bp
[junit4:junit4]   2> 438279 T1559 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-CollectionsAPIDistributedZkTest-1369404682802
[junit4:junit4]   2> 438279 T1559 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 438280 T1560 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 438380 T1559 oasc.ZkTestServer.run start zk server on port:34638
[junit4:junit4]   2> 438381 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 438562 T1566 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >34d6488c name:ZooKeeperConnection Watcher:127.0.0.1:34638 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 438562 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 438563 T1559 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 438567 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 438569 T1568 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >53bdd8b5 name:ZooKeeperConnection Watcher:127.0.0.1:34638/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 438569 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 438569 T1559 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 438571 T1559 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 438573 T1559 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 438575 T1559 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 438577 T1559 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 438578 T1559 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 438581 T1559 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 438581 T1559 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 438584 T1559 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 438584 T1559 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 438586 T1559 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 438587 T1559 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 438589 T1559 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 438589 T1559 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 438591 T1559 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 438591 T1559 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 438594 T1559 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 438594 T1559 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 438596 T1559 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 438597 T1559 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 438599 T1559 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 438599 T1559 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 438663 T1559 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 438666 T1559 oejs.AbstractConnector.doStart Started SelectChannelConnector< at >127.0.0.1:35380
[junit4:junit4]   2> 438666 T1559 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 438667 T1559 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 438667 T1559 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125
[junit4:junit4]   2> 438667 T1559 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/solr.xml
[junit4:junit4]   2> 438668 T1559 oasc.CoreContainer.<init> New CoreContainer 969729492
[junit4:junit4]   2> 438668 T1559 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/'
[junit4:junit4]   2> 438668 T1559 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/'
[junit4:junit4]   2> 438703 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125
[junit4:junit4]   2> 438704 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/collection1
[junit4:junit4]   2> 438705 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/collection1/conf
[junit4:junit4]   2> 438709 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/collection1/conf/xslt
[junit4:junit4]   2> 438724 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/collection1/lib
[junit4:junit4]   2> 438724 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/collection1/lib/classes
[junit4:junit4]   2> 438726 T1559 oasc.SolrCoreDiscoverer.addCore Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/conf/core.properties, adding to cores
[junit4:junit4]   2> 438727 T1559 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 438728 T1559 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 438728 T1559 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 438728 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 438729 T1559 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 438729 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 438729 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 438729 T1559 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 438730 T1559 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 438730 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 438742 T1559 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 438743 T1559 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:34638/solr
[junit4:junit4]   2> 438743 T1559 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 438744 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 438745 T1579 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >6787552b name:ZooKeeperConnection Watcher:127.0.0.1:34638 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 438746 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 438747 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 438751 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 438752 T1581 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >2a92ebe3 name:ZooKeeperConnection Watcher:127.0.0.1:34638/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 438752 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 438754 T1559 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4]   2> 438757 T1559 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4]   2> 438760 T1559 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 438762 T1559 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35380_m_%2Fbp
[junit4:junit4]   2> 438764 T1559 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35380_m_%2Fbp
[junit4:junit4]   2> 438768 T1559 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 438775 T1559 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 438778 T1559 oasc.Overseer.start Overseer (id=89745305292308483-127.0.0.1:35380_m_%2Fbp-n_0000000000) starting
[junit4:junit4]   2> 438782 T1559 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4]   2> 438786 T1583 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 438787 T1559 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 438790 T1559 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 438793 T1559 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 438796 T1582 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 438798 T1559 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 438798 T1559 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 438799 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 438803 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 438804 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 438806 T1586 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >64e6aeb3 name:ZooKeeperConnection Watcher:127.0.0.1:34638/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 438806 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 438807 T1559 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 438810 T1559 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 438890 T1559 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 438892 T1559 oejs.AbstractConnector.doStart Started SelectChannelConnector< at >127.0.0.1:46286
[junit4:junit4]   2> 438892 T1559 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 438893 T1559 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 438893 T1559 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333
[junit4:junit4]   2> 438893 T1559 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/solr.xml
[junit4:junit4]   2> 438893 T1559 oasc.CoreContainer.<init> New CoreContainer 1131596076
[junit4:junit4]   2> 438894 T1559 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/'
[junit4:junit4]   2> 438894 T1559 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/'
[junit4:junit4]   2> 438930 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333
[junit4:junit4]   2> 438931 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/collection1
[junit4:junit4]   2> 438931 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/collection1/conf
[junit4:junit4]   2> 438939 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/collection1/conf/xslt
[junit4:junit4]   2> 438965 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/collection1/lib
[junit4:junit4]   2> 438966 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/collection1/lib/classes
[junit4:junit4]   2> 438967 T1559 oasc.SolrCoreDiscoverer.addCore Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/conf/core.properties, adding to cores
[junit4:junit4]   2> 438970 T1559 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 438970 T1559 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 438971 T1559 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 438971 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 438972 T1559 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 438972 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 438973 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 438973 T1559 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 438973 T1559 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 438974 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 438979 T1559 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 438979 T1559 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:34638/solr
[junit4:junit4]   2> 438980 T1559 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 438981 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 438982 T1597 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >335a77aa name:ZooKeeperConnection Watcher:127.0.0.1:34638 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 438983 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 438984 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 438989 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 438992 T1599 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >484cd89d name:ZooKeeperConnection Watcher:127.0.0.1:34638/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 438992 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 438997 T1559 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 440000 T1559 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46286_m_%2Fbp
[junit4:junit4]   2> 440001 T1559 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46286_m_%2Fbp
[junit4:junit4]   2> 440004 T1586 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 440004 T1581 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 440005 T1599 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 440009 T1559 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 440010 T1559 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 440010 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 440076 T1559 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 440078 T1559 oejs.AbstractConnector.doStart Started SelectChannelConnector< at >127.0.0.1:44045
[junit4:junit4]   2> 440079 T1559 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 440079 T1559 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 440079 T1559 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537
[junit4:junit4]   2> 440080 T1559 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/solr.xml
[junit4:junit4]   2> 440080 T1559 oasc.CoreContainer.<init> New CoreContainer 944742903
[junit4:junit4]   2> 440080 T1559 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/'
[junit4:junit4]   2> 440081 T1559 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/'
[junit4:junit4]   2> 440124 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537
[junit4:junit4]   2> 440125 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/collection1
[junit4:junit4]   2> 440125 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/collection1/conf
[junit4:junit4]   2> 440129 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/collection1/conf/xslt
[junit4:junit4]   2> 440144 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/collection1/lib
[junit4:junit4]   2> 440145 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/collection1/lib/classes
[junit4:junit4]   2> 440146 T1559 oasc.SolrCoreDiscoverer.addCore Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/conf/core.properties, adding to cores
[junit4:junit4]   2> 440148 T1559 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 440148 T1559 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 440148 T1559 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 440149 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 440149 T1559 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 440149 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 440149 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 440150 T1559 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 440150 T1559 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 440150 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 440154 T1559 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 440154 T1559 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:34638/solr
[junit4:junit4]   2> 440154 T1559 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 440155 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 440156 T1611 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >47e0f2dc name:ZooKeeperConnection Watcher:127.0.0.1:34638 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 440157 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 440159 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 440162 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 440163 T1613 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >77cf9b72 name:ZooKeeperConnection Watcher:127.0.0.1:34638/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 440164 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 440167 T1559 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 441170 T1559 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44045_m_%2Fbp
[junit4:junit4]   2> 441171 T1559 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44045_m_%2Fbp
[junit4:junit4]   2> 441174 T1581 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 441174 T1586 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 441174 T1599 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 441175 T1613 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 441179 T1559 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 441179 T1559 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 441179 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 441243 T1559 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 441247 T1559 oejs.AbstractConnector.doStart Started SelectChannelConnector< at >127.0.0.1:52357
[junit4:junit4]   2> 441248 T1559 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 441248 T1559 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 441248 T1559 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705
[junit4:junit4]   2> 441248 T1559 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/solr.xml
[junit4:junit4]   2> 441249 T1559 oasc.CoreContainer.<init> New CoreContainer 524146838
[junit4:junit4]   2> 441249 T1559 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/'
[junit4:junit4]   2> 441249 T1559 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/'
[junit4:junit4]   2> 441291 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705
[junit4:junit4]   2> 441292 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/collection1
[junit4:junit4]   2> 441293 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/collection1/conf
[junit4:junit4]   2> 441297 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/collection1/conf/xslt
[junit4:junit4]   2> 441312 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/collection1/lib
[junit4:junit4]   2> 441312 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/collection1/lib/classes
[junit4:junit4]   2> 441314 T1559 oasc.SolrCoreDiscoverer.addCore Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/conf/core.properties, adding to cores
[junit4:junit4]   2> 441315 T1559 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 441315 T1559 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 441316 T1559 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 441316 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 441316 T1559 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 441317 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 441317 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 441317 T1559 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 441317 T1559 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 441318 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 441321 T1559 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 441321 T1559 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:34638/solr
[junit4:junit4]   2> 441322 T1559 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 441322 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 441324 T1625 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >a4942c4 name:ZooKeeperConnection Watcher:127.0.0.1:34638 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 441324 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 441326 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 441330 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 441331 T1627 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >7acc653 name:ZooKeeperConnection Watcher:127.0.0.1:34638/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 441331 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 441335 T1559 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 442337 T1559 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52357_m_%2Fbp
[junit4:junit4]   2> 442339 T1559 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52357_m_%2Fbp
[junit4:junit4]   2> 442342 T1581 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 442342 T1586 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 442342 T1613 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 442342 T1627 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 442342 T1599 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 442346 T1559 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 442346 T1559 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 442347 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 442410 T1559 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 442412 T1559 oejs.AbstractConnector.doStart Started SelectChannelConnector< at >127.0.0.1:56616
[junit4:junit4]   2> 442413 T1559 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 442413 T1559 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 442413 T1559 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873
[junit4:junit4]   2> 442414 T1559 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/solr.xml
[junit4:junit4]   2> 442414 T1559 oasc.CoreContainer.<init> New CoreContainer 1323448226
[junit4:junit4]   2> 442414 T1559 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/'
[junit4:junit4]   2> 442415 T1559 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/'
[junit4:junit4]   2> 442448 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873
[junit4:junit4]   2> 442449 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/collection1
[junit4:junit4]   2> 442449 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/collection1/conf
[junit4:junit4]   2> 442453 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/collection1/conf/xslt
[junit4:junit4]   2> 442468 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/collection1/lib
[junit4:junit4]   2> 442469 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/collection1/lib/classes
[junit4:junit4]   2> 442470 T1559 oasc.SolrCoreDiscoverer.addCore Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/conf/core.properties, adding to cores
[junit4:junit4]   2> 442471 T1559 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 442472 T1559 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 442472 T1559 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 442472 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 442473 T1559 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 442473 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 442473 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 442473 T1559 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 442474 T1559 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 442474 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 442477 T1559 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 442478 T1559 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:34638/solr
[junit4:junit4]   2> 442478 T1559 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 442479 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 442480 T1639 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >2d357bfa name:ZooKeeperConnection Watcher:127.0.0.1:34638 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 442480 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 442482 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 442486 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 442487 T1641 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >1f78cde1 name:ZooKeeperConnection Watcher:127.0.0.1:34638/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 442487 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 442491 T1559 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 443493 T1559 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56616_m_%2Fbp
[junit4:junit4]   2> 443494 T1559 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56616_m_%2Fbp
[junit4:junit4]   2> 443497 T1581 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 443497 T1599 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 443497 T1613 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 443497 T1586 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 443498 T1641 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 443498 T1627 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 443502 T1559 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 443503 T1559 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 443503 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 443507 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 443512 T1594 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2
[junit4:junit4]   2> 443514 T1581 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4]   2> 443515 T1583 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4:junit4]   2>   "operation":"createcollection",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "maxShardsPerNode":null,
[junit4:junit4]   2>   "createNodeSet":null,
[junit4:junit4]   2>   "name":"nodes_used_collection",
[junit4:junit4]   2>   "replicationFactor":"2"}
[junit4:junit4]   2> 443515 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica1 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:52357_m_%2Fbp
[junit4:junit4]   2> 443516 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica2 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:56616_m_%2Fbp
[junit4:junit4]   2> 443516 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica1 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:46286_m_%2Fbp
[junit4:junit4]   2> 443520 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica2 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:44045_m_%2Fbp
[junit4:junit4]   2> 443521 T1621 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/nodes_used_collection_shard1_replica1
[junit4:junit4]   2> 443521 T1621 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4]   2> 443521 T1636 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2
[junit4:junit4]   2> 443522 T1636 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4]   2> 443522 T1621 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4]   2> 443522 T1593 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1
[junit4:junit4]   2> 443523 T1636 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4]   2> 443523 T1609 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/nodes_used_collection_shard2_replica2
[junit4:junit4]   2> 443523 T1609 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4]   2> 443523 T1593 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4]   2> 443523 T1621 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 443524 T1609 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4]   2> 443525 T1593 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4]   2> 443525 T1593 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 443525 T1621 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 443523 T1636 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 443525 T1621 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4]   2> 443526 T1593 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 443525 T1609 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 443526 T1593 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4]   2> 443526 T1636 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 443527 T1636 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4]   2> 443528 T1609 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 443528 T1609 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4]   2> 443528 T1621 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4]   2> 443539 T1593 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4]   2> 443539 T1636 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4]   2> 443539 T1609 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4]   2> 443540 T1621 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/nodes_used_collection_shard1_replica1/'
[junit4:junit4]   2> 443541 T1593 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/'
[junit4:junit4]   2> 443541 T1609 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/nodes_used_collection_shard2_replica2/'
[junit4:junit4]   2> 443541 T1636 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/'
[junit4:junit4]   2> 443578 T1621 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 443589 T1636 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 443593 T1593 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 443594 T1609 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 443638 T1609 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 443639 T1609 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 443643 T1609 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica2] Schema name=test
[junit4:junit4]   2> 443652 T1621 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 443654 T1621 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 443657 T1636 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 443658 T1593 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 443659 T1621 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica1] Schema name=test
[junit4:junit4]   2> 443659 T1593 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 443659 T1636 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 443662 T1593 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica1] Schema name=test
[junit4:junit4]   2> 443664 T1636 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica2] Schema name=test
[junit4:junit4]   2> 444067 T1609 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 444073 T1609 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 444075 T1609 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 444086 T1609 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 444089 T1609 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 444098 T1609 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 444099 T1609 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 444099 T1609 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 444100 T1609 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 444101 T1609 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 444101 T1609 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 444101 T1609 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 444102 T1609 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/nodes_used_collection_shard2_replica2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/nodes_used_collection_shard2_replica2/data/
[junit4:junit4]   2> 444102 T1609 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >4b4fb675
[junit4:junit4]   2> 444102 T1609 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 444103 T1609 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/nodes_used_collection_shard2_replica2/data
[junit4:junit4]   2> 444103 T1609 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/nodes_used_collection_shard2_replica2/data/index/
[junit4:junit4]   2> 444104 T1609 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/nodes_used_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 444104 T1609 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/nodes_used_collection_shard2_replica2/data/index
[junit4:junit4]   2> 444106 T1609 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >9754d51 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >6d8220),segFN=segments_1,generation=1}
[junit4:junit4]   2> 444106 T1609 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 444108 T1609 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 444109 T1609 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 444109 T1609 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 444110 T1609 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 444110 T1609 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 444110 T1609 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 444111 T1609 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 444111 T1609 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 444112 T1609 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 444114 T1609 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 444116 T1609 oass.SolrIndexSearcher.<init> Opening Searcher< at >79194ff5 main
[junit4:junit4]   2> 444116 T1609 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/nodes_used_collection_shard2_replica2/data/tlog
[junit4:junit4]   2> 444117 T1609 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 444117 T1609 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 444121 T1647 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica2] Registered new searcher Searcher< at >79194ff5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 444122 T1609 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=down
[junit4:junit4]   2> 444184 T1593 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 444189 T1593 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 444191 T1593 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 444209 T1593 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 444213 T1593 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 444217 T1593 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 444217 T1621 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 444218 T1593 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 444219 T1593 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 444219 T1593 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 444220 T1593 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 444221 T1593 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 444221 T1593 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 444221 T1593 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/data/
[junit4:junit4]   2> 444222 T1593 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >4b4fb675
[junit4:junit4]   2> 444223 T1593 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 444223 T1621 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 444223 T1593 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/data
[junit4:junit4]   2> 444223 T1593 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/data/index/
[junit4:junit4]   2> 444224 T1593 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 444224 T1593 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/data/index
[junit4:junit4]   2> 444225 T1621 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 444226 T1593 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >74fe9f46 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >3248e3cf),segFN=segments_1,generation=1}
[junit4:junit4]   2> 444227 T1593 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 444229 T1593 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 444229 T1593 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 444230 T1593 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 444230 T1593 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 444231 T1593 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 444231 T1593 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 444232 T1593 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 444232 T1593 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 444232 T1593 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 444236 T1593 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 444236 T1636 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 444236 T1621 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 444238 T1593 oass.SolrIndexSearcher.<init> Opening Searcher< at >18d5c8cf main
[junit4:junit4]   2> 444238 T1593 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/data/tlog
[junit4:junit4]   2> 444239 T1593 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 444239 T1593 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 444241 T1621 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 444242 T1648 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica1] Registered new searcher Searcher< at >18d5c8cf main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 444243 T1593 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=down
[junit4:junit4]   2> 444243 T1636 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 444244 T1621 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 444245 T1621 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 444245 T1621 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 444245 T1636 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 444245 T1621 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 444247 T1621 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 444247 T1621 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 444247 T1621 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 444247 T1621 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/nodes_used_collection_shard1_replica1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/nodes_used_collection_shard1_replica1/data/
[junit4:junit4]   2> 444248 T1621 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >4b4fb675
[junit4:junit4]   2> 444248 T1621 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 444249 T1621 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/nodes_used_collection_shard1_replica1/data
[junit4:junit4]   2> 444249 T1621 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/nodes_used_collection_shard1_replica1/data/index/
[junit4:junit4]   2> 444250 T1621 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/nodes_used_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 444250 T1621 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/nodes_used_collection_shard1_replica1/data/index
[junit4:junit4]   2> 444252 T1621 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >68f3ba82 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >1a23d642),segFN=segments_1,generation=1}
[junit4:junit4]   2> 444252 T1621 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 444254 T1621 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 444254 T1621 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 444255 T1621 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 444256 T1621 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 444256 T1621 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 444256 T1621 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 444256 T1636 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 444257 T1621 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 444257 T1621 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 444258 T1621 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 444260 T1621 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 444262 T1621 oass.SolrIndexSearcher.<init> Opening Searcher< at >7b482ad2 main
[junit4:junit4]   2> 444263 T1636 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 444263 T1621 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/nodes_used_collection_shard1_replica1/data/tlog
[junit4:junit4]   2> 444264 T1621 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 444264 T1621 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 444267 T1649 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica1] Registered new searcher Searcher< at >7b482ad2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 444267 T1636 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 444267 T1621 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=down
[junit4:junit4]   2> 444269 T1636 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 444269 T1636 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 444270 T1636 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 444271 T1636 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 444271 T1636 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 444271 T1636 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 444272 T1636 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/data/
[junit4:junit4]   2> 444272 T1636 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >4b4fb675
[junit4:junit4]   2> 444273 T1636 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 444274 T1636 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/data
[junit4:junit4]   2> 444274 T1636 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/data/index/
[junit4:junit4]   2> 444274 T1636 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 444275 T1636 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/data/index
[junit4:junit4]   2> 444277 T1636 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >6f328d65 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >123118),segFN=segments_1,generation=1}
[junit4:junit4]   2> 444277 T1636 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 444280 T1636 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 444280 T1636 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 444281 T1636 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 444282 T1636 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 444282 T1636 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 444282 T1636 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 444283 T1636 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 444283 T1636 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 444284 T1636 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 444288 T1636 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 444291 T1636 oass.SolrIndexSearcher.<init> Opening Searcher< at >45cf6c3 main
[junit4:junit4]   2> 444291 T1636 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/data/tlog
[junit4:junit4]   2> 444292 T1636 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 444293 T1636 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 444295 T1650 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica2] Registered new searcher Searcher< at >45cf6c3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 444296 T1636 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=down
[junit4:junit4]   2> 444804 T1582 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 444805 T1582 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":null,
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":"shard2",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"nodes_used_collection_shard2_replica2",
[junit4:junit4]   2>   "collection":"nodes_used_collection",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:44045_m_%2Fbp",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:44045/m_/bp"}
[junit4:junit4]   2> 444805 T1582 oasc.Overseer$ClusterStateUpdater.createCollection Create collection nodes_used_collection with numShards 2
[junit4:junit4]   2> 444808 T1582 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":null,
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":"shard2",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"nodes_used_collection_shard2_replica1",
[junit4:junit4]   2>   "collection":"nodes_used_collection",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:46286_m_%2Fbp",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:46286/m_/bp"}
[junit4:junit4]   2> 444810 T1582 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":null,
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"nodes_used_collection_shard1_replica1",
[junit4:junit4]   2>   "collection":"nodes_used_collection",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:52357_m_%2Fbp",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:52357/m_/bp"}
[junit4:junit4]   2> 444812 T1582 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":null,
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"nodes_used_collection_shard1_replica2",
[junit4:junit4]   2>   "collection":"nodes_used_collection",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:56616_m_%2Fbp",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:56616/m_/bp"}
[junit4:junit4]   2> 444816 T1641 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 444816 T1613 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 444816 T1581 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 444816 T1627 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 444816 T1599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 444816 T1586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 445124 T1609 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica2
[junit4:junit4]   2> 445125 T1609 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica2 address:http://127.0.0.1:44045/m_/bp collection:nodes_used_collection shard:shard2
[junit4:junit4]   2> 445126 T1609 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard2/election
[junit4:junit4]   2> 445131 T1609 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 445134 T1609 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=179999
[junit4:junit4]   2> 445244 T1593 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica1
[junit4:junit4]   2> 445244 T1593 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica1 address:http://127.0.0.1:46286/m_/bp collection:nodes_used_collection shard:shard2
[junit4:junit4]   2> 445269 T1621 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica1
[junit4:junit4]   2> 445269 T1621 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica1 address:http://127.0.0.1:52357/m_/bp collection:nodes_used_collection shard:shard1
[junit4:junit4]   2> 445270 T1621 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard1/election
[junit4:junit4]   2> 445274 T1621 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 445276 T1621 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=180000
[junit4:junit4]   2> 445298 T1636 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica2
[junit4:junit4]   2> 445298 T1636 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica2 address:http://127.0.0.1:56616/m_/bp collection:nodes_used_collection shard:shard1
[junit4:junit4]   2> 445635 T1609 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 445635 T1609 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 445635 T1609 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:44045/m_/bp/nodes_used_collection_shard2_replica2/
[junit4:junit4]   2> 445636 T1609 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica2 url=http://127.0.0.1:44045/m_/bp START replicas=[http://127.0.0.1:46286/m_/bp/nodes_used_collection_shard2_replica1/] nUpdates=100
[junit4:junit4]   2> 445636 T1609 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica2 url=http://127.0.0.1:44045/m_/bp DONE.  We have no versions.  sync failed.
[junit4:junit4]   2> 445637 T1609 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4]   2> 445637 T1609 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4]   2> 445637 T1609 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:44045/m_/bp/nodes_used_collection_shard2_replica2/
[junit4:junit4]   2> 445637 T1609 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard2
[junit4:junit4]   2> ASYNC  NEW_CORE C1300 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore< at >24623f00 url=http://127.0.0.1:46286/m_/bp/nodes_used_collection_shard2_replica1 node=127.0.0.1:46286_m_%2Fbp C1300_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=down, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:46286_m_%2Fbp, base_url=http://127.0.0.1:46286/m_/bp}
[junit4:junit4]   2> 445643 T1592 C1300 P46286 oasc.SolrCore.execute [nodes_used_collection_shard2_replica1] webapp=/m_/bp path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1 
[junit4:junit4]   2> 445777 T1621 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 445778 T1621 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 445778 T1621 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52357/m_/bp/nodes_used_collection_shard1_replica1/
[junit4:junit4]   2> 445778 T1621 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica1 url=http://127.0.0.1:52357/m_/bp START replicas=[http://127.0.0.1:56616/m_/bp/nodes_used_collection_shard1_replica2/] nUpdates=100
[junit4:junit4]   2> 445779 T1621 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica1 url=http://127.0.0.1:52357/m_/bp DONE.  We have no versions.  sync failed.
[junit4:junit4]   2> 445779 T1621 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4]   2> 445779 T1621 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4]   2> 445779 T1621 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52357/m_/bp/nodes_used_collection_shard1_replica1/
[junit4:junit4]   2> 445780 T1621 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard1
[junit4:junit4]   2> ASYNC  NEW_CORE C1301 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore< at >8a6f3de url=http://127.0.0.1:56616/m_/bp/nodes_used_collection_shard1_replica2 node=127.0.0.1:56616_m_%2Fbp C1301_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=down, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:56616_m_%2Fbp, base_url=http://127.0.0.1:56616/m_/bp}
[junit4:junit4]   2> 445784 T1635 C1301 P56616 oasc.SolrCore.execute [nodes_used_collection_shard1_replica2] webapp=/m_/bp path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 446332 T1582 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 446343 T1641 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 446344 T1627 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 446344 T1613 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 446344 T1586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 446343 T1599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 446343 T1581 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 446349 T1593 oasc.ZkController.register We are http://127.0.0.1:46286/m_/bp/nodes_used_collection_shard2_replica1/ and leader is http://127.0.0.1:44045/m_/bp/nodes_used_collection_shard2_replica2/
[junit4:junit4]   2> 446349 T1593 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard2_replica1 baseURL=http://127.0.0.1:46286/m_/bp
[junit4:junit4]   2> 446350 T1593 oasc.ZkController.checkRecovery Core needs to recover:nodes_used_collection_shard2_replica1
[junit4:junit4]   2> 446350 T1593 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> 446350 T1653 C1300 P46286 oasc.RecoveryStrategy.run Starting recovery process.  core=nodes_used_collection_shard2_replica1 recoveringAfterStartup=true
[junit4:junit4]   2> 446350 T1653 C1300 P46286 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 446351 T1593 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 446351 T1653 C1300 P46286 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=recovering
[junit4:junit4]   2> 446352 T1593 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=2830 
[junit4:junit4]   2> 446352 T1653 C1300 P46286 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 446353 T1636 oasc.ZkController.register We are http://127.0.0.1:56616/m_/bp/nodes_used_collection_shard1_replica2/ and leader is http://127.0.0.1:52357/m_/bp/nodes_used_collection_shard1_replica1/
[junit4:junit4]   2> 446353 T1636 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard1_replica2 baseURL=http://127.0.0.1:56616/m_/bp
[junit4:junit4]   2> 446353 T1636 oasc.ZkController.checkRecovery Core needs to recover:nodes_used_collection_shard1_replica2
[junit4:junit4]   2> 446353 T1636 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> 446354 T1654 C1301 P56616 oasc.RecoveryStrategy.run Starting recovery process.  core=nodes_used_collection_shard1_replica2 recoveringAfterStartup=true
[junit4:junit4]   2> 446354 T1654 C1301 P56616 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 446354 T1636 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 446354 T1654 C1301 P56616 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=recovering
[junit4:junit4]   2> 446355 T1636 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=2834 
[junit4:junit4]   2> 446356 T1654 C1301 P56616 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 446357 T1607 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:46286_m_%2Fbp_nodes_used_collection_shard2_replica1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   2> 446360 T1622 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:56616_m_%2Fbp_nodes_used_collection_shard1_replica2, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   2> 446386 T1621 oasc.ZkController.register We are http://127.0.0.1:52357/m_/bp/nodes_used_collection_shard1_replica1/ and leader is http://127.0.0.1:52357/m_/bp/nodes_used_collection_shard1_replica1/
[junit4:junit4]   2> 446387 T1621 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard1_replica1 baseURL=http://127.0.0.1:52357/m_/bp
[junit4:junit4]   2> 446387 T1621 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 446387 T1621 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=active
[junit4:junit4]   2> 446389 T1621 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 446390 T1621 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=2869 
[junit4:junit4]   2> 446395 T1609 oasc.ZkController.register We are http://127.0.0.1:44045/m_/bp/nodes_used_collection_shard2_replica2/ and leader is http://127.0.0.1:44045/m_/bp/nodes_used_collection_shard2_replica2/
[junit4:junit4]   2> 446396 T1609 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard2_replica2 baseURL=http://127.0.0.1:44045/m_/bp
[junit4:junit4]   2> 446396 T1609 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 446396 T1609 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=active
[junit4:junit4]   2> 446398 T1609 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 446399 T1609 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=2876 
[junit4:junit4]   2> 446399 T1583 oasc.OverseerCollectionProcessor.createCollection Finished create command on all shards for collection: nodes_used_collection
[junit4:junit4]   2> 446404 T1599 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work/qnr-0000000000 state: SyncConnected type NodeDataChanged
[junit4:junit4]   2> 446405 T1581 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4]   2> 446406 T1583 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Message id:/overseer/collection-queue-work/qn-0000000000 complete, response:{success={null={responseHeader={status=0,QTime=2830},core=nodes_used_collection_shard2_replica1},null={responseHeader={status=0,QTime=2834},core=nodes_used_collection_shard1_replica2},null={responseHeader={status=0,QTime=2869},core=nodes_used_collection_shard1_replica1},null={responseHeader={status=0,QTime=2876},core=nodes_used_collection_shard2_replica2}}}
[junit4:junit4]   2> 446407 T1594 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2} status=0 QTime=2896 
[junit4:junit4]   2> 446408 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 446409 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 446410 T1656 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >3ac90fdc name:ZooKeeperConnection Watcher:127.0.0.1:34638/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 446410 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 446411 T1559 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 446413 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 446414 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 446416 T1658 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >667b27b7 name:ZooKeeperConnection Watcher:127.0.0.1:34638/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 446416 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 446418 T1559 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 446423 T1620 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=1&maxShardsPerNode=1&name=awholynewcollection_0&replicationFactor=2&action=CREATE&wt=javabin&version=2
[junit4:junit4]   2> 446424 T1581 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4]   2> 446425 T1583 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000002 message:{
[junit4:junit4]   2>   "operation":"createcollection",
[junit4:junit4]   2>   "numShards":"1",
[junit4:junit4]   2>   "maxShardsPerNode":"1",
[junit4:junit4]   2>   "createNodeSet":null,
[junit4:junit4]   2>   "name":"awholynewcollection_0",
[junit4:junit4]   2>   "replicationFactor":"2"}
[junit4:junit4]   2> 446426 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica1 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:56616_m_%2Fbp
[junit4:junit4]   2> 446426 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica2 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:52357_m_%2Fbp
[junit4:junit4]   2> 446428 T1621 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_0_shard1_replica2
[junit4:junit4]   2> 446428 T1621 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4]   2> 446428 T1637 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_0_shard1_replica1
[junit4:junit4]   2> 446429 T1637 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4]   2> 446429 T1621 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4]   2> 446429 T1637 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4]   2> 446430 T1621 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 446430 T1637 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 446431 T1621 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 446431 T1637 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 446432 T1621 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4]   2> 446432 T1637 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4]   2> 446434 T1621 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4]   2> 446434 T1637 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4]   2> 446436 T1621 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_0_shard1_replica2/'
[junit4:junit4]   2> 446436 T1637 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_0_shard1_replica1/'
[junit4:junit4]   2> 446460 T1621 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 446481 T1637 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 446497 T1621 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 446498 T1621 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 446502 T1621 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica2] Schema name=test
[junit4:junit4]   2> 446534 T1637 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 446535 T1637 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 446540 T1637 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica1] Schema name=test
[junit4:junit4]   2> 446866 T1621 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 446871 T1621 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 446874 T1621 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 446892 T1621 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 446895 T1621 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 446898 T1621 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 446899 T1621 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 446899 T1621 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 446899 T1621 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 446900 T1621 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 446901 T1621 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 446901 T1621 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 446901 T1621 oasc.SolrCore.<init> [awholynewcollection_0_shard1_replica2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_0_shard1_replica2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_0_shard1_replica2/data/
[junit4:junit4]   2> 446901 T1621 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >4b4fb675
[junit4:junit4]   2> 446902 T1621 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 446902 T1621 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_0_shard1_replica2/data
[junit4:junit4]   2> 446903 T1621 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_0_shard1_replica2/data/index/
[junit4:junit4]   2> 446903 T1621 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard1_replica2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_0_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 446903 T1621 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_0_shard1_replica2/data/index
[junit4:junit4]   2> 446905 T1621 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >6ff6fe07 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >66a4f0c5),segFN=segments_1,generation=1}
[junit4:junit4]   2> 446905 T1621 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 446907 T1621 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 446907 T1621 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 446908 T1621 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 446908 T1621 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 446909 T1621 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 446909 T1621 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 446909 T1621 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 446910 T1621 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 446910 T1621 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 446912 T1621 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 446914 T1621 oass.SolrIndexSearcher.<init> Opening Searcher< at >52d93f52 main
[junit4:junit4]   2> 446914 T1621 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_0_shard1_replica2/data/tlog
[junit4:junit4]   2> 446915 T1621 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 446915 T1621 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 446918 T1659 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard1_replica2] Registered new searcher Searcher< at >52d93f52 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 446919 T1621 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica2 state=down
[junit4:junit4]   2> 446921 T1637 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 446926 T1637 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 446928 T1637 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 446939 T1637 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 446944 T1637 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 446947 T1637 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 446948 T1637 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 446948 T1637 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 446948 T1637 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 446949 T1637 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 446950 T1637 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 446950 T1637 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 446950 T1637 oasc.SolrCore.<init> [awholynewcollection_0_shard1_replica1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_0_shard1_replica1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_0_shard1_replica1/data/
[junit4:junit4]   2> 446950 T1637 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >4b4fb675
[junit4:junit4]   2> 446951 T1637 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 446951 T1637 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_0_shard1_replica1/data
[junit4:junit4]   2> 446952 T1637 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_0_shard1_replica1/data/index/
[junit4:junit4]   2> 446952 T1637 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard1_replica1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_0_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 446952 T1637 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_0_shard1_replica1/data/index
[junit4:junit4]   2> 446954 T1637 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >74a30fe1 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >7edc4c43),segFN=segments_1,generation=1}
[junit4:junit4]   2> 446954 T1637 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 446956 T1637 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 446956 T1637 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 446957 T1637 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 446957 T1637 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 446957 T1637 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 446958 T1637 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 446958 T1637 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 446958 T1637 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 446959 T1637 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 446961 T1637 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 446963 T1637 oass.SolrIndexSearcher.<init> Opening Searcher< at >23a23789 main
[junit4:junit4]   2> 446964 T1637 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_0_shard1_replica1/data/tlog
[junit4:junit4]   2> 446964 T1637 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 446965 T1637 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 446967 T1660 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard1_replica1] Registered new searcher Searcher< at >23a23789 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 446968 T1637 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica1 state=down
[junit4:junit4]   2> 447852 T1582 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 447853 T1582 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"127.0.0.1:46286_m_%2Fbp_nodes_used_collection_shard2_replica1",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":"shard2",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"recovering",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"nodes_used_collection_shard2_replica1",
[junit4:junit4]   2>   "collection":"nodes_used_collection",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:46286_m_%2Fbp",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:46286/m_/bp"}
[junit4:junit4]   2> 447858 T1582 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"127.0.0.1:56616_m_%2Fbp_nodes_used_collection_shard1_replica2",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"recovering",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"nodes_used_collection_shard1_replica2",
[junit4:junit4]   2>   "collection":"nodes_used_collection",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:56616_m_%2Fbp",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:56616/m_/bp"}
[junit4:junit4]   2> 447862 T1582 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"127.0.0.1:52357_m_%2Fbp_nodes_used_collection_shard1_replica1",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"active",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"nodes_used_collection_shard1_replica1",
[junit4:junit4]   2>   "collection":"nodes_used_collection",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:52357_m_%2Fbp",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:52357/m_/bp"}
[junit4:junit4]   2> 447865 T1582 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"127.0.0.1:44045_m_%2Fbp_nodes_used_collection_shard2_replica2",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":"shard2",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"active",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"nodes_used_collection_shard2_replica2",
[junit4:junit4]   2>   "collection":"nodes_used_collection",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:44045_m_%2Fbp",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:44045/m_/bp"}
[junit4:junit4]   2> 447870 T1582 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":null,
[junit4:junit4]   2>   "numShards":"1",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"awholynewcollection_0_shard1_replica2",
[junit4:junit4]   2>   "collection":"awholynewcollection_0",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:52357_m_%2Fbp",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:52357/m_/bp"}
[junit4:junit4]   2> 447870 T1582 oasc.Overseer$ClusterStateUpdater.createCollection Create collection awholynewcollection_0 with numShards 1
[junit4:junit4]   2> 447874 T1582 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":null,
[junit4:junit4]   2>   "numShards":"1",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"awholynewcollection_0_shard1_replica1",
[junit4:junit4]   2>   "collection":"awholynewcollection_0",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:56616_m_%2Fbp",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:56616/m_/bp"}
[junit4:junit4]   2> 447881 T1656 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 447882 T1641 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 447882 T1627 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 447882 T1599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 447881 T1581 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 447881 T1613 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 447881 T1586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 447881 T1658 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 447920 T1621 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard1_replica2
[junit4:junit4]   2> 447921 T1621 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard1_replica2 address:http://127.0.0.1:52357/m_/bp collection:awholynewcollection_0 shard:shard1
[junit4:junit4]   2> 447922 T1621 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leader_elect/shard1/election
[junit4:junit4]   2> 447932 T1621 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 447935 T1621 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=180000
[junit4:junit4]   2> 447970 T1637 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard1_replica1
[junit4:junit4]   2> 447970 T1637 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard1_replica1 address:http://127.0.0.1:56616/m_/bp collection:awholynewcollection_0 shard:shard1
[junit4:junit4]   2> 448357 T1607 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:46286_m_%2Fbp_nodes_used_collection_shard2_replica1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4]   2> 448358 T1607 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:46286_m_%252Fbp_nodes_used_collection_shard2_replica1&state=recovering&nodeName=127.0.0.1:46286_m_%252Fbp&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard2_replica2&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2001 
[junit4:junit4]   2> 448360 T1622 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:56616_m_%2Fbp_nodes_used_collection_shard1_replica2, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4]   2> 448361 T1622 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:56616_m_%252Fbp_nodes_used_collection_shard1_replica2&state=recovering&nodeName=127.0.0.1:56616_m_%252Fbp&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard1_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2000 
[junit4:junit4]   2> 448437 T1621 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 448437 T1621 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 448438 T1621 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52357/m_/bp/awholynewcollection_0_shard1_replica2/
[junit4:junit4]   2> 448438 T1621 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard1_replica2 url=http://127.0.0.1:52357/m_/bp START replicas=[http://127.0.0.1:56616/m_/bp/awholynewcollection_0_shard1_replica1/] nUpdates=100
[junit4:junit4]   2> 448438 T1621 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard1_replica2 url=http://127.0.0.1:52357/m_/bp DONE.  We have no versions.  sync failed.
[junit4:junit4]   2> 448439 T1621 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4]   2> 448439 T1621 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4]   2> 448439 T1621 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52357/m_/bp/awholynewcollection_0_shard1_replica2/
[junit4:junit4]   2> 448439 T1621 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leaders/shard1
[junit4:junit4]   2> ASYNC  NEW_CORE C1302 name=awholynewcollection_0_shard1_replica1 org.apache.solr.core.SolrCore< at >7098fe06 url=http://127.0.0.1:56616/m_/bp/awholynewcollection_0_shard1_replica1 node=127.0.0.1:56616_m_%2Fbp C1302_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard1_replica1 props:{shard=shard1, state=down, core=awholynewcollection_0_shard1_replica1, collection=awholynewcollection_0, node_name=127.0.0.1:56616_m_%2Fbp, base_url=http://127.0.0.1:56616/m_/bp}
[junit4:junit4]   2> 448445 T1634 C1302 P56616 oasc.SolrCore.execute [awholynewcollection_0_shard1_replica1] webapp=/m_/bp path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1 
[junit4:junit4]   2> 449400 T1582 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 449407 T1656 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 449408 T1613 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 449408 T1581 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 449408 T1641 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 449408 T1627 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 449407 T1586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 449407 T1658 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 449407 T1599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 449426 T1637 oasc.ZkController.register We are http://127.0.0.1:56616/m_/bp/awholynewcollection_0_shard1_replica1/ and leader is http://127.0.0.1:52357/m_/bp/awholynewcollection_0_shard1_replica2/
[junit4:junit4]   2> 449427 T1637 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard1_replica1 baseURL=http://127.0.0.1:56616/m_/bp
[junit4:junit4]   2> 449427 T1637 oasc.ZkController.checkRecovery Core needs to recover:awholynewcollection_0_shard1_replica1
[junit4:junit4]   2> 449427 T1637 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> 449428 T1662 C1302 P56616 oasc.RecoveryStrategy.run Starting recovery process.  core=awholynewcollection_0_shard1_replica1 recoveringAfterStartup=true
[junit4:junit4]   2> 449428 T1662 C1302 P56616 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 449428 T1637 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 449429 T1662 C1302 P56616 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica1 state=recovering
[junit4:junit4]   2> 449430 T1637 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=1&shard=shard1&name=awholynewcollection_0_shard1_replica1&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=3002 
[junit4:junit4]   2> 449430 T1662 C1302 P56616 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 449444 T1623 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:56616_m_%2Fbp_awholynewcollection_0_shard1_replica1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   2> 449447 T1621 oasc.ZkController.register We are http://127.0.0.1:52357/m_/bp/awholynewcollection_0_shard1_replica2/ and leader is http://127.0.0.1:52357/m_/bp/awholynewcollection_0_shard1_replica2/
[junit4:junit4]   2> 449448 T1621 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard1_replica2 baseURL=http://127.0.0.1:52357/m_/bp
[junit4:junit4]   2> 449448 T1621 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 449448 T1621 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica2 state=active
[junit4:junit4]   2> 449451 T1621 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 449452 T1621 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=1&shard=shard1&name=awholynewcollection_0_shard1_replica2&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=3024 
[junit4:junit4]   2> 449453 T1583 oasc.OverseerCollectionProcessor.createCollection Finished create command on all shards for collection: awholynewcollection_0
[junit4:junit4]   2> 449456 T1627 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work/qnr-0000000002 state: SyncConnected type NodeDataChanged
[junit4:junit4]   2> 449457 T1581 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4]   2> 449457 T1583 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Message id:/overseer/collection-queue-work/qn-0000000002 complete, response:{success={null={responseHeader={status=0,QTime=3002},core=awholynewcollection_0_shard1_replica1},null={responseHeader={status=0,QTime=3024},core=awholynewcollection_0_shard1_replica2}}}
[junit4:junit4]   2> 449459 T1620 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={numShards=1&maxShardsPerNode=1&name=awholynewcollection_0&replicationFactor=2&action=CREATE&wt=javabin&version=2} status=0 QTime=3036 
[junit4:junit4]   2> 449461 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 449462 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 449464 T1664 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >270f96 name:ZooKeeperConnection Watcher:127.0.0.1:34638/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 449464 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 449466 T1559 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 449472 T1621 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=2&maxShardsPerNode=2&name=awholynewcollection_1&replicationFactor=4&action=CREATE&wt=javabin&version=2
[junit4:junit4]   2> 449473 T1581 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4]   2> 449474 T1583 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000004 message:{
[junit4:junit4]   2>   "operation":"createcollection",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "maxShardsPerNode":"2",
[junit4:junit4]   2>   "createNodeSet":null,
[junit4:junit4]   2>   "name":"awholynewcollection_1",
[junit4:junit4]   2>   "replicationFactor":"4"}
[junit4:junit4]   2> 449475 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_1_shard1_replica1 as part of slice shard1 of collection awholynewcollection_1 on 127.0.0.1:52357_m_%2Fbp
[junit4:junit4]   2> 449475 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_1_shard1_replica2 as part of slice shard1 of collection awholynewcollection_1 on 127.0.0.1:44045_m_%2Fbp
[junit4:junit4]   2> 449475 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_1_shard1_replica3 as part of slice shard1 of collection awholynewcollection_1 on 127.0.0.1:46286_m_%2Fbp
[junit4:junit4]   2> 449475 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_1_shard1_replica4 as part of slice shard1 of collection awholynewcollection_1 on 127.0.0.1:35380_m_%2Fbp
[junit4:junit4]   2> 449475 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_1_shard2_replica1 as part of slice shard2 of collection awholynewcollection_1 on 127.0.0.1:56616_m_%2Fbp
[junit4:junit4]   2> 449476 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_1_shard2_replica2 as part of slice shard2 of collection awholynewcollection_1 on 127.0.0.1:52357_m_%2Fbp
[junit4:junit4]   2> 449476 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_1_shard2_replica3 as part of slice shard2 of collection awholynewcollection_1 on 127.0.0.1:44045_m_%2Fbp
[junit4:junit4]   2> 449476 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_1_shard2_replica4 as part of slice shard2 of collection awholynewcollection_1 on 127.0.0.1:46286_m_%2Fbp
[junit4:junit4]   2> 449477 T1575 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_1_shard1_replica4' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/awholynewcollection_1_shard1_replica4
[junit4:junit4]   2> 449477 T1575 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_1
[junit4:junit4]   2> 449477 T1622 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_1_shard2_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_1_shard2_replica2
[junit4:junit4]   2> 449478 T1594 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_1_shard2_replica4' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/awholynewcollection_1_shard2_replica4
[junit4:junit4]   2> 449478 T1594 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_1
[junit4:junit4]   2> 449477 T1593 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_1_shard1_replica3' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/awholynewcollection_1_shard1_replica3
[junit4:junit4]   2> 449479 T1593 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_1
[junit4:junit4]   2> 449477 T1620 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_1_shard1_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_1_shard1_replica1
[junit4:junit4]   2> 449479 T1594 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_1
[junit4:junit4]   2> 449479 T1634 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_1_shard2_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_1_shard2_replica1
[junit4:junit4]   2> 449478 T1607 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_1_shard2_replica3' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/awholynewcollection_1_shard2_replica3
[junit4:junit4]   2> 449480 T1607 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_1
[junit4:junit4]   2> 449478 T1575 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_1
[junit4:junit4]   2> 449478 T1622 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_1
[junit4:junit4]   2> 449478 T1606 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_1_shard1_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/awholynewcollection_1_shard1_replica2
[junit4:junit4]   2> 449481 T1606 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_1
[junit4:junit4]   2> 449481 T1622 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_1
[junit4:junit4]   2> 449482 T1606 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_1
[junit4:junit4]   2> 449481 T1607 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_1
[junit4:junit4]   2> 449483 T1607 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 449481 T1575 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 449480 T1634 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_1
[junit4:junit4]   2> 449480 T1594 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 449479 T1593 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_1
[junit4:junit4]   2> 449479 T1620 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_1
[junit4:junit4]   2> 449488 T1593 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 449489 T1594 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 449484 T1575 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 449484 T1607 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 449484 T1634 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_1
[junit4:junit4]   2> 449490 T1593 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 449482 T1606 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 449482 T1622 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 449490 T1593 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_1
[junit4:junit4]   2> 449490 T1634 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 449490 T1607 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_1
[junit4:junit4]   2> 449489 T1575 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_1
[junit4:junit4]   2> 449489 T1594 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_1
[junit4:junit4]   2> 449489 T1620 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_1
[junit4:junit4]   2> 449493 T1634 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 449492 T1606 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 449493 T1634 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_1
[junit4:junit4]   2> 449493 T1620 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 449494 T1622 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 449494 T1606 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_1
[junit4:junit4]   2> 449494 T1622 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_1
[junit4:junit4]   2> 449495 T1593 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_1
[junit4:junit4]   2> 449496 T1575 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_1
[junit4:junit4]   2> 449496 T1620 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_1
[junit4:junit4]   2> 449496 T1594 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_1
[junit4:junit4]   2> 449496 T1607 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_1
[junit4:junit4]   2> 449497 T1593 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/awholynewcollection_1_shard1_replica3/'
[junit4:junit4]   2> 449498 T1606 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_1
[junit4:junit4]   2> 449498 T1634 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_1
[junit4:junit4]   2> 449500 T1575 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/awholynewcollection_1_shard1_replica4/'
[junit4:junit4]   2> 449501 T1594 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/awholynewcollection_1_shard2_replica4/'
[junit4:junit4]   2> 449503 T1622 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_1
[junit4:junit4]   2> 449504 T1620 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_1
[junit4:junit4]   2> 449504 T1607 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/awholynewcollection_1_shard2_replica3/'
[junit4:junit4]   2> 449505 T1634 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_1_shard2_replica1/'
[junit4:junit4]   2> 449506 T1606 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/awholynewcollection_1_shard1_replica2/'
[junit4:junit4]   2> 449513 T1622 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_1_shard2_replica2/'
[junit4:junit4]   2> 449513 T1620 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_1_shard1_replica1/'
[junit4:junit4]   2> 449535 T1593 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 449566 T1575 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 449598 T1634 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 449602 T1594 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 449621 T1622 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 449624 T1606 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 449625 T1620 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 449633 T1593 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 449635 T1593 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 449639 T1607 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 449650 T1593 oass.IndexSchema.readSchema [awholynewcollection_1_shard1_replica3] Schema name=test
[junit4:junit4]   2> 449679 T1634 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 449692 T1634 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 449694 T1575 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 449697 T1575 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 449697 T1594 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 449706 T1634 oass.IndexSchema.readSchema [awholynewcollection_1_shard2_replica1] Schema name=test
[junit4:junit4]   2> 449708 T1594 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 449711 T1575 oass.IndexSchema.readSchema [awholynewcollection_1_shard1_replica4] Schema name=test
[junit4:junit4]   2> 449715 T1594 oass.IndexSchema.readSchema [awholynewcollection_1_shard2_replica4] Schema name=test
[junit4:junit4]   2> 449718 T1606 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 449719 T1606 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 449736 T1606 oass.IndexSchema.readSchema [awholynewcollection_1_shard1_replica2] Schema name=test
[junit4:junit4]   2> 449742 T1620 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 449744 T1620 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 449745 T1622 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 449748 T1607 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 449751 T1620 oass.IndexSchema.readSchema [awholynewcollection_1_shard1_replica1] Schema name=test
[junit4:junit4]   2> 449752 T1607 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 449753 T1622 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 449768 T1607 oass.IndexSchema.readSchema [awholynewcollection_1_shard2_replica3] Schema name=test
[junit4:junit4]   2> 449769 T1622 oass.IndexSchema.readSchema [awholynewcollection_1_shard2_replica2] Schema name=test
[junit4:junit4]   2> ASYNC  NEW_CORE C1303 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore< at >24623f00 url=http://127.0.0.1:46286/m_/bp/nodes_used_collection_shard2_replica1 node=127.0.0.1:46286_m_%2Fbp C1303_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:46286_m_%2Fbp, base_url=http://127.0.0.1:46286/m_/bp}
[junit4:junit4]   2> 450360 T1653 C1303 P46286 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:44045/m_/bp/nodes_used_collection_shard2_replica2/ core=nodes_used_collection_shard2_replica1 - recoveringAfterStartup=true
[junit4:junit4]   2> 450360 T1653 C1303 P46286 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica1 url=http://127.0.0.1:46286/m_/bp START replicas=[http://127.0.0.1:44045/m_/bp/nodes_used_collection_shard2_replica2/] nUpdates=100
[junit4:junit4]   2> ASYNC  NEW_CORE C1304 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore< at >8a6f3de url=http://127.0.0.1:56616/m_/bp/nodes_used_collection_shard1_replica2 node=127.0.0.1:56616_m_%2Fbp C1304_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=recovering, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:56616_m_%2Fbp, base_url=http://127.0.0.1:56616/m_/bp}
[junit4:junit4]   2> 450361 T1654 C1304 P56616 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:52357/m_/bp/nodes_used_collection_shard1_replica1/ core=nodes_used_collection_shard1_replica2 - recoveringAfterStartup=true
[junit4:junit4]   2> 450362 T1654 C1304 P56616 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica2 url=http://127.0.0.1:56616/m_/bp START replicas=[http://127.0.0.1:52357/m_/bp/nodes_used_collection_shard1_replica1/] nUpdates=100
[junit4:junit4]   2> ASYNC  NEW_CORE C1305 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore< at >8a6f3de url=http://127.0.0.1:56616/m_/bp/nodes_used_collection_shard1_replica2 node=127.0.0.1:56616_m_%2Fbp C1305_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=recovering, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:56616_m_%2Fbp, base_url=http://127.0.0.1:56616/m_/bp}
[junit4:junit4]   2> 450370 T1654 C1305 P56616 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 450370 T1654 C1305 P56616 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=nodes_used_collection_shard1_replica2
[junit4:junit4]   2> 450370 T1654 C1305 P56616 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=nodes_used_collection_shard1_replica2
[junit4:junit4]   2> 450371 T1654 C1305 P56616 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=nodes_used_collection_shard1_replica2
[junit4:junit4]   2> 450371 T1654 C1305 P56616 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 450371 T1654 C1305 P56616 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:52357/m_/bp/nodes_used_collection_shard1_replica1/. core=nodes_used_collection_shard1_replica2
[junit4:junit4]   2> 450371 T1654 C1305 P56616 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C1306 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore< at >24623f00 url=http://127.0.0.1:46286/m_/bp/nodes_used_collection_shard2_replica1 node=127.0.0.1:46286_m_%2Fbp C1306_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:46286_m_%2Fbp, base_url=http://127.0.0.1:46286/m_/bp}
[junit4:junit4]   2> 450375 T1653 C1306 P46286 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 450375 T1653 C1306 P46286 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=nodes_used_collection_shard2_replica1
[junit4:junit4]   2> 450375 T1653 C1306 P46286 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=nodes_used_collection_shard2_replica1
[junit4:junit4]   2> 450375 T1653 C1306 P46286 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=nodes_used_collection_shard2_replica1
[junit4:junit4]   2> 450376 T1653 C1306 P46286 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 450376 T1653 C1306 P46286 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:44045/m_/bp/nodes_used_collection_shard2_replica2/. core=nodes_used_collection_shard2_replica1
[junit4:junit4]   2> 450376 T1653 C1306 P46286 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C1307 name=nodes_used_collection_shard1_replica1 org.apache.solr.core.SolrCore< at >643397b6 url=http://127.0.0.1:52357/m_/bp/nodes_used_collection_shard1_replica1 node=127.0.0.1:52357_m_%2Fbp C1307_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica1 props:{shard=shard1, state=active, core=nodes_used_collection_shard1_replica1, collection=nodes_used_collection, node_name=127.0.0.1:52357_m_%2Fbp, base_url=http://127.0.0.1:52357/m_/bp, leader=true}
[junit4:junit4]   2> 450382 T1670 C1307 P52357 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp=/m_/bp path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1 
[junit4:junit4]   2> 450386 T1673 C1307 P52357 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> ASYNC  NEW_CORE C1308 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore< at >35463c8f url=http://127.0.0.1:44045/m_/bp/nodes_used_collection_shard2_replica2 node=127.0.0.1:44045_m_%2Fbp C1308_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{shard=shard2, state=active, core=nodes_used_collection_shard2_replica2, collection=nodes_used_collection, node_name=127.0.0.1:44045_m_%2Fbp, base_url=http://127.0.0.1:44045/m_/bp, leader=true}
[junit4:junit4]   2> 450386 T1608 C1308 P44045 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 450392 T1608 C1308 P44045 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >9754d51 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >6d8220),segFN=segments_1,generation=1}
[junit4:junit4]   2> 450393 T1673 C1307 P52357 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >68f3ba82 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >1a23d642),segFN=segments_1,generation=1}
[junit4:junit4]   2> 450396 T1609 C1308 P44045 oasc.SolrCore.execute [nodes_used_collection_shard2_replica2] webapp=/m_/bp path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1 
[junit4:junit4]   2> 450393 T1608 C1308 P44045 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> ASYNC  NEW_CORE C1309 name=nodes_used_collection_shard1_replica1 org.apache.solr.core.SolrCore< at >643397b6 url=http://127.0.0.1:52357/m_/bp/nodes_used_collection_shard1_replica1 node=127.0.0.1:52357_m_%2Fbp C1309_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica1 props:{shard=shard1, state=active, core=nodes_used_collection_shard1_replica1, collection=nodes_used_collection, node_name=127.0.0.1:52357_m_%2Fbp, base_url=http://127.0.0.1:52357/m_/bp, leader=true}
[junit4:junit4]   2> 450400 T1673 C1309 P52357 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> ASYNC  NEW_CORE C1310 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore< at >35463c8f url=http://127.0.0.1:44045/m_/bp/nodes_used_collection_shard2_replica2 node=127.0.0.1:44045_m_%2Fbp C1310_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{shard=shard2, state=active, core=nodes_used_collection_shard2_replica2, collection=nodes_used_collection, node_name=127.0.0.1:44045_m_%2Fbp, base_url=http://127.0.0.1:44045/m_/bp, leader=true}
[junit4:junit4]   2> 450404 T1608 C1310 P44045 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >9754d51 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >6d8220),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >9754d51 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >6d8220),segFN=segments_2,generation=2}
[junit4:junit4]   2> 450414 T1608 C1310 P44045 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 450414 T1673 C1309 P52357 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >68f3ba82 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >1a23d642),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >68f3ba82 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >1a23d642),segFN=segments_2,generation=2}
[junit4:junit4]   2> 450415 T1673 C1309 P52357 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 450415 T1608 C1310 P44045 oass.SolrIndexSearcher.<init> Opening Searcher< at >4ca09394 realtime
[junit4:junit4]   2> 450416 T1608 C1310 P44045 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 450416 T1608 C1310 P44045 oasup.LogUpdateProcessor.finish [nodes_used_collection_shard2_replica2] webapp=/m_/bp path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 30
[junit4:junit4]   2> 450417 T1673 C1309 P52357 oass.SolrIndexSearcher.<init> Opening Searcher< at >2c66c886 realtime
[junit4:junit4]   2> ASYNC  NEW_CORE C1311 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore< at >24623f00 url=http://127.0.0.1:46286/m_/bp/nodes_used_collection_shard2_replica1 node=127.0.0.1:46286_m_%2Fbp C1311_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:46286_m_%2Fbp, base_url=http://127.0.0.1:46286/m_/bp}
[junit4:junit4]   2> 450417 T1653 C1311 P46286 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 450418 T1673 C1309 P52357 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 450418 T1653 C1311 P46286 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 450418 T1673 C1309 P52357 oasup.LogUpdateProcessor.finish [nodes_used_collection_shard1_replica1] webapp=/m_/bp path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 32
[junit4:junit4]   2> ASYNC  NEW_CORE C1312 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore< at >8a6f3de url=http://127.0.0.1:56616/m_/bp/nodes_used_collection_shard1_replica2 node=127.0.0.1:56616_m_%2Fbp C1312_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=recovering, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:56616_m_%2Fbp, base_url=http://127.0.0.1:56616/m_/bp}
[junit4:junit4]   2> 450420 T1654 C1312 P56616 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 450420 T1654 C1312 P56616 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 450421 T1608 C1310 P44045 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 450421 T1608 C1310 P44045 oasc.SolrCore.execute [nodes_used_collection_shard2_replica2] webapp=/m_/bp path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 450422 T1653 C1311 P46286 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 450423 T1653 C1311 P46286 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 450423 T1653 C1311 P46286 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 450422 T1670 C1309 P52357 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 450423 T1670 C1309 P52357 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp=/m_/bp path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 450424 T1654 C1312 P56616 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 450425 T1654 C1312 P56616 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 450425 T1654 C1312 P56616 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 450426 T1609 C1310 P44045 oasc.SolrCore.execute [nodes_used_collection_shard2_replica2] webapp=/m_/bp path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0 
[junit4:junit4]   2> 450427 T1653 C1311 P46286 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 450428 T1653 C1311 P46286 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/data/index.20130524081134950
[junit4:junit4]   2> 450429 T1653 C1311 P46286 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >38d6dd85 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >6ffcd7d2) fullCopy=false
[junit4:junit4]   2> 450429 T1673 C1309 P52357 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp=/m_/bp path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0 
[junit4:junit4]   2> 450429 T1654 C1312 P56616 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 450431 T1654 C1312 P56616 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/data/index.20130524081134953
[junit4:junit4]   2> 450431 T1654 C1312 P56616 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >6ba0c287 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >3dcb9b81) fullCopy=false
[junit4:junit4]   2> 450432 T1608 C1310 P44045 oasc.SolrCore.execute [nodes_used_collection_shard2_replica2] webapp=/m_/bp path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
[junit4:junit4]   2> 450433 T1670 C1309 P52357 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp=/m_/bp path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
[junit4:junit4]   2> ASYNC  NEW_CORE C1313 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore< at >8a6f3de url=http://127.0.0.1:56616/m_/bp/nodes_used_collection_shard1_replica2 node=127.0.0.1:56616_m_%2Fbp C1313_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=recovering, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:56616_m_%2Fbp, base_url=http://127.0.0.1:56616/m_/bp}
[junit4:junit4]   2> 450442 T1654 C1313 P56616 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> ASYNC  NEW_CORE C1314 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore< at >24623f00 url=http://127.0.0.1:46286/m_/bp/nodes_used_collection_shard2_replica1 node=127.0.0.1:46286_m_%2Fbp C1314_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:46286_m_%2Fbp, base_url=http://127.0.0.1:46286/m_/bp}
[junit4:junit4]   2> 450443 T1653 C1314 P46286 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 450444 T1654 C1313 P56616 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 450444 T1654 C1313 P56616 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=nodes_used_collection_shard1_replica2
[junit4:junit4]   2> 450446 T1654 C1313 P56616 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >6f328d65 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >123118),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >6f328d65 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >123118),segFN=segments_2,generation=2}
[junit4:junit4]   2> 450446 T1654 C1313 P56616 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 450447 T1654 C1313 P56616 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 450447 T1653 C1314 P46286 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 450448 T1654 C1313 P56616 oass.SolrIndexSearcher.<init> Opening Searcher< at >3403ecdf main
[junit4:junit4]   2> 450448 T1653 C1314 P46286 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=nodes_used_collection_shard2_replica1
[junit4:junit4]   2> 450449 T1650 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica2] Registered new searcher Searcher< at >3403ecdf main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 450449 T1653 C1314 P46286 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >74fe9f46 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >3248e3cf),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >74fe9f46 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >3248e3cf),segFN=segments_2,generation=2}
[junit4:junit4]   2> 450450 T1653 C1314 P46286 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 450450 T1653 C1314 P46286 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 450450 T1654 C1313 P56616 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/data/index.20130524081134953 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/data/index.20130524081134953;done=true>>]
[junit4:junit4]   2> 450450 T1653 C1314 P46286 oass.SolrIndexSearcher.<init> Opening Searcher< at >3003927d main
[junit4:junit4]   2> 450450 T1654 C1313 P56616 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/data/index.20130524081134953
[junit4:junit4]   2> 450451 T1654 C1313 P56616 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/data/index.20130524081134953
[junit4:junit4]   2> 450451 T1654 C1313 P56616 oasc.RecoveryStrategy.replay No replay needed. core=nodes_used_collection_shard1_replica2
[junit4:junit4]   2> 450451 T1654 C1313 P56616 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=nodes_used_collection_shard1_replica2
[junit4:junit4]   2> 450451 T1648 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica1] Registered new searcher Searcher< at >3003927d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 450452 T1653 C1314 P46286 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/data/index.20130524081134950 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/data/index.20130524081134950;done=true>>]
[junit4:junit4]   2> 450452 T1653 C1314 P46286 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/data/index.20130524081134950
[junit4:junit4]   2> 450453 T1653 C1314 P46286 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/data/index.20130524081134950
[junit4:junit4]   2> 450453 T1653 C1314 P46286 oasc.RecoveryStrategy.replay No replay needed. core=nodes_used_collection_shard2_replica1
[junit4:junit4]   2> 450453 T1653 C1314 P46286 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=nodes_used_collection_shard2_replica1
[junit4:junit4]   2> 450453 T1653 C1314 P46286 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=active
[junit4:junit4]   2> 450451 T1654 C1313 P56616 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=active
[junit4:junit4]   2> 450455 T1653 C1314 P46286 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=nodes_used_collection_shard2_replica1
[junit4:junit4]   2> 450457 T1654 C1313 P56616 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=nodes_used_collection_shard1_replica2
[junit4:junit4]   2> 450565 T1634 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 450580 T1634 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 450584 T1634 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 450603 T1575 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 450610 T1575 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 450614 T1593 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 450614 T1575 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 450617 T1634 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 450622 T1634 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 450632 T1593 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 450633 T1634 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 450634 T1634 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 450635 T1634 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 450635 T1634 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 450636 T1593 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 450641 T1634 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 450642 T1634 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 450643 T1634 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 450644 T1575 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 450644 T1634 oasc.SolrCore.<init> [awholynewcollection_1_shard2_replica1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_1_shard2_replica1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_1_shard2_replica1/data/
[junit4:junit4]   2> 450645 T1634 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >4b4fb675
[junit4:junit4]   2> 450646 T1634 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 450647 T1634 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_1_shard2_replica1/data
[junit4:junit4]   2> 450647 T1634 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_1_shard2_replica1/data/index/
[junit4:junit4]   2> 450648 T1634 oasc.SolrCore.initIndex WARN [awholynewcollection_1_shard2_replica1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_1_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 450648 T1634 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_1_shard2_replica1/data/index
[junit4:junit4]   2> 450648 T1575 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 450654 T1575 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 450654 T1593 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 450657 T1575 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 450665 T1575 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 450665 T1575 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 450667 T1593 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 450668 T1634 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >755a6688 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >5a687be5),segFN=segments_1,generation=1}
[junit4:junit4]   2> 450668 T1634 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 450667 T1575 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 450669 T1575 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 450670 T1575 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 450670 T1575 oasc.SolrCore.<init> [awholynewcollection_1_shard1_replica4] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/awholynewcollection_1_shard1_replica4/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/awholynewcollection_1_shard1_replica4/data/
[junit4:junit4]   2> 450671 T1575 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >4b4fb675
[junit4:junit4]   2> 450671 T1575 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 450672 T1575 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/awholynewcollection_1_shard1_replica4/data
[junit4:junit4]   2> 450673 T1575 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/awholynewcollection_1_shard1_replica4/data/index/
[junit4:junit4]   2> 450673 T1575 oasc.SolrCore.initIndex WARN [awholynewcollection_1_shard1_replica4] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/awholynewcollection_1_shard1_replica4/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 450674 T1575 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/awholynewcollection_1_shard1_replica4/data/index
[junit4:junit4]   2> 450678 T1593 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 450678 T1634 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 450679 T1634 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 450679 T1593 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 450680 T1593 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 450680 T1593 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 450680 T1634 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 450681 T1634 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 450682 T1634 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 450682 T1634 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 450683 T1634 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 450684 T1634 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 450680 T1575 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >54f37d22 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >df66e80),segFN=segments_1,generation=1}
[junit4:junit4]   2> 450685 T1634 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 450682 T1593 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 450685 T1607 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 450685 T1575 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 450686 T1593 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 450687 T1593 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 450688 T1593 oasc.SolrCore.<init> [awholynewcollection_1_shard1_replica3] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/awholynewcollection_1_shard1_replica3/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/awholynewcollection_1_shard1_replica3/data/
[junit4:junit4]   2> 450688 T1593 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >4b4fb675
[junit4:junit4]   2> 450688 T1634 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 450689 T1620 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 450689 T1575 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 450689 T1593 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 450700 T1575 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 450701 T1634 oass.SolrIndexSearcher.<init> Opening Searcher< at >35ed8feb main
[junit4:junit4]   2> 450701 T1593 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/awholynewcollection_1_shard1_replica3/data
[junit4:junit4]   2> 450701 T1634 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core

[...truncated too long message...]

4]   1>      /solr/collections/awholynewcollection_2/leaders/shard2 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"awholynewcollection_2_shard2_replica3",
[junit4:junit4]   1>            "node_name":"127.0.0.1:46286_m_%2Fbp",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:46286/m_/bp"}
[junit4:junit4]   1>    /solr/collections/control_collection (1)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/control_collection/shards (0)
[junit4:junit4]   1>    /solr/collections/awholynewcollection_1 (2)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {
[junit4:junit4]   1>          "configName":"conf1",
[junit4:junit4]   1>          "router":"compositeId"}
[junit4:junit4]   1>     /solr/collections/awholynewcollection_1/leader_elect (2)
[junit4:junit4]   1>      /solr/collections/awholynewcollection_1/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/awholynewcollection_1/leader_elect/shard1/election (4)
[junit4:junit4]   1>        /solr/collections/awholynewcollection_1/leader_elect/shard1/election/89745305292308483-127.0.0.1:35380_m_%2Fbp_awholynewcollection_1_shard1_replica4-n_0000000000 (0)
[junit4:junit4]   1>        /solr/collections/awholynewcollection_1/leader_elect/shard1/election/89745305292308488-127.0.0.1:44045_m_%2Fbp_awholynewcollection_1_shard1_replica2-n_0000000003 (0)
[junit4:junit4]   1>        /solr/collections/awholynewcollection_1/leader_elect/shard1/election/89745305292308486-127.0.0.1:46286_m_%2Fbp_awholynewcollection_1_shard1_replica3-n_0000000001 (0)
[junit4:junit4]   1>        /solr/collections/awholynewcollection_1/leader_elect/shard1/election/89745305292308490-127.0.0.1:52357_m_%2Fbp_awholynewcollection_1_shard1_replica1-n_0000000002 (0)
[junit4:junit4]   1>      /solr/collections/awholynewcollection_1/leader_elect/shard2 (1)
[junit4:junit4]   1>       /solr/collections/awholynewcollection_1/leader_elect/shard2/election (4)
[junit4:junit4]   1>        /solr/collections/awholynewcollection_1/leader_elect/shard2/election/89745305292308486-127.0.0.1:46286_m_%2Fbp_awholynewcollection_1_shard2_replica4-n_0000000003 (0)
[junit4:junit4]   1>        /solr/collections/awholynewcollection_1/leader_elect/shard2/election/89745305292308488-127.0.0.1:44045_m_%2Fbp_awholynewcollection_1_shard2_replica3-n_0000000001 (0)
[junit4:junit4]   1>        /solr/collections/awholynewcollection_1/leader_elect/shard2/election/89745305292308490-127.0.0.1:52357_m_%2Fbp_awholynewcollection_1_shard2_replica2-n_0000000002 (0)
[junit4:junit4]   1>        /solr/collections/awholynewcollection_1/leader_elect/shard2/election/89745305292308492-127.0.0.1:56616_m_%2Fbp_awholynewcollection_1_shard2_replica1-n_0000000000 (0)
[junit4:junit4]   1>     /solr/collections/awholynewcollection_1/leaders (2)
[junit4:junit4]   1>      /solr/collections/awholynewcollection_1/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"awholynewcollection_1_shard1_replica4",
[junit4:junit4]   1>            "node_name":"127.0.0.1:35380_m_%2Fbp",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:35380/m_/bp"}
[junit4:junit4]   1>      /solr/collections/awholynewcollection_1/leaders/shard2 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"awholynewcollection_1_shard2_replica1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:56616_m_%2Fbp",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:56616/m_/bp"}
[junit4:junit4]   1>   /solr/overseer_elect (2)
[junit4:junit4]   1>    /solr/overseer_elect/election (5)
[junit4:junit4]   1>     /solr/overseer_elect/election/89745305292308492-127.0.0.1:56616_m_%2Fbp-n_0000000004 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89745305292308483-127.0.0.1:35380_m_%2Fbp-n_0000000000 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89745305292308490-127.0.0.1:52357_m_%2Fbp-n_0000000003 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89745305292308488-127.0.0.1:44045_m_%2Fbp-n_0000000002 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89745305292308486-127.0.0.1:46286_m_%2Fbp-n_0000000001 (0)
[junit4:junit4]   1>    /solr/overseer_elect/leader (0)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"id":"89745305292308483-127.0.0.1:35380_m_%2Fbp-n_0000000000"}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=5662BDE050A999FE -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_PR -Dtests.timezone=America/Chihuahua -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE  277s J1 | CollectionsAPIDistributedZkTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 230 seconds
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([5662BDE050A999FE:D78433F827F6F9C2]:0)
[junit4:junit4]    > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:173)
[junit4:junit4]    > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:131)
[junit4:junit4]    > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:126)
[junit4:junit4]    > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:512)
[junit4:junit4]    > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:146)
[junit4:junit4]    > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4]    > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 715133 T1559 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 276862 T1558 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4]   2> 716349 T1641 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 716349 T1641 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 716349 T1641 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> NOTE: test params are: codec=Appending, sim=DefaultSimilarity, locale=es_PR, timezone=America/Chihuahua
[junit4:junit4]   2> NOTE: Linux 3.2.0-41-generic amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=8,threads=1,free=98186600,total=224169984
[junit4:junit4]   2> NOTE: All tests run in this JVM: [PreAnalyzedUpdateProcessorTest, TestRandomFaceting, TestDefaultSimilarityFactory, TestLazyCores, SolrTestCaseJ4Test, TestCSVResponseWriter, TestHashPartitioner, TestPostingsSolrHighlighter, DirectSolrSpellCheckerTest, TestSystemIdResolver, UpdateParamsTest, SimplePostToolTest, SampleTest, TestDFRSimilarityFactory, TestIndexSearcher, TestSchemaNameResource, TestPropInject, TestCollationField, TestCodecSupport, SolrIndexConfigTest, JSONWriterTest, TestZkChroot, TestCSVLoader, ClusterStateTest, OutputWriterTest, HardAutoCommitTest, TestSchemaSimilarityResource, TestWordDelimiterFilterFactory, ZkSolrClientTest, TestSolrXml, TestNumberUtils, TermVectorComponentDistributedTest, PathHierarchyTokenizerFactoryTest, DistanceFunctionTest, TestJmxIntegration, CoreContainerCoreInitFailuresTest, TestJmxMonitoredMap, TestAnalyzedSuggestions, TestSolr4Spatial, IndexSchemaRuntimeFieldTest, TestSolrJ, OpenExchangeRatesOrgProviderTest, TestComponentsName, URLClassifyProcessorTest, FieldAnalysisRequestHandlerTest, ChaosMonkeySafeLeaderTest, TestDistributedGrouping, TestPartialUpdateDeduplication, TestBinaryResponseWriter, TestUpdate, TestUtils, IndexReaderFactoryTest, TestMultiCoreConfBootstrap, BadIndexSchemaTest, ZkNodePropsTest, TestReload, TestSolrQueryParserDefaultOperatorResource, TestRTGBase, TestSolrXMLSerializer, TestElisionMultitermQuery, RequestHandlersTest, TestUniqueKeyFieldResource, XsltUpdateRequestHandlerTest, TestLuceneMatchVersion, TestFieldTypeResource, SpellPossibilityIteratorTest, TestRecovery, TestRangeQuery, TestArbitraryIndexDir, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest]
[junit4:junit4] Completed on J1 in 278.14s, 1 test, 1 failure <<< FAILURES!

[...truncated 517 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:386: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:366: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:437: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1243: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:887: There were test failures: 296 suites, 1234 tests, 1 failure, 13 ignored (7 assumptions)

Total time: 41 minutes 13 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_21 -XX:-UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe< at >lucene.apache.org
For additional commands, e-mail: dev-help< at >lucene.apache.org

[jira] [Updated] (LUCENE-5013) ScandinavianInterintelligableASCIIFoldingFilter

Karl Wettin (JIRA — 2013-05-24T14:10:21

     [ https://issues.apache.org/jira/browse/LUCENE-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Karl Wettin updated LUCENE-5013:
--------------------------------

    Attachment: LUCENE-5013-5.txt

Cleaned up the javadocs. 

This is as far as I can take this patch my self:

I need help with the TestFilterFactories, they throw SPI exceptions stating the factories are not available in the classpath via lookup. I shouldn't have to register them somewhere, right?
                

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (SOLR-4470) Support for basic http auth in internal solr requests

Mark Miller (JIRA — 2013-05-24T13:54:20

    [ https://issues.apache.org/jira/browse/SOLR-4470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13666316#comment-13666316 ] 

Mark Miller commented on SOLR-4470:
-----------------------------------

bq. Solr is not enforcing security - the webcontainer or something else is. 

A comment right in the patch explains this is not the case - it says the web container authorizes *any* role and then new Solr code is responsible for dealing with role authorization. This is Solr code that can introduce security bugs. This is the slippery slope, this is the fuzzy line, this is the creep. 

I'm fine with minor extensions to allow the web container security to work in many cases. I'm not currently okay with security code in Solr. 
                

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[JENKINS] Lucene-Solr-4.x-MacOSX (64bit/jdk1.6.0) - Build # 485 - Still Failing!

Policeman Jenkins Server — 2013-05-24T13:28:48

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-MacOSX/485/
Java: 64bit/jdk1.6.0 -XX:+UseCompressedOops -XX:+UseSerialGC

1 tests failed.
FAILED:  org.apache.lucene.replicator.http.HttpReplicatorTest.testBasic

Error Message:
Connection to http://localhost:51703 refused

Stack Trace:
org.apache.http.conn.HttpHostConnectException: Connection to http://localhost:51703 refused
at __randomizedtesting.SeedInfo.seed([3E22CA4A8DFC7E25:95D8D75F5220F80B]:0)
at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:190)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)
at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
at org.apache.lucene.replicator.http.HttpClientBase.executeGET(HttpClientBase.java:178)
at org.apache.lucene.replicator.http.HttpReplicator.checkForUpdate(HttpReplicator.java:51)
at org.apache.lucene.replicator.ReplicationClient.doUpdate(ReplicationClient.java:196)
at org.apache.lucene.replicator.ReplicationClient.updateNow(ReplicationClient.java:402)
at org.apache.lucene.replicator.http.HttpReplicatorTest.testBasic(HttpReplicatorTest.java:112)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:680)
Caused by: java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:432)
at java.net.Socket.connect(Socket.java:529)
at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)
at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)
... 48 more




Build Log:
[...truncated 7428 lines...]
[junit4:junit4] Suite: org.apache.lucene.replicator.http.HttpReplicatorTest
[junit4:junit4]   2> 2013-05-24 20:28:11.549:DBUG:oejs.ServletHandler:filterNameMap={}
[junit4:junit4]   2> 2013-05-24 20:28:11.550:DBUG:oejs.ServletHandler:pathFilters=null
[junit4:junit4]   2> 2013-05-24 20:28:11.550:DBUG:oejs.ServletHandler:servletFilterMap=null
[junit4:junit4]   2> 2013-05-24 20:28:11.550:DBUG:oejs.ServletHandler:servletPathMap={/replicate/*=org.apache.lucene.replicator.http.ReplicationServlet-960692424}
[junit4:junit4]   2> 2013-05-24 20:28:11.550:DBUG:oejs.ServletHandler:servletNameMap={org.apache.lucene.replicator.http.ReplicationServlet-960692424=org.apache.lucene.replicator.http.ReplicationServlet-960692424}
[junit4:junit4]   2> 2013-05-24 20:28:11.656:DBUG:oejuc.Container:Container org.eclipse.jetty.server.Server< at >24d2fb67 + SelectChannelConnector< at >0.0.0.0:0 as connector
[junit4:junit4]   2> 2013-05-24 20:28:11.660:DBUG:oejuc.Container:Container org.eclipse.jetty.servlet.ServletHandler< at >14860315 + org.apache.lucene.replicator.http.ReplicationServlet-960692424 as servlet
[junit4:junit4]   2> 2013-05-24 20:28:11.661:DBUG:oejuc.Container:Container org.eclipse.jetty.servlet.ServletHandler< at >14860315 + [/replicate/*]=>org.apache.lucene.replicator.http.ReplicationServlet-960692424 as servletMapping
[junit4:junit4]   2> 2013-05-24 20:28:11.661:DBUG:oejuc.Container:Container org.eclipse.jetty.server.Server< at >24d2fb67 + org.eclipse.jetty.servlet.ServletHandler< at >14860315 as handler
[junit4:junit4]   2> 2013-05-24 20:28:11.683:DBUG:oejuc.Container:Container org.eclipse.jetty.server.Server< at >24d2fb67 - SelectChannelConnector< at >0.0.0.0:0 as connector
[junit4:junit4]   2> 2013-05-24 20:28:11.684:DBUG:oejuc.Container:Container org.eclipse.jetty.server.Server< at >24d2fb67 + SelectChannelConnector< at >127.0.0.1:0 as connector
[junit4:junit4]   2> 2013-05-24 20:28:11.696:DBUG:oejuc.Container:Container org.eclipse.jetty.server.Server< at >24d2fb67 + org.eclipse.jetty.server.session.HashSessionIdManager< at >648353f6 as sessionIdManager
[junit4:junit4]   2> 2013-05-24 20:28:11.696:DBUG:oejuc.AbstractLifeCycle:starting org.eclipse.jetty.server.Server< at >24d2fb67
[junit4:junit4]   2> 2013-05-24 20:28:11.696:INFO:oejs.Server:jetty-8.1.10.v20130312
[junit4:junit4]   2> 2013-05-24 20:28:11.805:DBUG:oejuc.Container:Container org.eclipse.jetty.server.Server< at >24d2fb67 + qtp1791127681{8<=0<=0/254,-1} as threadpool
[junit4:junit4]   2> 2013-05-24 20:28:11.805:DBUG:oejuc.AbstractLifeCycle:starting org.eclipse.jetty.servlet.ServletHandler< at >14860315
[junit4:junit4]   2> 2013-05-24 20:28:11.821:DBUG:oejs.ServletHandler:filterNameMap={}
[junit4:junit4]   2> 2013-05-24 20:28:11.821:DBUG:oejs.ServletHandler:pathFilters=null
[junit4:junit4]   2> 2013-05-24 20:28:11.821:DBUG:oejs.ServletHandler:servletFilterMap=null
[junit4:junit4]   2> 2013-05-24 20:28:11.821:DBUG:oejs.ServletHandler:servletPathMap={/replicate/*=org.apache.lucene.replicator.http.ReplicationServlet-960692424}
[junit4:junit4]   2> 2013-05-24 20:28:11.822:DBUG:oejs.ServletHandler:servletNameMap={org.apache.lucene.replicator.http.ReplicationServlet-960692424=org.apache.lucene.replicator.http.ReplicationServlet-960692424}
[junit4:junit4]   2> 2013-05-24 20:28:11.822:DBUG:oejsh.AbstractHandler:starting org.eclipse.jetty.servlet.ServletHandler< at >14860315
[junit4:junit4]   2> 2013-05-24 20:28:11.822:DBUG:oejuc.AbstractLifeCycle:starting org.apache.lucene.replicator.http.ReplicationServlet-960692424
[junit4:junit4]   2> 2013-05-24 20:28:11.838:DBUG:oejuc.AbstractLifeCycle:STARTED org.apache.lucene.replicator.http.ReplicationServlet-960692424
[junit4:junit4]   2> 2013-05-24 20:28:11.838:DBUG:oejuc.AbstractLifeCycle:STARTED org.eclipse.jetty.servlet.ServletHandler< at >14860315
[junit4:junit4]   2> 2013-05-24 20:28:11.838:DBUG:oejsh.AbstractHandler:starting org.eclipse.jetty.server.Server< at >24d2fb67
[junit4:junit4]   2> 2013-05-24 20:28:11.838:DBUG:oejuc.AbstractLifeCycle:starting org.eclipse.jetty.server.session.HashSessionIdManager< at >648353f6
[junit4:junit4]   2> 2013-05-24 20:28:11.838:DBUG:oejuc.AbstractLifeCycle:STARTED org.eclipse.jetty.server.session.HashSessionIdManager< at >648353f6
[junit4:junit4]   2> 2013-05-24 20:28:11.838:DBUG:oejuc.AbstractLifeCycle:starting qtp1791127681{8<=0<=0/254,-1}
[junit4:junit4]   2> 2013-05-24 20:28:11.852:DBUG:oejuc.AbstractLifeCycle:STARTED qtp1791127681{8<=7<=8/254,0}
[junit4:junit4]   2> 2013-05-24 20:28:11.852:DBUG:oejuc.AbstractLifeCycle:starting SelectChannelConnector< at >127.0.0.1:0
[junit4:junit4]   2> 2013-05-24 20:28:11.935:DBUG:oejuc.AbstractLifeCycle:starting null/null
[junit4:junit4]   2> 2013-05-24 20:28:11.951:DBUG:oejuc.AbstractLifeCycle:STARTED PooledBuffers [0/1024< at >6144,0/1024< at >16384,0/1024< at >-]/PooledBuffers [0/1024< at >6144,0/1024< at >32768,0/1024< at >-]
[junit4:junit4]   2> 2013-05-24 20:28:11.952:DBUG:oejuc.AbstractLifeCycle:starting org.eclipse.jetty.server.nio.SelectChannelConnector$ConnectorSelectorManager< at >1cfd7c
[junit4:junit4]   2> 2013-05-24 20:28:11.997:DBUG:oejuc.AbstractLifeCycle:STARTED org.eclipse.jetty.server.nio.SelectChannelConnector$ConnectorSelectorManager< at >1cfd7c
[junit4:junit4]   2> 2013-05-24 20:28:12.001:DBUG:oeji.nio:Starting Thread[qtp1791127681-17 Selector0,5,TGRP-HttpReplicatorTest] on org.eclipse.jetty.io.nio.SelectorManager$1< at >25ee40a4
[junit4:junit4]   2> 2013-05-24 20:28:12.001:INFO:oejs.AbstractConnector:Started SelectChannelConnector< at >127.0.0.1:51703
[junit4:junit4]   2> 2013-05-24 20:28:12.007:DBUG:oejuc.AbstractLifeCycle:STARTED SelectChannelConnector< at >127.0.0.1:51703
[junit4:junit4]   2> 2013-05-24 20:28:12.008:DBUG:oejuc.AbstractLifeCycle:STARTED org.eclipse.jetty.server.Server< at >24d2fb67
[junit4:junit4]   2> 2013-05-24 20:28:14.310:DBUG:oejuc.AbstractLifeCycle:stopping org.eclipse.jetty.server.Server< at >24d2fb67
[junit4:junit4]   2> 2013-05-24 20:28:14.310:DBUG:oejuc.AbstractLifeCycle:stopping SelectChannelConnector< at >127.0.0.1:51703
[junit4:junit4]   2> 2013-05-24 20:28:14.314:DBUG:oejuc.AbstractLifeCycle:stopping org.eclipse.jetty.server.nio.SelectChannelConnector$ConnectorSelectorManager< at >1cfd7c
[junit4:junit4]   2> 2013-05-24 20:28:14.316:DBUG:oeji.nio:Stopped Thread[qtp1791127681-17 Selector0,5,TGRP-HttpReplicatorTest] on org.eclipse.jetty.io.nio.SelectorManager$1< at >25ee40a4
[junit4:junit4]   2> 2013-05-24 20:28:14.329:DBUG:oejuc.AbstractLifeCycle:STOPPED org.eclipse.jetty.server.nio.SelectChannelConnector$ConnectorSelectorManager< at >1cfd7c
[junit4:junit4]   2> 2013-05-24 20:28:14.329:DBUG:oejuc.AbstractLifeCycle:stopping PooledBuffers [0/1024< at >6144,0/1024< at >16384,0/1024< at >-]/PooledBuffers [0/1024< at >6144,0/1024< at >32768,0/1024< at >-]
[junit4:junit4]   2> 2013-05-24 20:28:14.338:DBUG:oejuc.AbstractLifeCycle:STOPPED null/null
[junit4:junit4]   2> 2013-05-24 20:28:14.338:DBUG:oejuc.AbstractLifeCycle:STOPPED SelectChannelConnector< at >127.0.0.1:0
[junit4:junit4]   2> 2013-05-24 20:28:14.339:DBUG:oejuc.AbstractLifeCycle:stopping org.eclipse.jetty.servlet.ServletHandler< at >14860315
[junit4:junit4]   2> 2013-05-24 20:28:14.339:DBUG:oejsh.AbstractHandler:stopping org.eclipse.jetty.servlet.ServletHandler< at >14860315
[junit4:junit4]   2> 2013-05-24 20:28:14.339:DBUG:oejuc.AbstractLifeCycle:stopping org.apache.lucene.replicator.http.ReplicationServlet-960692424
[junit4:junit4]   2> 2013-05-24 20:28:14.339:DBUG:oejuc.AbstractLifeCycle:STOPPED org.apache.lucene.replicator.http.ReplicationServlet-960692424
[junit4:junit4]   2> 2013-05-24 20:28:14.339:DBUG:oejuc.AbstractLifeCycle:STOPPED org.eclipse.jetty.servlet.ServletHandler< at >14860315
[junit4:junit4]   2> 2013-05-24 20:28:14.339:DBUG:oejsh.AbstractHandler:stopping org.eclipse.jetty.server.Server< at >24d2fb67
[junit4:junit4]   2> 2013-05-24 20:28:14.339:DBUG:oejuc.AbstractLifeCycle:stopping qtp1791127681{8<=8<=8/254,0}
[junit4:junit4]   2> 2013-05-24 20:28:14.400:DBUG:oejuc.AbstractLifeCycle:STOPPED qtp1791127681{8<=0<=0/254,6}
[junit4:junit4]   2> 2013-05-24 20:28:14.400:DBUG:oejuc.AbstractLifeCycle:stopping org.eclipse.jetty.server.session.HashSessionIdManager< at >648353f6
[junit4:junit4]   2> 2013-05-24 20:28:14.400:DBUG:oejuc.AbstractLifeCycle:STOPPED org.eclipse.jetty.server.session.HashSessionIdManager< at >648353f6
[junit4:junit4]   2> 2013-05-24 20:28:14.400:DBUG:oejuc.AbstractLifeCycle:STOPPED org.eclipse.jetty.server.Server< at >24d2fb67
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=HttpReplicatorTest -Dtests.method=testBasic -Dtests.seed=3E22CA4A8DFC7E25 -Dtests.slow=true -Dtests.locale=es_GT -Dtests.timezone=Asia/Omsk -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR   3.70s | HttpReplicatorTest.testBasic <<<
[junit4:junit4]    > Throwable #1: org.apache.http.conn.HttpHostConnectException: Connection to http://localhost:51703 refused
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([3E22CA4A8DFC7E25:95D8D75F5220F80B]:0)
[junit4:junit4]    > at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:190)
[junit4:junit4]    > at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)
[junit4:junit4]    > at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)
[junit4:junit4]    > at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)
[junit4:junit4]    > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
[junit4:junit4]    > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
[junit4:junit4]    > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
[junit4:junit4]    > at org.apache.lucene.replicator.http.HttpClientBase.executeGET(HttpClientBase.java:178)
[junit4:junit4]    > at org.apache.lucene.replicator.http.HttpReplicator.checkForUpdate(HttpReplicator.java:51)
[junit4:junit4]    > at org.apache.lucene.replicator.ReplicationClient.doUpdate(ReplicationClient.java:196)
[junit4:junit4]    > at org.apache.lucene.replicator.ReplicationClient.updateNow(ReplicationClient.java:402)
[junit4:junit4]    > at org.apache.lucene.replicator.http.HttpReplicatorTest.testBasic(HttpReplicatorTest.java:112)
[junit4:junit4]    > at java.lang.Thread.run(Thread.java:680)
[junit4:junit4]    > Caused by: java.net.ConnectException: Connection refused
[junit4:junit4]    > at java.net.PlainSocketImpl.socketConnect(Native Method)
[junit4:junit4]    > at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
[junit4:junit4]    > at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
[junit4:junit4]    > at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
[junit4:junit4]    > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:432)
[junit4:junit4]    > at java.net.Socket.connect(Socket.java:529)
[junit4:junit4]    > at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)
[junit4:junit4]    > at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)
[junit4:junit4]    > ... 48 more
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40, sim=DefaultSimilarity, locale=es_GT, timezone=Asia/Omsk
[junit4:junit4]   2> NOTE: Mac OS X 10.8.3 x86_64/Apple Inc. 1.6.0_45 (64-bit)/cpus=2,threads=1,free=30440528,total=48693248
[junit4:junit4]   2> NOTE: All tests run in this JVM: [IndexReplicationClientTest, HttpReplicatorTest]
[junit4:junit4] Completed in 3.79s, 1 test, 1 error <<< FAILURES!

[...truncated 24 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/build.xml:386: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/build.xml:366: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/lucene/build.xml:554: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:1827: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/lucene/module-build.xml:61: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:1243: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:887: There were test failures: 7 suites, 30 tests, 1 error

Total time: 48 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.6.0 -XX:+UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe< at >lucene.apache.org
For additional commands, e-mail: dev-help< at >lucene.apache.org

[JENKINS] Lucene-Solr-4.x-Linux (32bit/ibm-j9-jdk7) - Build # 5746 - Failure!

Policeman Jenkins Server — 2013-05-24T13:01:10

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/5746/
Java: 32bit/ibm-j9-jdk7 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}

1 tests failed.
REGRESSION:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
Server at http://127.0.0.1:46224/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:46224/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
at __randomizedtesting.SeedInfo.seed([201FBD2F856FF64B:A1F93337F2309677]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:198)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:90)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
at java.lang.reflect.Method.invoke(Method.java:613)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:780)




Build Log:
[...truncated 9346 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4]   2> 25194 T146 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4]   2> 25215 T146 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404
[junit4:junit4]   2> 25223 T146 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 25226 T147 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 25436 T146 oasc.ZkTestServer.run start zk server on port:41015
[junit4:junit4]   2> 25569 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 25595 T148 oazs.NIOServerCnxn.doIO WARN Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
[junit4:junit4]   2> 27631 T155 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >fd7e4735 name:ZooKeeperConnection Watcher:127.0.0.1:41015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 27632 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 27634 T146 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 27669 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 27672 T157 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >2fb52689 name:ZooKeeperConnection Watcher:127.0.0.1:41015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 27672 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 27676 T146 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 27681 T146 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 27686 T146 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 27690 T146 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 27695 T146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 27696 T146 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 27702 T146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 27703 T146 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 27709 T146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 27710 T146 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 27714 T146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 27715 T146 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 27721 T146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 27722 T146 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 27728 T146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 27729 T146 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 27734 T146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 27735 T146 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 27739 T146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 27740 T146 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 27745 T146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 27746 T146 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 28057 T146 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 28063 T146 oejs.AbstractConnector.doStart Started SelectChannelConnector< at >127.0.0.1:45451
[junit4:junit4]   2> 28064 T146 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 28065 T146 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 28066 T146 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369399172941
[junit4:junit4]   2> 28067 T146 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369399172941/solr.xml
[junit4:junit4]   2> 28068 T146 oasc.CoreContainer.<init> New CoreContainer 178491587
[junit4:junit4]   2> 28069 T146 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369399172941/'
[junit4:junit4]   2> 28070 T146 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369399172941/'
[junit4:junit4]   2> 28183 T146 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 28185 T146 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 28187 T146 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 28189 T146 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 28190 T146 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 28192 T146 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 28194 T146 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 28195 T146 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 28197 T146 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 28199 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 28229 T146 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 28230 T146 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41015/solr
[junit4:junit4]   2> 28239 T146 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 28243 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 28248 T172 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >472aafa name:ZooKeeperConnection Watcher:127.0.0.1:41015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 28249 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 28254 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 28285 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 28289 T174 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >634e87c0 name:ZooKeeperConnection Watcher:127.0.0.1:41015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 28289 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 28297 T146 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4]   2> 28309 T146 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4]   2> 28326 T146 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 28332 T146 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45451_
[junit4:junit4]   2> 28337 T146 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45451_
[junit4:junit4]   2> 28346 T146 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 28365 T146 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 28369 T146 oasc.Overseer.start Overseer (id=89744944041689091-127.0.0.1:45451_-n_0000000000) starting
[junit4:junit4]   2> 28379 T146 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4]   2> 28390 T146 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 28395 T146 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 28398 T146 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 28410 T175 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 28412 T176 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 28426 T177 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369399172941/collection1
[junit4:junit4]   2> 28427 T177 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 28429 T177 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 28430 T177 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 28435 T177 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369399172941/collection1/'
[junit4:junit4]   2> 28436 T177 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369399172941/collection1/lib/README' to classloader
[junit4:junit4]   2> 28437 T177 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369399172941/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 28527 T177 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 28593 T177 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 28604 T177 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 28625 T177 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 29383 T177 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 29395 T177 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 29399 T177 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 29437 T177 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 29446 T177 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 29452 T177 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 29456 T177 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 29457 T177 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 29458 T177 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 29460 T177 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 29461 T177 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 29461 T177 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 29461 T177 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369399172941/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/control/data/
[junit4:junit4]   2> 29462 T177 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >d3c35777
[junit4:junit4]   2> 29466 T177 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 29467 T177 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/control/data
[junit4:junit4]   2> 29468 T177 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/control/data/index/
[junit4:junit4]   2> 29468 T177 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 29469 T177 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/control/data/index
[junit4:junit4]   2> 29472 T177 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >598a91b2 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >c8de8f2b),segFN=segments_1,generation=1}
[junit4:junit4]   2> 29472 T177 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 29477 T177 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 29478 T177 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 29479 T177 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 29482 T177 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 29484 T177 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 29485 T177 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 29486 T177 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 29487 T177 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 29488 T177 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 29490 T177 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 29492 T177 oass.SolrIndexSearcher.<init> Opening Searcher< at >1d3af124 main
[junit4:junit4]   2> 29493 T177 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/control/data/tlog
[junit4:junit4]   2> 29494 T177 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 29495 T177 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 29508 T178 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher< at >1d3af124 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 29515 T177 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 29516 T177 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 29918 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 29920 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:45451",
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"1",
[junit4:junit4]   2>   "node_name":"127.0.0.1:45451_",
[junit4:junit4]   2>   "numShards":"1",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "collection":"control_collection",
[junit4:junit4]   2>   "shard":null,
[junit4:junit4]   2>   "core":"collection1"}
[junit4:junit4]   2> 29921 T175 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 29927 T175 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4]   2> 29941 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 30518 T177 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 30519 T177 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:45451 collection:control_collection shard:shard1
[junit4:junit4]   2> 30522 T177 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 30552 T177 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 30580 T177 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 30583 T177 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 30584 T177 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 30585 T177 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45451/collection1/
[junit4:junit4]   2> 30585 T177 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 30586 T177 oasc.SyncStrategy.syncToMe http://127.0.0.1:45451/collection1/ has no replicas
[junit4:junit4]   2> 30586 T177 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45451/collection1/
[junit4:junit4]   2> 30587 T177 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 31448 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 31559 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 31604 T177 oasc.ZkController.register We are http://127.0.0.1:45451/collection1/ and leader is http://127.0.0.1:45451/collection1/
[junit4:junit4]   2> 31605 T177 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45451
[junit4:junit4]   2> 31605 T177 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 31606 T177 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 31606 T177 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 31608 T177 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 31610 T146 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 31611 T146 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 31612 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 31620 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 31623 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 31626 T181 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >f426e0b7 name:ZooKeeperConnection Watcher:127.0.0.1:41015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 31626 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 31628 T146 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 31632 T146 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 31720 T146 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 31723 T146 oejs.AbstractConnector.doStart Started SelectChannelConnector< at >127.0.0.1:38199
[junit4:junit4]   2> 31724 T146 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 31724 T146 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 31725 T146 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369399176820
[junit4:junit4]   2> 31726 T146 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369399176820/solr.xml
[junit4:junit4]   2> 31726 T146 oasc.CoreContainer.<init> New CoreContainer -726346679
[junit4:junit4]   2> 31727 T146 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369399176820/'
[junit4:junit4]   2> 31727 T146 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369399176820/'
[junit4:junit4]   2> 31784 T146 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 31785 T146 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 31786 T146 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 31786 T146 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 31787 T146 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 31788 T146 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 31788 T146 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 31789 T146 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 31790 T146 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 31791 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 31798 T146 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 31798 T146 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41015/solr
[junit4:junit4]   2> 31799 T146 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 31800 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 31802 T192 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >69afcb75 name:ZooKeeperConnection Watcher:127.0.0.1:41015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 31802 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 31804 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 31812 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 31815 T194 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >90ed4bf3 name:ZooKeeperConnection Watcher:127.0.0.1:41015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 31815 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 31821 T146 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 32828 T146 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38199_
[junit4:junit4]   2> 32830 T146 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38199_
[junit4:junit4]   2> 32833 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 32834 T181 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 32835 T194 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 32837 T174 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 32843 T195 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369399176820/collection1
[junit4:junit4]   2> 32844 T195 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 32848 T195 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 32848 T195 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 32857 T195 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369399176820/collection1/'
[junit4:junit4]   2> 32858 T195 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369399176820/collection1/lib/README' to classloader
[junit4:junit4]   2> 32859 T195 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369399176820/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 32896 T195 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 32936 T195 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 32938 T195 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 32945 T195 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 33066 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 33068 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:45451",
[junit4:junit4]   2>   "state":"active",
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"1",
[junit4:junit4]   2>   "node_name":"127.0.0.1:45451_",
[junit4:junit4]   2>   "numShards":"1",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "collection":"control_collection",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "core":"collection1"}
[junit4:junit4]   2> 33075 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 33075 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 33075 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 33513 T195 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 33523 T195 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 33527 T195 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 33555 T195 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 33562 T195 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 33569 T195 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 33571 T195 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 33572 T195 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 33572 T195 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 33576 T195 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 33576 T195 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 33577 T195 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 33577 T195 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369399176820/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty1/
[junit4:junit4]   2> 33578 T195 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >d3c35777
[junit4:junit4]   2> 33579 T195 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 33580 T195 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty1
[junit4:junit4]   2> 33580 T195 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty1/index/
[junit4:junit4]   2> 33581 T195 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 33581 T195 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty1/index
[junit4:junit4]   2> 33583 T195 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >118f417e lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >d472e68b),segFN=segments_1,generation=1}
[junit4:junit4]   2> 33584 T195 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 33588 T195 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 33589 T195 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 33590 T195 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 33592 T195 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 33594 T195 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 33594 T195 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 33595 T195 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 33596 T195 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 33597 T195 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 33599 T195 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 33602 T195 oass.SolrIndexSearcher.<init> Opening Searcher< at >f27d551d main
[junit4:junit4]   2> 33602 T195 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty1/tlog
[junit4:junit4]   2> 33603 T195 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 33604 T195 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 33625 T196 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher< at >f27d551d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 33630 T195 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 33630 T195 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 34584 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 34586 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:38199",
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"2",
[junit4:junit4]   2>   "node_name":"127.0.0.1:38199_",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard":null,
[junit4:junit4]   2>   "core":"collection1"}
[junit4:junit4]   2> 34586 T175 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 34586 T175 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4]   2> 34635 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 34635 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 34635 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 35633 T195 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 35633 T195 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:38199 collection:collection1 shard:shard1
[junit4:junit4]   2> 35634 T195 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 35642 T195 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 35645 T195 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 35645 T195 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 35646 T195 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:38199/collection1/
[junit4:junit4]   2> 35646 T195 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 35647 T195 oasc.SyncStrategy.syncToMe http://127.0.0.1:38199/collection1/ has no replicas
[junit4:junit4]   2> 35647 T195 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:38199/collection1/
[junit4:junit4]   2> 35648 T195 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 36142 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 36151 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 36151 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 36151 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 36155 T195 oasc.ZkController.register We are http://127.0.0.1:38199/collection1/ and leader is http://127.0.0.1:38199/collection1/
[junit4:junit4]   2> 36156 T195 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:38199
[junit4:junit4]   2> 36156 T195 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 36157 T195 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 36157 T195 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 36159 T195 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 36161 T146 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 36161 T146 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 36162 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 36241 T146 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 36244 T146 oejs.AbstractConnector.doStart Started SelectChannelConnector< at >127.0.0.1:46224
[junit4:junit4]   2> 36245 T146 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 36245 T146 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 36246 T146 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369399181354
[junit4:junit4]   2> 36247 T146 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369399181354/solr.xml
[junit4:junit4]   2> 36247 T146 oasc.CoreContainer.<init> New CoreContainer 1193150784
[junit4:junit4]   2> 36248 T146 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369399181354/'
[junit4:junit4]   2> 36248 T146 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369399181354/'
[junit4:junit4]   2> 36292 T146 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 36293 T146 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 36294 T146 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 36294 T146 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 36295 T146 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 36295 T146 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 36296 T146 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 36296 T146 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 36297 T146 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 36298 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 36303 T146 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 36304 T146 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41015/solr
[junit4:junit4]   2> 36305 T146 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 36306 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 36309 T208 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >3d052b80 name:ZooKeeperConnection Watcher:127.0.0.1:41015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 36309 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 36311 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 36317 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 36319 T210 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >4191b62b name:ZooKeeperConnection Watcher:127.0.0.1:41015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 36319 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 36324 T146 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 37329 T146 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46224_
[junit4:junit4]   2> 37330 T146 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46224_
[junit4:junit4]   2> 37333 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 37333 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 37333 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 37333 T210 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 37336 T181 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 37336 T194 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 37337 T174 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 37341 T211 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369399181354/collection1
[junit4:junit4]   2> 37341 T211 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 37342 T211 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 37342 T211 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 37344 T211 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369399181354/collection1/'
[junit4:junit4]   2> 37344 T211 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369399181354/collection1/lib/README' to classloader
[junit4:junit4]   2> 37345 T211 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369399181354/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 37369 T211 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 37399 T211 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 37401 T211 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 37406 T211 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 37658 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 37659 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:38199",
[junit4:junit4]   2>   "state":"active",
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"2",
[junit4:junit4]   2>   "node_name":"127.0.0.1:38199_",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "core":"collection1"}
[junit4:junit4]   2> 37670 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 37671 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 37671 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 37671 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 37750 T211 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 37756 T211 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 37759 T211 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 37778 T211 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 37783 T211 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 37788 T211 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 37789 T211 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 37789 T211 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 37790 T211 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 37791 T211 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 37792 T211 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 37792 T211 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 37793 T211 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369399181354/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty2/
[junit4:junit4]   2> 37793 T211 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >d3c35777
[junit4:junit4]   2> 37794 T211 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 37794 T211 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty2
[junit4:junit4]   2> 37795 T211 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty2/index/
[junit4:junit4]   2> 37795 T211 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 37795 T211 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty2/index
[junit4:junit4]   2> 37797 T211 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >17f45be3 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >7fc37ff1),segFN=segments_1,generation=1}
[junit4:junit4]   2> 37797 T211 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 37801 T211 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 37801 T211 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 37802 T211 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 37803 T211 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 37804 T211 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 37804 T211 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 37805 T211 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 37806 T211 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 37807 T211 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 37808 T211 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 37810 T211 oass.SolrIndexSearcher.<init> Opening Searcher< at >422cd2a5 main
[junit4:junit4]   2> 37811 T211 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty2/tlog
[junit4:junit4]   2> 37812 T211 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 37812 T211 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 37824 T212 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher< at >422cd2a5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 37830 T211 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 37830 T211 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 39179 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 39180 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:46224",
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"3",
[junit4:junit4]   2>   "node_name":"127.0.0.1:46224_",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard":null,
[junit4:junit4]   2>   "core":"collection1"}
[junit4:junit4]   2> 39181 T175 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 39181 T175 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4]   2> 39189 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 39190 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 39189 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 39189 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 39832 T211 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 39833 T211 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:46224 collection:collection1 shard:shard2
[junit4:junit4]   2> 39834 T211 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 39841 T211 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 39844 T211 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 39845 T211 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 39845 T211 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:46224/collection1/
[junit4:junit4]   2> 39846 T211 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 39846 T211 oasc.SyncStrategy.syncToMe http://127.0.0.1:46224/collection1/ has no replicas
[junit4:junit4]   2> 39847 T211 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:46224/collection1/
[junit4:junit4]   2> 39847 T211 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 40696 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 40719 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 40720 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 40720 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 40720 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 40762 T211 oasc.ZkController.register We are http://127.0.0.1:46224/collection1/ and leader is http://127.0.0.1:46224/collection1/
[junit4:junit4]   2> 40762 T211 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46224
[junit4:junit4]   2> 40763 T211 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 40763 T211 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 40764 T211 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 40766 T211 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 40767 T146 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 40768 T146 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 40769 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 40902 T146 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 40905 T146 oejs.AbstractConnector.doStart Started SelectChannelConnector< at >127.0.0.1:57633
[junit4:junit4]   2> 40906 T146 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 40907 T146 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 40908 T146 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369399185965
[junit4:junit4]   2> 40909 T146 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369399185965/solr.xml
[junit4:junit4]   2> 40910 T146 oasc.CoreContainer.<init> New CoreContainer 1797337163
[junit4:junit4]   2> 40911 T146 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369399185965/'
[junit4:junit4]   2> 40912 T146 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369399185965/'
[junit4:junit4]   2> 40978 T146 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 40980 T146 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 40981 T146 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 40982 T146 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 40983 T146 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 40984 T146 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 40985 T146 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 40986 T146 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 40987 T146 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 40988 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 40998 T146 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 41001 T146 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41015/solr
[junit4:junit4]   2> 41002 T146 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 41006 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 41008 T224 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >48bac97a name:ZooKeeperConnection Watcher:127.0.0.1:41015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 41008 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 41012 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 41019 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 41023 T226 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >305c4a7 name:ZooKeeperConnection Watcher:127.0.0.1:41015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 41023 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 41030 T146 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 42034 T146 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57633_
[junit4:junit4]   2> 42037 T146 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57633_
[junit4:junit4]   2> 42040 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 42040 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 42041 T210 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 42041 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 42042 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 42043 T181 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 42041 T226 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 42045 T174 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 42046 T194 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 42052 T227 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369399185965/collection1
[junit4:junit4]   2> 42053 T227 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 42054 T227 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 42054 T227 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 42056 T227 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369399185965/collection1/'
[junit4:junit4]   2> 42056 T227 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369399185965/collection1/lib/README' to classloader
[junit4:junit4]   2> 42057 T227 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369399185965/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 42104 T227 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 42168 T227 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 42202 T227 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 42217 T227 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 42229 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 42230 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:46224",
[junit4:junit4]   2>   "state":"active",
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"3",
[junit4:junit4]   2>   "node_name":"127.0.0.1:46224_",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard":"shard2",
[junit4:junit4]   2>   "core":"collection1"}
[junit4:junit4]   2> 42238 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 42238 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 42238 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 42239 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 42240 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 42993 T227 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 43017 T227 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 43023 T227 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 43077 T227 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 43090 T227 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 43109 T227 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 43114 T227 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 43115 T227 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 43115 T227 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 43122 T227 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 43123 T227 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 43123 T227 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 43124 T227 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369399185965/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/
[junit4:junit4]   2> 43124 T227 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >d3c35777
[junit4:junit4]   2> 43126 T227 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 43127 T227 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3
[junit4:junit4]   2> 43127 T227 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/index/
[junit4:junit4]   2> 43128 T227 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 43129 T227 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/index
[junit4:junit4]   2> 43132 T227 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >a7fd2ed3 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >d5a6759f),segFN=segments_1,generation=1}
[junit4:junit4]   2> 43132 T227 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 43138 T227 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 43138 T227 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 43139 T227 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 43142 T227 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 43143 T227 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 43144 T227 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 43145 T227 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 43147 T227 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 43148 T227 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 43150 T227 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 43154 T227 oass.SolrIndexSearcher.<init> Opening Searcher< at >dbbcb5ef main
[junit4:junit4]   2> 43154 T227 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/tlog
[junit4:junit4]   2> 43156 T227 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 43156 T227 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 43174 T228 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher< at >dbbcb5ef main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 43192 T227 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 43192 T227 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 43750 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 43751 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:57633",
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"4",
[junit4:junit4]   2>   "node_name":"127.0.0.1:57633_",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard":null,
[junit4:junit4]   2>   "core":"collection1"}
[junit4:junit4]   2> 43751 T175 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 43752 T175 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4]   2> 43757 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 43757 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 43757 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 43757 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 43757 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 44200 T227 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 44200 T227 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:57633 collection:collection1 shard:shard1
[junit4:junit4]   2> 44205 T227 oasc.ZkController.register We are http://127.0.0.1:57633/collection1/ and leader is http://127.0.0.1:38199/collection1/
[junit4:junit4]   2> 44206 T227 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57633
[junit4:junit4]   2> 44206 T227 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 44207 T227 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C67 name=collection1 org.apache.solr.core.SolrCore< at >42344a6d url=http://127.0.0.1:57633/collection1 node=127.0.0.1:57633_ C67_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:57633, state=down, node_name=127.0.0.1:57633_, collection=collection1, core=collection1}
[junit4:junit4]   2> 44210 T229 C67 P57633 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 44210 T229 C67 P57633 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 44211 T229 C67 P57633 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 44211 T229 C67 P57633 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 44210 T227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 44213 T229 C67 P57633 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 44213 T146 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 44214 T146 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 44216 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 44227 T189 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   2> 44377 T146 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 44383 T146 oejs.AbstractConnector.doStart Started SelectChannelConnector< at >127.0.0.1:37229
[junit4:junit4]   2> 44388 T146 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 44389 T146 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 44390 T146 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369399189411
[junit4:junit4]   2> 44391 T146 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369399189411/solr.xml
[junit4:junit4]   2> 44393 T146 oasc.CoreContainer.<init> New CoreContainer 1003633917
[junit4:junit4]   2> 44394 T146 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369399189411/'
[junit4:junit4]   2> 44396 T146 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369399189411/'
[junit4:junit4]   2> 44494 T146 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 44496 T146 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 44497 T146 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 44499 T146 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 44501 T146 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 44502 T146 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 44504 T146 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 44505 T146 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 44507 T146 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 44513 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 44536 T146 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 44539 T146 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41015/solr
[junit4:junit4]   2> 44540 T146 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 44543 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 44556 T241 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >40c8c7fc name:ZooKeeperConnection Watcher:127.0.0.1:41015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 44560 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 44567 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 44587 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 44591 T243 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >42db5a55 name:ZooKeeperConnection Watcher:127.0.0.1:41015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 44591 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 44599 T146 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 45265 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 45267 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:57633",
[junit4:junit4]   2>   "state":"recovering",
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"4",
[junit4:junit4]   2>   "node_name":"127.0.0.1:57633_",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "core":"collection1"}
[junit4:junit4]   2> 45274 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 45274 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 45275 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 45274 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 45275 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 45274 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 45605 T146 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37229_
[junit4:junit4]   2> 45606 T146 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37229_
[junit4:junit4]   2> 45608 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 45609 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 45609 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 45609 T226 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 45609 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 45611 T210 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 45611 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 45610 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 45613 T194 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 45613 T243 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 45614 T174 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 45614 T181 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 45618 T244 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369399189411/collection1
[junit4:junit4]   2> 45619 T244 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 45619 T244 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 45620 T244 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 45621 T244 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369399189411/collection1/'
[junit4:junit4]   2> 45622 T244 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369399189411/collection1/lib/README' to classloader
[junit4:junit4]   2> 45622 T244 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369399189411/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 45651 T244 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 45684 T244 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 45686 T244 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 45691 T244 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 46228 T189 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4]   2> 46229 T189 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={state=recovering&onlyIfLeader=true&checkLive=true&action=PREPRECOVERY&version=2&coreNodeName=4&wt=javabin&nodeName=127.0.0.1:57633_&core=collection1} status=0 QTime=2003 
[junit4:junit4]   2> 46240 T244 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 46263 T244 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 46268 T244 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 46295 T244 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 46302 T244 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 46308 T244 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 46310 T244 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 46310 T244 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 46311 T244 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 46313 T244 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 46313 T244 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 46314 T244 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 46314 T244 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369399189411/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/
[junit4:junit4]   2> 46315 T244 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >d3c35777
[junit4:junit4]   2> 46316 T244 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 46317 T244 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4
[junit4:junit4]   2> 46318 T244 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/index/
[junit4:junit4]   2> 46318 T244 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 46319 T244 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/index
[junit4:junit4]   2> 46322 T244 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >118a9f31 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >a5c39f22),segFN=segments_1,generation=1}
[junit4:junit4]   2> 46322 T244 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 46325 T244 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 46326 T244 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 46327 T244 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 46328 T244 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 46330 T244 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 46330 T244 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 46331 T244 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 46332 T244 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 46333 T244 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 46334 T244 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 46339 T244 oass.SolrIndexSearcher.<init> Opening Searcher< at >593367bd main
[junit4:junit4]   2> 46341 T244 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/tlog
[junit4:junit4]   2> 46344 T244 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 46345 T244 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 46368 T245 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher< at >593367bd main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 46376 T244 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 46377 T244 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 46780 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 46782 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:37229",
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"5",
[junit4:junit4]   2>   "node_name":"127.0.0.1:37229_",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard":null,
[junit4:junit4]   2>   "core":"collection1"}
[junit4:junit4]   2> 46782 T175 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 46783 T175 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4]   2> 46787 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 46788 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 46788 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 46787 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 46788 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 46787 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 47379 T244 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 47380 T244 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:37229 collection:collection1 shard:shard2
[junit4:junit4]   2> 47383 T244 oasc.ZkController.register We are http://127.0.0.1:37229/collection1/ and leader is http://127.0.0.1:46224/collection1/
[junit4:junit4]   2> 47384 T244 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:37229
[junit4:junit4]   2> 47384 T244 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 47385 T244 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C68 name=collection1 org.apache.solr.core.SolrCore< at >78f9e89a url=http://127.0.0.1:37229/collection1 node=127.0.0.1:37229_ C68_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:37229, state=down, node_name=127.0.0.1:37229_, collection=collection1, core=collection1}
[junit4:junit4]   2> 47386 T246 C68 P37229 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 47386 T246 C68 P37229 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 47386 T244 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 47387 T246 C68 P37229 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 47387 T246 C68 P37229 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 47388 T146 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 47389 T146 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 47390 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 47620 T246 C68 P37229 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 47620 T146 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 47622 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 47631 T204 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   2> 47639 T187 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369399176820/onenodecollectioncore
[junit4:junit4]   2> 47639 T187 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4]   2> 47641 T187 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4]   2> 47642 T187 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 47643 T187 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 47644 T187 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4]   2> 47648 T187 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4]   2> 47649 T187 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369399176820/onenodecollectioncore/'
[junit4:junit4]   2> 47689 T187 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 47750 T187 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 47752 T187 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 47757 T187 oass.IndexSchema.readSchema [onenodecollectioncore] Schema name=test
[junit4:junit4]   2> 48191 T187 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 48213 T187 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 48218 T187 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> ASYNC  NEW_CORE C69 name=collection1 org.apache.solr.core.SolrCore< at >42344a6d url=http://127.0.0.1:57633/collection1 node=127.0.0.1:57633_ C69_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:57633, state=recovering, node_name=127.0.0.1:57633_, collection=collection1, shard=shard1, core=collection1}
[junit4:junit4]   2> 48230 T229 C69 P57633 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:38199/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 48234 T229 C69 P57633 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 48241 T229 C69 P57633 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:57633 START replicas=[http://127.0.0.1:38199/collection1/] nUpdates=100
[junit4:junit4]   2> 48243 T229 C69 P57633 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 48244 T229 C69 P57633 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 48244 T229 C69 P57633 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 48244 T229 C69 P57633 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 48245 T229 C69 P57633 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 48245 T229 C69 P57633 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:38199/collection1/. core=collection1
[junit4:junit4]   2> 48246 T229 C69 P57633 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 48256 T187 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> ASYNC  NEW_CORE C70 name=collection1 org.apache.solr.core.SolrCore< at >abeec515 url=http://127.0.0.1:38199/collection1 node=127.0.0.1:38199_ C70_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:38199, state=active, node_name=127.0.0.1:38199_, collection=collection1, shard=shard1, core=collection1, leader=true}
[junit4:junit4]   2> 48260 T190 C70 P38199 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 48262 T190 C70 P38199 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >118f417e lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >d472e68b),segFN=segments_1,generation=1}
[junit4:junit4]   2> 48263 T190 C70 P38199 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 48264 T190 C70 P38199 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >118f417e lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >d472e68b),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >118f417e lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >d472e68b),segFN=segments_2,generation=2}
[junit4:junit4]   2> 48264 T188 C70 P38199 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&qt=/get&distrib=false&version=2&wt=javabin} status=0 QTime=0 
[junit4:junit4]   2> 48265 T190 C70 P38199 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 48267 T190 C70 P38199 oass.SolrIndexSearcher.<init> Opening Searcher< at >dc3a04c3 realtime
[junit4:junit4]   2> 48267 T190 C70 P38199 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 48268 T190 C70 P38199 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={softCommit=false&commit_end_point=true&commit=true&version=2&waitSearcher=true&wt=javabin&openSearcher=false} {commit=} 0 9
[junit4:junit4]   2> 48269 T187 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 48285 T229 C69 P57633 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 48285 T187 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 48286 T229 C69 P57633 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 48293 T187 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 48296 T187 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 48296 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 48297 T187 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 48298 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:37229",
[junit4:junit4]   2>   "state":"recovering",
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"5",
[junit4:junit4]   2>   "node_name":"127.0.0.1:37229_",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard":"shard2",
[junit4:junit4]   2>   "core":"collection1"}
[junit4:junit4]   2> 48306 T187 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 48306 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 48307 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 48307 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 48308 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 48308 T187 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 48309 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 48309 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 48312 T187 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 48313 T229 C69 P57633 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 48314 T187 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369399176820/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection/
[junit4:junit4]   2> 48316 T187 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >d3c35777
[junit4:junit4]   2> 48317 T187 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 48319 T187 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection
[junit4:junit4]   2> 48320 T187 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection/index/
[junit4:junit4]   2> 48321 T187 oasc.SolrCore.initIndex WARN [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 48318 T190 C70 P38199 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 48322 T187 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection/index
[junit4:junit4]   2> 48323 T190 C70 P38199 oasc.SolrCore.execute [collection1] webapp= path=/replication params={qt=/replication&version=2&command=indexversion&wt=javabin} status=0 QTime=6 
[junit4:junit4]   2> 48325 T229 C69 P57633 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 48325 T229 C69 P57633 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 48326 T229 C69 P57633 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 48326 T187 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >20defd2d lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >4bb6a476),segFN=segments_1,generation=1}
[junit4:junit4]   2> 48327 T187 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 48328 T189 C70 P38199 oasc.SolrCore.execute [collection1] webapp= path=/replication params={qt=/replication&version=2&generation=2&command=filelist&wt=javabin} status=0 QTime=0 
[junit4:junit4]   2> 48330 T229 C69 P57633 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 48331 T187 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 48332 T229 C69 P57633 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/index.20130524073953517
[junit4:junit4]   2> 48332 T187 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 48333 T229 C69 P57633 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >3c4e209d lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >e0d64e52) fullCopy=false
[junit4:junit4]   2> 48334 T187 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 48336 T187 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 48340 T188 C70 P38199 oasc.SolrCore.execute [collection1] webapp= path=/replication params={checksum=true&qt=/replication&generation=2&command=filecontent&file=segments_2&wt=filestream} status=0 QTime=2 
[junit4:junit4]   2> 48344 T187 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 48345 T187 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 48347 T187 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 48349 T229 C69 P57633 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 48349 T187 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 48350 T187 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 48351 T229 C69 P57633 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 48352 T229 C69 P57633 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 48353 T187 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 48356 T229 C69 P57633 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >a7fd2ed3 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >d5a6759f),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >a7fd2ed3 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >d5a6759f),segFN=segments_2,generation=2}
[junit4:junit4]   2> 48357 T187 oass.SolrIndexSearcher.<init> Opening Searcher< at >e45aac88 main
[junit4:junit4]   2> 48359 T187 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection/tlog
[junit4:junit4]   2> 48360 T187 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 48361 T187 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 48357 T229 C69 P57633 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 48366 T229 C69 P57633 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 48369 T229 C69 P57633 oass.SolrIndexSearcher.<init> Opening Searcher< at >a347dcf0 main
[junit4:junit4]   2> 48373 T228 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher< at >a347dcf0 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 48375 T229 C69 P57633 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/index.20130524073953517 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/index.20130524073953517;done=true>>]
[junit4:junit4]   2> 48376 T229 C69 P57633 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/index.20130524073953517
[junit4:junit4]   2> 48376 T229 C69 P57633 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/index.20130524073953517
[junit4:junit4]   2> 48377 T229 C69 P57633 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 48377 T229 C69 P57633 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 48378 T229 C69 P57633 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 48380 T229 C69 P57633 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 48379 T250 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher< at >e45aac88 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 48384 T229 C69 P57633 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 48387 T187 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4]   2> 48632 T204 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4]   2> 48633 T204 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={state=recovering&onlyIfLeader=true&checkLive=true&action=PREPRECOVERY&version=2&coreNodeName=5&wt=javabin&nodeName=127.0.0.1:37229_&core=collection1} status=0 QTime=1002 
[junit4:junit4]   2> 49813 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 49814 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:57633",
[junit4:junit4]   2>   "state":"active",
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"4",
[junit4:junit4]   2>   "node_name":"127.0.0.1:57633_",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "core":"collection1"}
[junit4:junit4]   2> 49853 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:38199",
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:38199_",
[junit4:junit4]   2>   "numShards":"1",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "roles":"none",
[junit4:junit4]   2>   "collection":"onenodecollection",
[junit4:junit4]   2>   "shard":null,
[junit4:junit4]   2>   "core":"onenodecollectioncore"}
[junit4:junit4]   2> 49854 T175 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4]   2> 49854 T175 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4]   2> 49859 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 49859 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 49859 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 49859 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 49859 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 49859 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 50391 T187 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4]   2> 50392 T187 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:38199 collection:onenodecollection shard:shard1
[junit4:junit4]   2> 50393 T187 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4]   2> 50401 T187 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 50403 T187 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 50404 T187 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 50404 T187 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:38199/onenodecollectioncore/
[junit4:junit4]   2> 50405 T187 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 50405 T187 oasc.SyncStrategy.syncToMe http://127.0.0.1:38199/onenodecollectioncore/ has no replicas
[junit4:junit4]   2> 50406 T187 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:38199/onenodecollectioncore/
[junit4:junit4]   2> 50406 T187 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4]   2> ASYNC  NEW_CORE C71 name=collection1 org.apache.solr.core.SolrCore< at >78f9e89a url=http://127.0.0.1:37229/collection1 node=127.0.0.1:37229_ C71_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:37229, state=recovering, node_name=127.0.0.1:37229_, collection=collection1, shard=shard2, core=collection1}
[junit4:junit4]   2> 50635 T246 C71 P37229 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:46224/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 50635 T246 C71 P37229 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:37229 START replicas=[http://127.0.0.1:46224/collection1/] nUpdates=100
[junit4:junit4]   2> 50636 T246 C71 P37229 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 50636 T246 C71 P37229 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 50636 T246 C71 P37229 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 50637 T246 C71 P37229 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 50637 T246 C71 P37229 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 50637 T246 C71 P37229 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:46224/collection1/. core=collection1
[junit4:junit4]   2> 50638 T246 C71 P37229 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C72 name=collection1 org.apache.solr.core.SolrCore< at >d56d7629 url=http://127.0.0.1:46224/collection1 node=127.0.0.1:46224_ C72_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:46224, state=active, node_name=127.0.0.1:46224_, collection=collection1, shard=shard2, core=collection1, leader=true}
[junit4:junit4]   2> 50644 T206 C72 P46224 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&qt=/get&distrib=false&version=2&wt=javabin} status=0 QTime=0 
[junit4:junit4]   2> 50647 T204 C72 P46224 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 50648 T204 C72 P46224 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >17f45be3 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >7fc37ff1),segFN=segments_1,generation=1}
[junit4:junit4]   2> 50649 T204 C72 P46224 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 50650 T204 C72 P46224 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >17f45be3 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >7fc37ff1),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >17f45be3 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >7fc37ff1),segFN=segments_2,generation=2}
[junit4:junit4]   2> 50650 T204 C72 P46224 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 50651 T204 C72 P46224 oass.SolrIndexSearcher.<init> Opening Searcher< at >86deacda realtime
[junit4:junit4]   2> 50652 T204 C72 P46224 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 50652 T204 C72 P46224 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={softCommit=false&commit_end_point=true&commit=true&version=2&waitSearcher=true&wt=javabin&openSearcher=false} {commit=} 0 5
[junit4:junit4]   2> 50653 T246 C71 P37229 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 50654 T246 C71 P37229 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 50655 T206 C72 P46224 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 50656 T206 C72 P46224 oasc.SolrCore.execute [collection1] webapp= path=/replication params={qt=/replication&version=2&command=indexversion&wt=javabin} status=0 QTime=1 
[junit4:junit4]   2> 50657 T246 C71 P37229 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 50658 T246 C71 P37229 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 50658 T246 C71 P37229 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 50660 T204 C72 P46224 oasc.SolrCore.execute [collection1] webapp= path=/replication params={qt=/replication&version=2&generation=2&command=filelist&wt=javabin} status=0 QTime=0 
[junit4:junit4]   2> 50661 T246 C71 P37229 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 50662 T246 C71 P37229 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/index.20130524073955849
[junit4:junit4]   2> 50663 T246 C71 P37229 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >6363de1d lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >1c87207b) fullCopy=false
[junit4:junit4]   2> 50666 T203 C72 P46224 oasc.SolrCore.execute [collection1] webapp= path=/replication params={checksum=true&qt=/replication&generation=2&command=filecontent&file=segments_2&wt=filestream} status=0 QTime=1 
[junit4:junit4]   2> ASYNC  NEW_CORE C73 name=collection1 org.apache.solr.core.SolrCore< at >78f9e89a url=http://127.0.0.1:37229/collection1 node=127.0.0.1:37229_ C73_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:37229, state=recovering, node_name=127.0.0.1:37229_, collection=collection1, shard=shard2, core=collection1}
[junit4:junit4]   2> 50675 T246 C73 P37229 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 50676 T246 C73 P37229 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 50677 T246 C73 P37229 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 50678 T246 C73 P37229 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >118a9f31 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >a5c39f22),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >118a9f31 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >a5c39f22),segFN=segments_2,generation=2}
[junit4:junit4]   2> 50679 T246 C73 P37229 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 50679 T246 C73 P37229 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 50680 T246 C73 P37229 oass.SolrIndexSearcher.<init> Opening Searcher< at >d7985d8f main
[junit4:junit4]   2> 50681 T245 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher< at >d7985d8f main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 50682 T246 C73 P37229 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/index.20130524073955849 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/index.20130524073955849;done=true>>]
[junit4:junit4]   2> 50682 T246 C73 P37229 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/index.20130524073955849
[junit4:junit4]   2> 50683 T246 C73 P37229 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/index.20130524073955849
[junit4:junit4]   2> 50683 T246 C73 P37229 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 50683 T246 C73 P37229 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 50684 T246 C73 P37229 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 50684 T246 C73 P37229 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 50685 T246 C73 P37229 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 51369 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 51376 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:37229",
[junit4:junit4]   2>   "state":"active",
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"5",
[junit4:junit4]   2>   "node_name":"127.0.0.1:37229_",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard":"shard2",
[junit4:junit4]   2>   "core":"collection1"}
[junit4:junit4]   2> 51450 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 51450 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 51450 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 51450 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 51450 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 51450 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 51477 T187 oasc.ZkController.register We are http://127.0.0.1:38199/onenodecollectioncore/ and leader is http://127.0.0.1:38199/onenodecollectioncore/
[junit4:junit4]   2> 51478 T187 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:38199
[junit4:junit4]   2> 51478 T187 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 51479 T187 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4]   2> 51481 T187 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 51483 T187 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection&action=CREATE&version=2&numShards=1&name=onenodecollectioncore&wt=javabin&roles=none&collection=onenodecollection} status=0 QTime=3849 
[junit4:junit4]   2> 51484 T146 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4]   2> 51486 T146 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 52488 T146 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 52959 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 52961 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:38199",
[junit4:junit4]   2>   "state":"active",
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"127.0.0.1:38199__onenodecollectioncore",
[junit4:junit4]   2>   "node_name":"127.0.0.1:38199_",
[junit4:junit4]   2>   "numShards":"1",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "roles":"none",
[junit4:junit4]   2>   "collection":"onenodecollection",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "core":"onenodecollectioncore"}
[junit4:junit4]   2> 52965 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 52965 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 52965 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 52965 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 52965 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 52965 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 53490 T146 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 53491 T146 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4]   2> 53492 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 53511 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 53517 T254 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >911429c6 name:ZooKeeperConnection Watcher:127.0.0.1:41015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 53518 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 53584 T146 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 45451
[junit4:junit4]   2> 53585 T146 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=178491587
[junit4:junit4]   2> 54472 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 54473 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:45451",
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"1",
[junit4:junit4]   2>   "node_name":"127.0.0.1:45451_",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "collection":"control_collection",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "core":"collection1"}
[junit4:junit4]   2> 54477 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 54477 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 54477 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 54477 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 54477 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 55591 T146 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 55592 T146 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 55594 T146 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore< at >1a846202
[junit4:junit4]   2> 55603 T146 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 55604 T146 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 55605 T146 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 55606 T146 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 55607 T146 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 55608 T146 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   2> 55609 T146 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/control/data/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/control/data/index;done=false>>]
[junit4:junit4]   2> 55609 T146 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/control/data/index
[junit4:junit4]   2> 55610 T146 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/control/data [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/control/data;done=false>>]
[junit4:junit4]   2> 55611 T146 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/control/data
[junit4:junit4]   2> 55613 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 55613 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 55613 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 55613 T175 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89744944041689091-127.0.0.1:45451_-n_0000000000) am no longer a leader.
[junit4:junit4]   2> 55614 T174 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 55615 T210 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 55615 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 55615 T174 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 55617 T243 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 55617 T194 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 55618 T226 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 55619 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 55619 T194 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 55640 T146 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4]   2> 55693 T146 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 38199
[junit4:junit4]   2> 55694 T146 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=-726346679
[junit4:junit4]   2> 55721 T194 oasc.Overseer.start Overseer (id=89744944041689094-127.0.0.1:38199_-n_0000000001) starting
[junit4:junit4]   2> 55725 T256 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 55727 T255 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 55729 T255 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 55731 T255 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:45451",
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"1",
[junit4:junit4]   2>   "node_name":"127.0.0.1:45451_",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "collection":"control_collection",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "core":"collection1"}
[junit4:junit4]   2> 55735 T255 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:38199",
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"127.0.0.1:38199__onenodecollectioncore",
[junit4:junit4]   2>   "node_name":"127.0.0.1:38199_",
[junit4:junit4]   2>   "roles":"none",
[junit4:junit4]   2>   "collection":"onenodecollection",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "core":"onenodecollectioncore"}
[junit4:junit4]   2> 55738 T255 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:38199",
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"2",
[junit4:junit4]   2>   "node_name":"127.0.0.1:38199_",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "core":"collection1"}
[junit4:junit4]   2> 55742 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 55742 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 55742 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 55742 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 57722 T146 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 57723 T146 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 57725 T146 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4]   2> 57727 T146 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore< at >abeec515
[junit4:junit4]   2> 57736 T146 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 57737 T146 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 57738 T146 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 57739 T146 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 57740 T146 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 57741 T146 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   2> 57742 T146 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty1/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty1/index;done=false>>]
[junit4:junit4]   2> 57743 T146 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty1/index
[junit4:junit4]   2> 57744 T146 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty1 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty1;done=false>>]
[junit4:junit4]   2> 57745 T146 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty1
[junit4:junit4]   2> 57746 T146 oasc.SolrCore.close [onenodecollectioncore]  CLOSING SolrCore org.apache.solr.core.SolrCore< at >89a9f5cd
[junit4:junit4]   2> 57757 T146 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 57758 T146 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 57759 T146 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 57760 T146 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 57761 T146 oasc.SolrCore.closeSearcher [onenodecollectioncore] Closing main searcher on request.
[junit4:junit4]   2> 57762 T146 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   2> 57763 T146 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection/index;done=false>>]
[junit4:junit4]   2> 57763 T146 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection/index
[junit4:junit4]   2> 57764 T146 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection;done=false>>]
[junit4:junit4]   2> 57765 T146 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection
[junit4:junit4]   2> 57766 T255 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89744944041689094-127.0.0.1:38199_-n_0000000001) am no longer a leader.
[junit4:junit4]   2> 57767 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 57767 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 57768 T194 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 57768 T194 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 57768 T210 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 57769 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 57768 T226 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 57770 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 57770 T243 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 57772 T210 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 57772 T226 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 57775 T210 oasc.Overseer.start Overseer (id=89744944041689096-127.0.0.1:46224_-n_0000000002) starting
[junit4:junit4]   2> 57775 T226 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4:junit4]   2> 57775 T226 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4:junit4]   2> 57776 T226 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 57776 T226 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:57633/collection1/
[junit4:junit4]   2> 57777 T226 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 57777 T226 oasc.SyncStrategy.syncToMe http://127.0.0.1:57633/collection1/ has no replicas
[junit4:junit4]   2> 57777 T226 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:57633/collection1/
[junit4:junit4]   2> 57778 T226 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 57778 T258 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 57784 T257 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 57786 T257 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 57789 T257 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:38199",
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"2",
[junit4:junit4]   2>   "node_name":"127.0.0.1:38199_",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "core":"collection1"}
[junit4:junit4]   2> 57790 T146 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4]   2> 57792 T257 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:38199",
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"127.0.0.1:38199__onenodecollectioncore",
[junit4:junit4]   2>   "node_name":"127.0.0.1:38199_",
[junit4:junit4]   2>   "numShards":"1",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "roles":"none",
[junit4:junit4]   2>   "collection":"onenodecollection",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "core":"onenodecollectioncore"}
[junit4:junit4]   2> 57818 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 57818 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 57818 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 57842 T146 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 46224
[junit4:junit4]   2> 57842 T146 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1193150784
[junit4:junit4]   2> 58844 T146 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 58845 T146 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 58850 T146 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore< at >d56d7629
[junit4:junit4]   2> 58856 T146 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 58857 T146 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 58857 T146 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 58858 T146 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 58859 T146 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 58860 T146 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   2> 58860 T146 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty2/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty2/index;done=false>>]
[junit4:junit4]   2> 58861 T146 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty2/index
[junit4:junit4]   2> 58861 T146 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty2 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty2;done=false>>]
[junit4:junit4]   2> 58862 T146 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty2
[junit4:junit4]   2> 58863 T257 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89744944041689096-127.0.0.1:46224_-n_0000000002) am no longer a leader.
[junit4:junit4]   2> 58866 T243 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 58866 T226 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 58868 T243 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4:junit4]   2> 58868 T243 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4:junit4]   2> 58869 T243 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 58869 T226 oasc.Overseer.start Overseer (id=89744944041689098-127.0.0.1:57633_-n_0000000003) starting
[junit4:junit4]   2> 58869 T243 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:37229/collection1/
[junit4:junit4]   2> 58870 T243 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:37229 START replicas=[http://127.0.0.1:46224/collection1/] nUpdates=100
[junit4:junit4]   2> 58871 T243 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:37229 DONE.  We have no versions.  sync failed.
[junit4:junit4]   2> 58871 T243 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4]   2> 58872 T243 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4]   2> 58872 T243 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:37229/collection1/
[junit4:junit4]   2> 58872 T243 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 58874 T261 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 58875 T226 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 58876 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 58877 T260 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 58878 T146 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4]   2> 58879 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 58879 T260 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 58881 T260 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:46224",
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"3",
[junit4:junit4]   2>   "node_name":"127.0.0.1:46224_",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard":"shard2",
[junit4:junit4]   2>   "core":"collection1"}
[junit4:junit4]   2> 58882 T243 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 58885 T260 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:46224",
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"3",
[junit4:junit4]   2>   "node_name":"127.0.0.1:46224_",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard":"shard2",
[junit4:junit4]   2>   "core":"collection1"}
[junit4:junit4]   2> 58894 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 58894 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 58932 T146 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 57633
[junit4:junit4]   2> 58934 T146 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1797337163
[junit4:junit4]   2> 59935 T146 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 59936 T146 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 59938 T146 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore< at >42344a6d
[junit4:junit4]   2> 59944 T146 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 59945 T146 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 59946 T146 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 59946 T146 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 59950 T146 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 59951 T146 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   2> 59951 T146 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3;done=false>>]
[junit4:junit4]   2> 59952 T146 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3
[junit4:junit4]   2> 59953 T146 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/index;done=false>>]
[junit4:junit4]   2> 59954 T146 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/index
[junit4:junit4]   2> 59956 T260 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89744944041689098-127.0.0.1:57633_-n_0000000003) am no longer a leader.
[junit4:junit4]   2> 59958 T243 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 59960 T243 oasc.Overseer.start Overseer (id=89744944041689100-127.0.0.1:37229_-n_0000000004) starting
[junit4:junit4]   2> 59963 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 59963 T263 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 59966 T243 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 59967 T262 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 59968 T262 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 59969 T262 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:57633",
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"4",
[junit4:junit4]   2>   "node_name":"127.0.0.1:57633_",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "core":"collection1"}
[junit4:junit4]   2> 59972 T262 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:57633",
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"4",
[junit4:junit4]   2>   "node_name":"127.0.0.1:57633_",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "core":"collection1"}
[junit4:junit4]   2> 59977 T146 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4]   2> 60030 T146 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 37229
[junit4:junit4]   2> 60031 T146 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1003633917
[junit4:junit4]   2> 60060 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 60165 T210 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 60166 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 60166 T210 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 61061 T146 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 61062 T146 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 61064 T146 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore< at >78f9e89a
[junit4:junit4]   2> 61082 T146 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 61082 T146 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 61083 T146 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 61084 T146 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 61088 T146 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 61088 T146 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   2> 61089 T146 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/index;done=false>>]
[junit4:junit4]   2> 61090 T146 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/index
[junit4:junit4]   2> 61091 T146 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4;done=false>>]
[junit4:junit4]   2> 61091 T146 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4
[junit4:junit4]   2> 61093 T262 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89744944041689100-127.0.0.1:37229_-n_0000000004) am no longer a leader.
[junit4:junit4]   2> 61094 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 61094 T243 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 61095 T243 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 61116 T146 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4]   2> 61178 T146 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4]   2> 61180 T146 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:41015 41015
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   1> / (2)
[junit4:junit4]   1> DATA:
[junit4:junit4]   1>     
[junit4:junit4]   1>  /solr (7)
[junit4:junit4]   1>   /solr/configs (1)
[junit4:junit4]   1>    /solr/configs/conf1 (9)
[junit4:junit4]   1>     /solr/configs/conf1/old_synonyms.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/protwords.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/stopwords.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/synonyms.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/schema.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/currency.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/open-exchange-rates.json (0)
[junit4:junit4]   1>     DATA:
[junit4:junit4]   1>         {
[junit4:junit4]   1>           "disclaimer": "This data is not real, it was synthetically created to match currency.xml.  It is modeled after the data format available from openexchangerates.org.  See https://openexchangerates.org/documentation for details",
[junit4:junit4]   1>           "license": "http://www.apache.org/licenses/LICENSE-2.0",
[junit4:junit4]   1>           "timestamp": 1332070464,
[junit4:junit4]   1>         
[junit4:junit4]   1>         
[junit4:junit4]   1>           "IMPORTANT NOTE": "In order for tests to work, this data must be kept in sync with ./currency.xml",
[junit4:junit4]   1>         
[junit4:junit4]   1>         
[junit4:junit4]   1>           "base": "USD",
[junit4:junit4]   1>           "rates": {
[junit4:junit4]   1>             "USD": 1,
[junit4:junit4]   1>             "JPY": 81.29,
[junit4:junit4]   1>             "EUR": 2.5,
[junit4:junit4]   1>             "GBP": 0.5,
[junit4:junit4]   1>             "MXN": 2.0
[junit4:junit4]   1>           }
[junit4:junit4]   1>         }
[junit4:junit4]   1>         
[junit4:junit4]   1>     /solr/configs/conf1/solrconfig.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>   /solr/overseer (3)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       
[junit4:junit4]   1>    /solr/overseer/queue (0)
[junit4:junit4]   1>    /solr/overseer/collection-queue-work (0)
[junit4:junit4]   1>    /solr/overseer/queue-work (0)
[junit4:junit4]   1>   /solr/overseer_elect (2)
[junit4:junit4]   1>    /solr/overseer_elect/leader (0)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"id":"89744944041689091-127.0.0.1:45451_-n_0000000000"}
[junit4:junit4]   1>    /solr/overseer_elect/election (5)
[junit4:junit4]   1>     /solr/overseer_elect/election/89744944041689094-127.0.0.1:38199_-n_0000000001 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89744944041689096-127.0.0.1:46224_-n_0000000002 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89744944041689100-127.0.0.1:37229_-n_0000000004 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89744944041689098-127.0.0.1:57633_-n_0000000003 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89744944041689091-127.0.0.1:45451_-n_0000000000 (0)
[junit4:junit4]   1>   /solr/collections (3)
[junit4:junit4]   1>    /solr/collections/control_collection (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/control_collection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4]   1>        /solr/collections/control_collection/leader_elect/shard1/election/89744944041689091-1-n_0000000000 (0)
[junit4:junit4]   1>     /solr/collections/control_collection/leaders (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:45451",
[junit4:junit4]   1>            "node_name":"127.0.0.1:45451_",
[junit4:junit4]   1>            "core":"collection1"}
[junit4:junit4]   1>     /solr/collections/control_collection/shards (0)
[junit4:junit4]   1>    /solr/collections/collection1 (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/collection1/leader_elect (2)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard1/election (2)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89744944041689094-2-n_0000000000 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89744944041689098-4-n_0000000001 (0)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard2 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard2/election (2)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard2/election/89744944041689096-3-n_0000000000 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard2/election/89744944041689100-5-n_0000000001 (0)
[junit4:junit4]   1>     /solr/collections/collection1/leaders (2)
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:38199",
[junit4:junit4]   1>            "node_name":"127.0.0.1:38199_",
[junit4:junit4]   1>            "core":"collection1"}
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard2 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:46224",
[junit4:junit4]   1>            "node_name":"127.0.0.1:46224_",
[junit4:junit4]   1>            "core":"collection1"}
[junit4:junit4]   1>     /solr/collections/collection1/shards (0)
[junit4:junit4]   1>    /solr/collections/onenodecollection (2)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {
[junit4:junit4]   1>          "router":"compositeId",
[junit4:junit4]   1>          "configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/onenodecollection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/onenodecollection/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/onenodecollection/leader_elect/shard1/election (1)
[junit4:junit4]   1>        /solr/collections/onenodecollection/leader_elect/shard1/election/89744944041689094-127.0.0.1:38199__onenodecollectioncore-n_0000000000 (0)
[junit4:junit4]   1>     /solr/collections/onenodecollection/leaders (1)
[junit4:junit4]   1>      /solr/collections/onenodecollection/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:38199",
[junit4:junit4]   1>            "node_name":"127.0.0.1:38199_",
[junit4:junit4]   1>            "core":"onenodecollectioncore"}
[junit4:junit4]   1>   /solr/aliases.json (0)
[junit4:junit4]   1>   /solr/live_nodes (5)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:57633_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:38199_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:46224_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:45451_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:37229_ (0)
[junit4:junit4]   1>   /solr/clusterstate.json (0)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       {
[junit4:junit4]   1>         "control_collection":{
[junit4:junit4]   1>           "shards":{"shard1":{
[junit4:junit4]   1>               "range":"80000000-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{"1":{
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:45451",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:45451_",
[junit4:junit4]   1>                   "collection":"control_collection",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "leader":"true"}}}},
[junit4:junit4]   1>           "router":"compositeId"},
[junit4:junit4]   1>         "onenodecollection":{
[junit4:junit4]   1>           "shards":{"shard1":{
[junit4:junit4]   1>               "range":"80000000-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{"127.0.0.1:38199__onenodecollectioncore":{
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:38199",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:38199_",
[junit4:junit4]   1>                   "roles":"none",
[junit4:junit4]   1>                   "collection":"onenodecollection",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "core":"onenodecollectioncore",
[junit4:junit4]   1>                   "leader":"true"}}}},
[junit4:junit4]   1>           "router":"compositeId"},
[junit4:junit4]   1>         "collection1":{
[junit4:junit4]   1>           "shards":{
[junit4:junit4]   1>             "shard1":{
[junit4:junit4]   1>               "range":"80000000-ffffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{
[junit4:junit4]   1>                 "2":{
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:38199",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:38199_",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "leader":"true"},
[junit4:junit4]   1>                 "4":{
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:57633",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:57633_",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "core":"collection1"}}},
[junit4:junit4]   1>             "shard2":{
[junit4:junit4]   1>               "range":"0-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{
[junit4:junit4]   1>                 "3":{
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:46224",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:46224_",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "shard":"shard2",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "leader":"true"},
[junit4:junit4]   1>                 "5":{
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:37229",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:37229_",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "shard":"shard2",
[junit4:junit4]   1>                   "core":"collection1"}}}},
[junit4:junit4]   1>           "router":"compositeId"}}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=201FBD2F856FF64B -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=et_EE_PREEURO -Dtests.timezone=America/Bahia_Banderas -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR   36.0s J1 | BasicDistributedZk2Test.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:46224/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([201FBD2F856FF64B:A1F93337F2309677]:0)
[junit4:junit4]    > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4:junit4]    > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4]    > at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4:junit4]    > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
[junit4:junit4]    > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
[junit4:junit4]    > at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:198)
[junit4:junit4]    > at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:90)
[junit4:junit4]    > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4]    > at java.lang.Thread.run(Thread.java:780)
[junit4:junit4]   2> 61231 T146 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 36045 T145 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4]   2> 61257 T226 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 61257 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 61258 T226 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> NOTE: test params are: codec=Lucene42: {}, docValues:{}, sim=DefaultSimilarity, locale=et_EE_PREEURO, timezone=America/Bahia_Banderas
[junit4:junit4]   2> NOTE: Linux 3.2.0-41-generic x86/IBM Corporation 1.7.0 (32-bit)/cpus=8,threads=3,free=11008624,total=82116608
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestCollationField, SolrCmdDistributorTest, FieldAnalysisRequestHandlerTest, TestCSVLoader, BasicDistributedZk2Test]
[junit4:junit4] Completed on J1 in 37.00s, 1 test, 1 error <<< FAILURES!

[...truncated 890 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:386: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:379: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:437: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1243: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:887: There were test failures: 296 suites, 1234 tests, 1 error, 14 ignored (8 assumptions)

Total time: 45 minutes 1 second
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/ibm-j9-jdk7 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe< at >lucene.apache.org
For additional commands, e-mail: dev-help< at >lucene.apache.org

[jira] [Commented] (SOLR-4470) Support for basic http auth in internal solr requests

Jan Høydahl (JIRA — 2013-05-24T12:56:21

    [ https://issues.apache.org/jira/browse/SOLR-4470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13666271#comment-13666271 ] 

Jan Høydahl commented on SOLR-4470:
-----------------------------------

bq. You can override the CredentialsProviders or you can choose to use the default one (finding credentials in VM params) but not set the VM params using command-line.

Could make an implementation which reads a system-basic-auth.properties from ZK (given your ZK is encrypted). That would be useful once the other issue about securing ZK is solved.

Or one which takes in a {{-DinternalAuthCredentialsBasicAuthFile=/path/to/file}} and then that file would not be readable only to the user running Jetty/Tomcat.

I agree that since this is pluggable, it is not a showstopper - users can choose how paranoid they are and plug whatever suits them.

Q: Would it make sense to make {{CurrentInternalRequestFactory}} or {{InterSolrNodeAuthCredentialsFactory}} pluggable through solr.xml? Currently you need to patch and build Solr to change it, right?
                

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Re: [JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.8.0-ea-b89) - Build # 5736 - Still Failing!

Martijn v Groningen — 2013-05-24T11:36:39

Committed a fix for this. Hopefully it doesn't fail any more.


On 23 May 2013 23:14, Policeman Jenkins Server <jenkins< at >thetaphi.de> wrote:

[jira] [Commented] (LUCENE-5016) Sampling can break FacetResult labeling

Shai Erera (JIRA — 2013-05-24T10:53:21

    [ https://issues.apache.org/jira/browse/LUCENE-5016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13666201#comment-13666201 ] 

Shai Erera commented on LUCENE-5016:
------------------------------------

Can you attach a simple testcase exposing the problem? Not sure that I follow what's wrong. About not labeling, I doubt it will gain us anything. Labeling is not very expensive, and labels are LRU-cached. Also, considering all the work that's done during search processing, the labeling part is less than marginal.
                

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (LUCENE-5015) Unexpected performance difference between SamplingAccumulator and StandardFacetAccumulator

Shai Erera (JIRA — 2013-05-24T10:51:21

    [ https://issues.apache.org/jira/browse/LUCENE-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13666190#comment-13666190 ] 

Shai Erera commented on LUCENE-5015:
------------------------------------

Looking at SamplingParams, isn't overSampleFactor enough to decide whether to over sample or not? It can default to not oversample, with the default Amortized fixer or some other default (2.0?) if fixer is Takmi. Then user can change it, and if he passes a fixer which requires over sampling, he should set that too.
                

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[JENKINS] Lucene-Solr-Tests-trunk-Java7 - Build # 4013 - Still Failing

Apache Jenkins Server — 2013-05-24T10:48:56

Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java7/4013/

1 tests failed.
REGRESSION:  org.apache.lucene.search.grouping.AllGroupHeadsCollectorTest.testBasic

Error Message:
testBasic(org.apache.lucene.search.grouping.AllGroupHeadsCollectorTest): Insane FieldCache usage(s) found expected:<0> but was:<2>

Stack Trace:
java.lang.AssertionError: testBasic(org.apache.lucene.search.grouping.AllGroupHeadsCollectorTest): Insane FieldCache usage(s) found expected:<0> but was:<2>
at __randomizedtesting.SeedInfo.seed([8E0C3B24782019CD:25F62631A7FC9FE3]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.lucene.util.LuceneTestCase.assertSaneFieldCaches(LuceneTestCase.java:613)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:55)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 7042 lines...]
[junit4:junit4] Suite: org.apache.lucene.search.grouping.AllGroupHeadsCollectorTest
[junit4:junit4]   2> *** BEGIN testBasic(org.apache.lucene.search.grouping.AllGroupHeadsCollectorTest): Insane FieldCache usage(s) ***
[junit4:junit4]   2> VALUEMISMATCH: Multiple distinct value objects for ParallelAtomicReader(FilterAtomicReader(_0(5.0):C3))+id
[junit4:junit4]   2> 'ParallelAtomicReader(FilterAtomicReader(_0(5.0):C3))'=>'id',int,null=>org.apache.lucene.search.FieldCacheImpl$IntsFromArray#13779014 (size =~ 48 bytes)
[junit4:junit4]   2> 'ParallelAtomicReader(FilterAtomicReader(_0(5.0):C3))'=>'id',int,org.apache.lucene.search.FieldCache.DEFAULT_INT_PARSER=>org.apache.lucene.search.FieldCacheImpl$IntsFromArray#13779014 (size =~ 48 bytes)
[junit4:junit4]   2> 'ParallelAtomicReader(FilterAtomicReader(_0(5.0):C3))'=>'id',class org.apache.lucene.index.SortedDocValues,0.5=>org.apache.lucene.search.FieldCacheImpl$SortedDocValuesImpl#1928215889 (size =~ 232 bytes)
[junit4:junit4]   2> 
[junit4:junit4]   2> VALUEMISMATCH: Multiple distinct value objects for ParallelAtomicReader(FilterAtomicReader(_1(5.0):C5))+id
[junit4:junit4]   2> 'ParallelAtomicReader(FilterAtomicReader(_1(5.0):C5))'=>'id',class org.apache.lucene.index.SortedDocValues,0.5=>org.apache.lucene.search.FieldCacheImpl$SortedDocValuesImpl#1939143291 (size =~ 232 bytes)
[junit4:junit4]   2> 'ParallelAtomicReader(FilterAtomicReader(_1(5.0):C5))'=>'id',int,org.apache.lucene.search.FieldCache.DEFAULT_INT_PARSER=>org.apache.lucene.search.FieldCacheImpl$IntsFromArray#1883049357 (size =~ 56 bytes)
[junit4:junit4]   2> 'ParallelAtomicReader(FilterAtomicReader(_1(5.0):C5))'=>'id',int,null=>org.apache.lucene.search.FieldCacheImpl$IntsFromArray#1883049357 (size =~ 56 bytes)
[junit4:junit4]   2> 
[junit4:junit4]   2> *** END testBasic(org.apache.lucene.search.grouping.AllGroupHeadsCollectorTest): Insane FieldCache usage(s) ***
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=AllGroupHeadsCollectorTest -Dtests.method=testBasic -Dtests.seed=8E0C3B24782019CD -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ja_JP_JP_#u-ca-japanese -Dtests.timezone=Africa/Harare -Dtests.file.encoding=US-ASCII
[junit4:junit4] FAILURE 0.39s J1 | AllGroupHeadsCollectorTest.testBasic <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: testBasic(org.apache.lucene.search.grouping.AllGroupHeadsCollectorTest): Insane FieldCache usage(s) found expected:<0> but was:<2>
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([8E0C3B24782019CD:25F62631A7FC9FE3]:0)
[junit4:junit4]    > at org.apache.lucene.util.LuceneTestCase.assertSaneFieldCaches(LuceneTestCase.java:613)
[junit4:junit4]    > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> NOTE: test params are: codec=Lucene42: {sort3=PostingsFormat(name=Direct), id=PostingsFormat(name=Memory doPackFST= true), content=PostingsFormat(name=Direct), sort2=PostingsFormat(name=NestedPulsing), author=PostingsFormat(name=Memory doPackFST= true), sort1=PostingsFormat(name=Memory doPackFST= true), group=PostingsFormat(name=Memory doPackFST= true)}, docValues:{author_dv=DocValuesFormat(name=Disk), group_dv=DocValuesFormat(name=Disk)}, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {content=LM Jelinek-Mercer(0.100000), author=BM25(k1=1.2,b=0.75)}, locale=ja_JP_JP_#u-ca-japanese, timezone=Africa/Harare
[junit4:junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=1,free=69735672,total=116391936
[junit4:junit4]   2> NOTE: All tests run in this JVM: [GroupFacetCollectorTest, AllGroupsCollectorTest, AllGroupHeadsCollectorTest]
[junit4:junit4] Completed on J1 in 5.41s, 2 tests, 1 failure <<< FAILURES!

[...truncated 13 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:380: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:360: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/build.xml:554: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:1825: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/module-build.xml:61: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:1240: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:884: There were test failures: 6 suites, 12 tests, 1 failure

Total time: 16 minutes 11 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe< at >lucene.apache.org
For additional commands, e-mail: dev-help< at >lucene.apache.org

[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_21) - Build # 5807 - Failure!

Policeman Jenkins Server — 2013-05-24T10:37:06

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/5807/
Java: 32bit/jdk1.7.0_21 -client -XX:+UseG1GC

1 tests failed.
FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
Server at http://127.0.0.1:40578/collection1 returned non ok status:503, message:Service Unavailable

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:40578/collection1 returned non ok status:503, message:Service Unavailable
at __randomizedtesting.SeedInfo.seed([7208F616AD4E319B:F3EE780EDA1151A7]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.index_specific(AbstractFullDistribZkTestBase.java:592)
at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:304)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:117)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 9312 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4]   2> 159358 T542 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4]   2> 159361 T542 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369390734579
[junit4:junit4]   2> 159362 T542 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 159362 T543 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 159462 T542 oasc.ZkTestServer.run start zk server on port:37853
[junit4:junit4]   2> 159463 T542 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 159493 T549 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >81ab73 name:ZooKeeperConnection Watcher:127.0.0.1:37853 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 159494 T542 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 159494 T542 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 159499 T542 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 159500 T551 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >9cd85b name:ZooKeeperConnection Watcher:127.0.0.1:37853/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 159500 T542 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 159500 T542 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 159502 T542 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 159504 T542 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 159505 T542 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 159507 T542 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 159508 T542 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 159511 T542 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 159512 T542 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 159514 T542 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 159515 T542 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 159517 T542 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 159518 T542 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 159520 T542 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 159520 T542 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 159522 T542 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 159523 T542 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 159525 T542 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 159525 T542 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 159527 T542 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 159528 T542 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 159529 T542 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 159530 T542 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 159595 T542 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 159600 T542 oejs.AbstractConnector.doStart Started SelectChannelConnector< at >127.0.0.1:35250
[junit4:junit4]   2> 159601 T542 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 159601 T542 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 159602 T542 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369390734749
[junit4:junit4]   2> 159602 T542 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369390734749/solr.xml
[junit4:junit4]   2> 159602 T542 oasc.CoreContainer.<init> New CoreContainer 31820610
[junit4:junit4]   2> 159603 T542 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369390734749/'
[junit4:junit4]   2> 159603 T542 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369390734749/'
[junit4:junit4]   2> 159664 T542 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 159664 T542 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 159665 T542 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 159665 T542 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 159665 T542 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 159666 T542 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 159666 T542 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 159666 T542 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 159667 T542 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 159667 T542 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 159670 T542 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 159671 T542 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:37853/solr
[junit4:junit4]   2> 159671 T542 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 159672 T542 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 159673 T562 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >129228d name:ZooKeeperConnection Watcher:127.0.0.1:37853 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 159674 T542 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 159675 T542 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 159678 T542 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 159679 T564 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >f45460 name:ZooKeeperConnection Watcher:127.0.0.1:37853/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 159679 T542 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 159681 T542 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4]   2> 159683 T542 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4]   2> 159685 T542 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 159687 T542 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35250_
[junit4:junit4]   2> 159687 T542 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35250_
[junit4:junit4]   2> 159689 T542 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 159697 T542 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 159698 T542 oasc.Overseer.start Overseer (id=89744391181500419-127.0.0.1:35250_-n_0000000000) starting
[junit4:junit4]   2> 159700 T542 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4]   2> 159703 T566 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 159703 T542 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 159705 T542 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 159706 T542 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 159708 T565 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 159710 T567 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369390734749/collection1
[junit4:junit4]   2> 159711 T567 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 159711 T567 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 159711 T567 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 159712 T567 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369390734749/collection1/'
[junit4:junit4]   2> 159713 T567 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369390734749/collection1/lib/README' to classloader
[junit4:junit4]   2> 159713 T567 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369390734749/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 159746 T567 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 159784 T567 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 159786 T567 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 159790 T567 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 160215 T567 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 160221 T567 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 160224 T567 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 160233 T567 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 160236 T567 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 160239 T567 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 160240 T567 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 160240 T567 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 160240 T567 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 160241 T567 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 160241 T567 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 160241 T567 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 160242 T567 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369390734749/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/control/data/
[junit4:junit4]   2> 160242 T567 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >51f26e
[junit4:junit4]   2> 160242 T567 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 160243 T567 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/control/data
[junit4:junit4]   2> 160243 T567 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/control/data/index/
[junit4:junit4]   2> 160243 T567 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 160243 T567 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/control/data/index
[junit4:junit4]   2> 160245 T567 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >1b95730 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >108e71a),segFN=segments_1,generation=1}
[junit4:junit4]   2> 160245 T567 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 160247 T567 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 160247 T567 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 160247 T567 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 160248 T567 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 160248 T567 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 160248 T567 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 160249 T567 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 160249 T567 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 160249 T567 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 160252 T567 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 160254 T567 oass.SolrIndexSearcher.<init> Opening Searcher< at >397bdc main
[junit4:junit4]   2> 160255 T567 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/control/data/tlog
[junit4:junit4]   2> 160255 T567 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 160255 T567 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 160259 T568 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher< at >397bdc main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 160260 T567 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 160260 T567 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 161211 T565 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 161211 T565 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":null,
[junit4:junit4]   2>   "numShards":"1",
[junit4:junit4]   2>   "shard":null,
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"collection1",
[junit4:junit4]   2>   "collection":"control_collection",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:35250_",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:35250"}
[junit4:junit4]   2> 161212 T565 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 161212 T565 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4]   2> 161215 T564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 161261 T567 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 161262 T567 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:35250 collection:control_collection shard:shard1
[junit4:junit4]   2> 161263 T567 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 161268 T567 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 161270 T567 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 161271 T567 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 161271 T567 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:35250/collection1/
[junit4:junit4]   2> 161271 T567 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 161272 T567 oasc.SyncStrategy.syncToMe http://127.0.0.1:35250/collection1/ has no replicas
[junit4:junit4]   2> 161272 T567 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:35250/collection1/
[junit4:junit4]   2> 161272 T567 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 162718 T565 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 162724 T564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 162731 T567 oasc.ZkController.register We are http://127.0.0.1:35250/collection1/ and leader is http://127.0.0.1:35250/collection1/
[junit4:junit4]   2> 162731 T567 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35250
[junit4:junit4]   2> 162732 T567 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 162732 T567 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 162732 T567 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 162733 T567 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 162734 T542 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 162735 T542 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 162735 T542 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 162740 T542 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 162742 T542 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 162743 T571 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >125d7e5 name:ZooKeeperConnection Watcher:127.0.0.1:37853/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 162743 T542 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 162744 T542 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 162746 T542 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 162823 T542 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 162825 T542 oejs.AbstractConnector.doStart Started SelectChannelConnector< at >127.0.0.1:41343
[junit4:junit4]   2> 162826 T542 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 162826 T542 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 162827 T542 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369390737964
[junit4:junit4]   2> 162827 T542 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369390737964/solr.xml
[junit4:junit4]   2> 162827 T542 oasc.CoreContainer.<init> New CoreContainer 5566683
[junit4:junit4]   2> 162828 T542 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369390737964/'
[junit4:junit4]   2> 162828 T542 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369390737964/'
[junit4:junit4]   2> 162878 T542 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 162879 T542 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 162879 T542 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 162879 T542 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 162880 T542 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 162880 T542 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 162880 T542 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 162881 T542 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 162881 T542 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 162882 T542 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 162885 T542 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 162885 T542 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:37853/solr
[junit4:junit4]   2> 162886 T542 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 162887 T542 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 162889 T582 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >18baf57 name:ZooKeeperConnection Watcher:127.0.0.1:37853 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 162890 T542 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 162894 T542 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 162900 T542 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 162902 T584 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >1c2e827 name:ZooKeeperConnection Watcher:127.0.0.1:37853/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 162902 T542 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 162905 T542 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 163908 T542 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41343_
[junit4:junit4]   2> 163909 T542 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41343_
[junit4:junit4]   2> 163912 T564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 163912 T571 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 163913 T584 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 163914 T564 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 163918 T585 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369390737964/collection1
[junit4:junit4]   2> 163918 T585 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 163919 T585 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 163919 T585 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 163920 T585 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369390737964/collection1/'
[junit4:junit4]   2> 163921 T585 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369390737964/collection1/lib/README' to classloader
[junit4:junit4]   2> 163921 T585 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369390737964/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 163956 T585 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 163994 T585 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 163995 T585 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 163999 T585 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 164228 T565 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 164229 T565 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"127.0.0.1:35250__collection1",
[junit4:junit4]   2>   "numShards":"1",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"active",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"collection1",
[junit4:junit4]   2>   "collection":"control_collection",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:35250_",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:35250"}
[junit4:junit4]   2> 164232 T571 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 164232 T584 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 164234 T564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 164463 T585 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 164470 T585 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 164473 T585 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 164481 T585 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 164484 T585 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 164487 T585 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 164488 T585 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 164489 T585 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 164489 T585 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 164490 T585 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 164491 T585 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 164491 T585 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 164491 T585 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369390737964/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty1/
[junit4:junit4]   2> 164492 T585 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >51f26e
[junit4:junit4]   2> 164492 T585 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 164493 T585 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty1
[junit4:junit4]   2> 164493 T585 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty1/index/
[junit4:junit4]   2> 164494 T585 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 164494 T585 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty1/index
[junit4:junit4]   2> 164496 T585 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >7a5452 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >f84f65),segFN=segments_1,generation=1}
[junit4:junit4]   2> 164496 T585 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 164499 T585 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 164499 T585 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 164500 T585 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 164501 T585 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 164502 T585 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 164502 T585 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 164502 T585 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 164503 T585 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 164504 T585 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 164507 T585 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 164510 T585 oass.SolrIndexSearcher.<init> Opening Searcher< at >170210d main
[junit4:junit4]   2> 164510 T585 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty1/tlog
[junit4:junit4]   2> 164511 T585 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 164511 T585 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 164517 T586 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher< at >170210d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 164520 T585 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 164521 T585 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 165738 T565 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 165739 T565 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":null,
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":null,
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"collection1",
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:41343_",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:41343"}
[junit4:junit4]   2> 165739 T565 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 165739 T565 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4]   2> 165745 T564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 165745 T584 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 165745 T571 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 166522 T585 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 166522 T585 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:41343 collection:collection1 shard:shard1
[junit4:junit4]   2> 166523 T585 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 166528 T585 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 166530 T585 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 166530 T585 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 166530 T585 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:41343/collection1/
[junit4:junit4]   2> 166531 T585 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 166531 T585 oasc.SyncStrategy.syncToMe http://127.0.0.1:41343/collection1/ has no replicas
[junit4:junit4]   2> 166531 T585 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:41343/collection1/
[junit4:junit4]   2> 166532 T585 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 167249 T565 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 167256 T571 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 167256 T584 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 167256 T564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 167288 T585 oasc.ZkController.register We are http://127.0.0.1:41343/collection1/ and leader is http://127.0.0.1:41343/collection1/
[junit4:junit4]   2> 167288 T585 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:41343
[junit4:junit4]   2> 167288 T585 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 167288 T585 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 167289 T585 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 167290 T585 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 167291 T542 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 167292 T542 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 167292 T542 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 167362 T542 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 167364 T542 oejs.AbstractConnector.doStart Started SelectChannelConnector< at >127.0.0.1:39257
[junit4:junit4]   2> 167365 T542 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 167366 T542 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 167366 T542 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369390742512
[junit4:junit4]   2> 167366 T542 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369390742512/solr.xml
[junit4:junit4]   2> 167367 T542 oasc.CoreContainer.<init> New CoreContainer 20627208
[junit4:junit4]   2> 167367 T542 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369390742512/'
[junit4:junit4]   2> 167368 T542 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369390742512/'
[junit4:junit4]   2> 167418 T542 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 167418 T542 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 167418 T542 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 167419 T542 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 167419 T542 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 167420 T542 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 167420 T542 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 167420 T542 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 167421 T542 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 167421 T542 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 167424 T542 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 167425 T542 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:37853/solr
[junit4:junit4]   2> 167425 T542 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 167426 T542 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 167427 T598 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >b45ce5 name:ZooKeeperConnection Watcher:127.0.0.1:37853 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 167428 T542 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 167429 T542 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 167432 T542 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 167433 T600 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >1f37461 name:ZooKeeperConnection Watcher:127.0.0.1:37853/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 167434 T542 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 167436 T542 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 168439 T542 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39257_
[junit4:junit4]   2> 168441 T542 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39257_
[junit4:junit4]   2> 168443 T564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 168443 T571 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 168444 T584 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 168444 T600 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 168445 T564 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 168445 T584 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 168445 T571 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 168449 T601 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369390742512/collection1
[junit4:junit4]   2> 168449 T601 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 168450 T601 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 168450 T601 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 168451 T601 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369390742512/collection1/'
[junit4:junit4]   2> 168452 T601 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369390742512/collection1/lib/README' to classloader
[junit4:junit4]   2> 168452 T601 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369390742512/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 168481 T601 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 168518 T601 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 168519 T601 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 168524 T601 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 168760 T565 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 168761 T565 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"127.0.0.1:41343__collection1",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"active",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"collection1",
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:41343_",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:41343"}
[junit4:junit4]   2> 168765 T584 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 168765 T600 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 168765 T571 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 168765 T564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 168949 T601 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 168955 T601 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 168958 T601 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 168968 T601 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 168971 T601 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 168974 T601 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 168974 T601 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 168975 T601 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 168975 T601 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 168976 T601 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 168976 T601 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 168977 T601 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 168977 T601 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369390742512/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty2/
[junit4:junit4]   2> 168977 T601 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >51f26e
[junit4:junit4]   2> 168977 T601 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 168978 T601 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty2
[junit4:junit4]   2> 168978 T601 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty2/index/
[junit4:junit4]   2> 168978 T601 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 168979 T601 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty2/index
[junit4:junit4]   2> 168980 T601 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >ca4123 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >bf3c3),segFN=segments_1,generation=1}
[junit4:junit4]   2> 168980 T601 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 168982 T601 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 168982 T601 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 168983 T601 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 168983 T601 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 168984 T601 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 168984 T601 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 168984 T601 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 168985 T601 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 168985 T601 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 168988 T601 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 168990 T601 oass.SolrIndexSearcher.<init> Opening Searcher< at >114564c main
[junit4:junit4]   2> 168991 T601 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty2/tlog
[junit4:junit4]   2> 168991 T601 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 168991 T601 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 168999 T602 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher< at >114564c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 169001 T601 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 169001 T601 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 170269 T565 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 170269 T565 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":null,
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":null,
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"collection1",
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:39257_",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:39257"}
[junit4:junit4]   2> 170270 T565 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 170270 T565 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4]   2> 170273 T564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 170274 T571 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 170273 T584 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 170273 T600 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 171003 T601 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 171003 T601 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:39257 collection:collection1 shard:shard2
[junit4:junit4]   2> 171004 T601 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 171010 T601 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 171012 T601 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 171012 T601 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 171013 T601 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:39257/collection1/
[junit4:junit4]   2> 171013 T601 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 171014 T601 oasc.SyncStrategy.syncToMe http://127.0.0.1:39257/collection1/ has no replicas
[junit4:junit4]   2> 171014 T601 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:39257/collection1/
[junit4:junit4]   2> 171014 T601 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 171778 T565 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 171786 T564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 171786 T571 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 171786 T584 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 171786 T600 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 171820 T601 oasc.ZkController.register We are http://127.0.0.1:39257/collection1/ and leader is http://127.0.0.1:39257/collection1/
[junit4:junit4]   2> 171820 T601 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:39257
[junit4:junit4]   2> 171820 T601 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 171821 T601 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 171821 T601 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 171823 T601 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 171824 T542 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 171824 T542 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 171824 T542 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 171893 T542 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 171896 T542 oejs.AbstractConnector.doStart Started SelectChannelConnector< at >127.0.0.1:40578
[junit4:junit4]   2> 171897 T542 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 171897 T542 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 171897 T542 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369390747045
[junit4:junit4]   2> 171898 T542 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369390747045/solr.xml
[junit4:junit4]   2> 171898 T542 oasc.CoreContainer.<init> New CoreContainer 13901573
[junit4:junit4]   2> 171899 T542 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369390747045/'
[junit4:junit4]   2> 171899 T542 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369390747045/'
[junit4:junit4]   2> 171950 T542 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 171950 T542 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 171950 T542 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 171951 T542 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 171951 T542 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 171952 T542 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 171952 T542 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 171952 T542 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 171953 T542 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 171953 T542 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 171956 T542 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 171957 T542 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:37853/solr
[junit4:junit4]   2> 171957 T542 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 171958 T542 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 171959 T614 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >1546c6e name:ZooKeeperConnection Watcher:127.0.0.1:37853 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 171960 T542 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 171961 T542 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 171964 T542 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 171965 T616 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >1ad3836 name:ZooKeeperConnection Watcher:127.0.0.1:37853/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 171966 T542 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 171969 T542 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 172971 T542 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40578_
[junit4:junit4]   2> 172972 T542 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40578_
[junit4:junit4]   2> 172974 T571 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 172974 T584 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 172975 T616 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 172974 T564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 172975 T600 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 172976 T600 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 172977 T571 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 172977 T564 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 172978 T584 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 172981 T617 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369390747045/collection1
[junit4:junit4]   2> 172982 T617 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 172982 T617 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 172982 T617 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 172984 T617 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369390747045/collection1/'
[junit4:junit4]   2> 172984 T617 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369390747045/collection1/lib/README' to classloader
[junit4:junit4]   2> 172984 T617 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369390747045/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 173013 T617 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 173051 T617 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 173052 T617 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 173056 T617 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 173290 T565 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 173292 T565 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"127.0.0.1:39257__collection1",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":"shard2",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"active",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"collection1",
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:39257_",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:39257"}
[junit4:junit4]   2> 173299 T616 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 173299 T564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 173299 T584 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 173299 T571 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 173299 T600 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 173525 T617 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 173532 T617 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 173536 T617 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 173547 T617 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 173551 T617 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 173557 T617 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 173558 T617 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 173559 T617 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 173560 T617 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 173561 T617 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 173561 T617 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 173561 T617 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 173562 T617 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369390747045/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty3/
[junit4:junit4]   2> 173562 T617 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >51f26e
[junit4:junit4]   2> 173563 T617 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 173563 T617 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty3
[junit4:junit4]   2> 173564 T617 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty3/index/
[junit4:junit4]   2> 173564 T617 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 173564 T617 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty3/index
[junit4:junit4]   2> 173566 T617 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >a3ae20 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >1ce4de8),segFN=segments_1,generation=1}
[junit4:junit4]   2> 173567 T617 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 173569 T617 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 173569 T617 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 173570 T617 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 173571 T617 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 173572 T617 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 173572 T617 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 173573 T617 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 173574 T617 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 173574 T617 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 173578 T617 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 173581 T617 oass.SolrIndexSearcher.<init> Opening Searcher< at >b17119 main
[junit4:junit4]   2> 173581 T617 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty3/tlog
[junit4:junit4]   2> 173582 T617 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 173582 T617 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 173587 T618 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher< at >b17119 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 173588 T617 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 173588 T617 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 174805 T565 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 174806 T565 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":null,
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":null,
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"collection1",
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:40578_",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:40578"}
[junit4:junit4]   2> 174807 T565 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 174807 T565 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4]   2> 174826 T564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 174826 T600 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 174826 T571 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 174826 T584 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 174826 T616 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 175594 T617 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 175594 T617 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40578 collection:collection1 shard:shard1
[junit4:junit4]   2> 175597 T617 oasc.ZkController.register We are http://127.0.0.1:40578/collection1/ and leader is http://127.0.0.1:41343/collection1/
[junit4:junit4]   2> 175597 T617 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40578
[junit4:junit4]   2> 175597 T617 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 175597 T617 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C198 name=collection1 org.apache.solr.core.SolrCore< at >b80f78 url=http://127.0.0.1:40578/collection1 node=127.0.0.1:40578_ C198_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:40578_, base_url=http://127.0.0.1:40578}
[junit4:junit4]   2> 175598 T619 C198 P40578 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 175598 T617 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 175598 T619 C198 P40578 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 175599 T619 C198 P40578 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 175599 T619 C198 P40578 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 175599 T542 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 175600 T542 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 175600 T619 C198 P40578 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 175600 T542 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 175604 T579 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:40578__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   2> 175671 T542 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 175673 T542 oejs.AbstractConnector.doStart Started SelectChannelConnector< at >127.0.0.1:45338
[junit4:junit4]   2> 175674 T542 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 175674 T542 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 175675 T542 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369390750820
[junit4:junit4]   2> 175675 T542 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369390750820/solr.xml
[junit4:junit4]   2> 175675 T542 oasc.CoreContainer.<init> New CoreContainer 7278944
[junit4:junit4]   2> 175676 T542 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369390750820/'
[junit4:junit4]   2> 175676 T542 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369390750820/'
[junit4:junit4]   2> 175727 T542 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 175727 T542 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 175728 T542 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 175728 T542 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 175729 T542 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 175729 T542 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 175729 T542 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 175730 T542 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 175730 T542 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 175730 T542 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 175733 T542 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 175734 T542 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:37853/solr
[junit4:junit4]   2> 175734 T542 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 175735 T542 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 175736 T631 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >13df72c name:ZooKeeperConnection Watcher:127.0.0.1:37853 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 175737 T542 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 175738 T542 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 175742 T542 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 175743 T633 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >b4bff name:ZooKeeperConnection Watcher:127.0.0.1:37853/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 175743 T542 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 175746 T542 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 176331 T565 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 176332 T565 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"127.0.0.1:40578__collection1",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"recovering",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"collection1",
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:40578_",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:40578"}
[junit4:junit4]   2> 176334 T616 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 176334 T600 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 176335 T633 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 176335 T571 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 176335 T564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 176335 T584 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 176605 T579 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:40578__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4]   2> 176605 T579 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:40578__collection1&state=recovering&nodeName=127.0.0.1:40578_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001 
[junit4:junit4]   2> 176748 T542 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45338_
[junit4:junit4]   2> 176749 T542 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45338_
[junit4:junit4]   2> 176751 T564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 176751 T571 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 176751 T584 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 176751 T633 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 176751 T616 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 176752 T600 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 176752 T564 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 176753 T600 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 176753 T584 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 176753 T571 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 176754 T633 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 176755 T616 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 176758 T634 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369390750820/collection1
[junit4:junit4]   2> 176758 T634 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 176759 T634 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 176759 T634 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 176760 T634 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369390750820/collection1/'
[junit4:junit4]   2> 176760 T634 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369390750820/collection1/lib/README' to classloader
[junit4:junit4]   2> 176761 T634 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369390750820/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 176790 T634 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 176827 T634 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 176829 T634 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 176833 T634 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 177261 T634 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 177268 T634 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 177271 T634 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 177284 T634 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 177287 T634 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 177290 T634 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 177291 T634 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 177291 T634 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 177291 T634 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 177292 T634 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 177293 T634 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 177293 T634 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 177293 T634 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369390750820/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty4/
[junit4:junit4]   2> 177293 T634 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >51f26e
[junit4:junit4]   2> 177294 T634 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 177294 T634 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty4
[junit4:junit4]   2> 177294 T634 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty4/index/
[junit4:junit4]   2> 177295 T634 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 177295 T634 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty4/index
[junit4:junit4]   2> 177296 T634 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >e3559d lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >bf6637),segFN=segments_1,generation=1}
[junit4:junit4]   2> 177296 T634 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 177298 T634 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 177299 T634 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 177299 T634 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 177300 T634 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 177300 T634 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 177301 T634 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 177301 T634 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 177302 T634 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 177302 T634 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 177304 T634 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 177307 T634 oass.SolrIndexSearcher.<init> Opening Searcher< at >9f832d main
[junit4:junit4]   2> 177307 T634 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty4/tlog
[junit4:junit4]   2> 177307 T634 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 177308 T634 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 177315 T635 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher< at >9f832d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 177317 T634 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 177318 T634 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 177839 T565 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 177840 T565 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":null,
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":null,
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"collection1",
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:45338_",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:45338"}
[junit4:junit4]   2> 177840 T565 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 177840 T565 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4]   2> 177843 T616 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 177843 T564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 177844 T633 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 177844 T600 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 177843 T571 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 177844 T584 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 178319 T634 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 178319 T634 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:45338 collection:collection1 shard:shard2
[junit4:junit4]   2> 178322 T634 oasc.ZkController.register We are http://127.0.0.1:45338/collection1/ and leader is http://127.0.0.1:39257/collection1/
[junit4:junit4]   2> 178323 T634 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45338
[junit4:junit4]   2> 178323 T634 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 178323 T634 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C199 name=collection1 org.apache.solr.core.SolrCore< at >1855381 url=http://127.0.0.1:45338/collection1 node=127.0.0.1:45338_ C199_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:45338_, base_url=http://127.0.0.1:45338}
[junit4:junit4]   2> 178324 T636 C199 P45338 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 178324 T634 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 178324 T636 C199 P45338 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 178325 T636 C199 P45338 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 178325 T636 C199 P45338 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 178325 T542 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 178326 T542 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 178326 T636 C199 P45338 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 178326 T542 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 178329 T542 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 178330 T596 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:45338__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   2> 178331 T542 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 178336 T580 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369390737964/onenodecollectioncore
[junit4:junit4]   2> 178336 T580 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4]   2> 178337 T580 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4]   2> 178338 T580 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 178339 T580 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 178339 T580 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4]   2> 178341 T580 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4]   2> 178343 T580 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369390737964/onenodecollectioncore/'
[junit4:junit4]   2> 178384 T580 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 178423 T580 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 178424 T580 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 178430 T580 oass.IndexSchema.readSchema [onenodecollectioncore] Schema name=test
[junit4:junit4]   2> ASYNC  NEW_CORE C200 name=collection1 org.apache.solr.core.SolrCore< at >b80f78 url=http://127.0.0.1:40578/collection1 node=127.0.0.1:40578_ C200_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:40578_, base_url=http://127.0.0.1:40578}
[junit4:junit4]   2> 178606 T619 C200 P40578 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:41343/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 178607 T619 C200 P40578 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:40578 START replicas=[http://127.0.0.1:41343/collection1/] nUpdates=100
[junit4:junit4]   2> 178607 T619 C200 P40578 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 178608 T619 C200 P40578 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 178608 T619 C200 P40578 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 178608 T619 C200 P40578 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 178608 T619 C200 P40578 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 178609 T619 C200 P40578 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:41343/collection1/. core=collection1
[junit4:junit4]   2> 178609 T619 C200 P40578 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C201 name=collection1 org.apache.solr.core.SolrCore< at >12a69c8 url=http://127.0.0.1:41343/collection1 node=127.0.0.1:41343_ C201_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:41343_, base_url=http://127.0.0.1:41343, leader=true}
[junit4:junit4]   2> 178616 T577 C201 P41343 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 178617 T578 C201 P41343 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 178618 T578 C201 P41343 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >7a5452 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >f84f65),segFN=segments_1,generation=1}
[junit4:junit4]   2> 178619 T578 C201 P41343 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 178619 T578 C201 P41343 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >7a5452 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >f84f65),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >7a5452 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >f84f65),segFN=segments_2,generation=2}
[junit4:junit4]   2> 178620 T578 C201 P41343 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 178620 T578 C201 P41343 oass.SolrIndexSearcher.<init> Opening Searcher< at >85d634 realtime
[junit4:junit4]   2> 178621 T578 C201 P41343 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 178621 T578 C201 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4]   2> 178622 T619 C200 P40578 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 178623 T619 C200 P40578 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 178624 T579 C201 P41343 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 178624 T579 C201 P41343 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 178625 T619 C200 P40578 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 178625 T619 C200 P40578 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 178625 T619 C200 P40578 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 178627 T578 C201 P41343 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0 
[junit4:junit4]   2> 178628 T619 C200 P40578 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 178629 T619 C200 P40578 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty3/index.20130524061913845
[junit4:junit4]   2> 178629 T619 C200 P40578 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >14e3a72 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >9e2d1c) fullCopy=false
[junit4:junit4]   2> 178631 T577 C201 P41343 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
[junit4:junit4]   2> 178633 T619 C200 P40578 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 178633 T619 C200 P40578 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 178633 T619 C200 P40578 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 178634 T619 C200 P40578 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >a3ae20 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >1ce4de8),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >a3ae20 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >1ce4de8),segFN=segments_2,generation=2}
[junit4:junit4]   2> 178635 T619 C200 P40578 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 178635 T619 C200 P40578 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 178635 T619 C200 P40578 oass.SolrIndexSearcher.<init> Opening Searcher< at >586007 main
[junit4:junit4]   2> 178637 T618 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher< at >586007 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 178638 T619 C200 P40578 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty3/index.20130524061913845 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty3/index.20130524061913845;done=true>>]
[junit4:junit4]   2> 178638 T619 C200 P40578 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty3/index.20130524061913845
[junit4:junit4]   2> 178638 T619 C200 P40578 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty3/index.20130524061913845
[junit4:junit4]   2> 178638 T619 C200 P40578 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 178638 T619 C200 P40578 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 178639 T619 C200 P40578 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 178639 T619 C200 P40578 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 178640 T619 C200 P40578 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 178875 T580 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 178882 T580 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 178885 T580 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 178894 T580 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 178897 T580 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 178900 T580 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 178901 T580 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 178901 T580 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 178902 T580 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 178903 T580 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 178903 T580 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 178903 T580 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 178904 T580 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369390737964/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369390734579/onenodecollection/
[junit4:junit4]   2> 178904 T580 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer< at >51f26e
[junit4:junit4]   2> 178904 T580 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 178905 T580 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369390734579/onenodecollection
[junit4:junit4]   2> 178905 T580 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369390734579/onenodecollection/index/
[junit4:junit4]   2> 178906 T580 oasc.SolrCore.initIndex WARN [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369390734579/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 178906 T580 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369390734579/onenodecollection/index
[junit4:junit4]   2> 178907 T580 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >1350aa1 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >131a783),segFN=segments_1,generation=1}
[junit4:junit4]   2> 178908 T580 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 178909 T580 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 178910 T580 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 178910 T580 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 178911 T580 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 178911 T580 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 178912 T580 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 178912 T580 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 178913 T580 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 178913 T580 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 178916 T580 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 178918 T580 oass.SolrIndexSearcher.<init> Opening Searcher< at >1e3d731 main
[junit4:junit4]   2> 178919 T580 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369390734579/onenodecollection/tlog
[junit4:junit4]   2> 178919 T580 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 178920 T580 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 178923 T640 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher< at >1e3d731 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 178924 T580 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4]   2> 179348 T565 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 179349 T565 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"127.0.0.1:45338__collection1",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":"shard2",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"recovering",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"collection1",
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:45338_",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:45338"}
[junit4:junit4]   2> 179351 T565 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"127.0.0.1:40578__collection1",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"active",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"collection1",
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:40578_",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:40578"}
[junit4:junit4]   2> 179356 T565 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":null,
[junit4:junit4]   2>   "numShards":"1",
[junit4:junit4]   2>   "shard":null,
[junit4:junit4]   2>   "roles":"none",
[junit4:junit4]   2>   "state":"down",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"onenodecollectioncore",
[junit4:junit4]   2>   "collection":"onenodecollection",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:41343_",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:41343"}
[junit4:junit4]   2> 179356 T565 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4]   2> 179357 T565 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4]   2> 179360 T616 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 179360 T564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 179360 T571 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 179360 T600 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 179361 T584 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 179360 T633 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 179925 T580 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4]   2> 179925 T580 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:41343 collection:onenodecollection shard:shard1
[junit4:junit4]   2> 179926 T580 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4]   2> 179931 T580 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 179933 T580 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 179933 T580 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 179934 T580 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:41343/onenodecollectioncore/
[junit4:junit4]   2> 179934 T580 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 179934 T580 oasc.SyncStrategy.syncToMe http://127.0.0.1:41343/onenodecollectioncore/ has no replicas
[junit4:junit4]   2> 179935 T580 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:41343/onenodecollectioncore/
[junit4:junit4]   2> 179935 T580 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4]   2> 180331 T596 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:45338__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4]   2> 180331 T596 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:45338__collection1&state=recovering&nodeName=127.0.0.1:45338_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2001 
[junit4:junit4]   2> 180866 T565 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 180871 T616 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 180872 T571 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 180872 T633 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 180872 T564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 180872 T600 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 180871 T584 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 180892 T580 oasc.ZkController.register We are http://127.0.0.1:41343/onenodecollectioncore/ and leader is http://127.0.0.1:41343/onenodecollectioncore/
[junit4:junit4]   2> 180893 T580 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:41343
[junit4:junit4]   2> 180893 T580 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 180893 T580 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4]   2> 180894 T580 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 180895 T580 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=1&roles=none&name=onenodecollectioncore&action=CREATE&collection=onenodecollection&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369390734579/onenodecollection&wt=javabin&version=2} status=0 QTime=2559 
[junit4:junit4]   2> 180896 T542 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4]   2> 180897 T542 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 181899 T542 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> ASYNC  NEW_CORE C202 name=collection1 org.apache.solr.core.SolrCore< at >1855381 url=http://127.0.0.1:45338/collection1 node=127.0.0.1:45338_ C202_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:45338_, base_url=http://127.0.0.1:45338}
[junit4:junit4]   2> 182332 T636 C202 P45338 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:39257/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 182333 T636 C202 P45338 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:45338 START replicas=[http://127.0.0.1:39257/collection1/] nUpdates=100
[junit4:junit4]   2> 182333 T636 C202 P45338 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 182333 T636 C202 P45338 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 182333 T636 C202 P45338 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 182334 T636 C202 P45338 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 182334 T636 C202 P45338 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 182334 T636 C202 P45338 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:39257/collection1/. core=collection1
[junit4:junit4]   2> 182334 T636 C202 P45338 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C203 name=collection1 org.apache.solr.core.SolrCore< at >136c67d url=http://127.0.0.1:39257/collection1 node=127.0.0.1:39257_ C203_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:39257_, base_url=http://127.0.0.1:39257, leader=true}
[junit4:junit4]   2> 182358 T596 C203 P39257 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 182362 T593 C203 P39257 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 182363 T593 C203 P39257 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >ca4123 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >bf3c3),segFN=segments_1,generation=1}
[junit4:junit4]   2> 182364 T593 C203 P39257 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 182364 T593 C203 P39257 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >ca4123 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >bf3c3),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >ca4123 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >bf3c3),segFN=segments_2,generation=2}
[junit4:junit4]   2> 182364 T593 C203 P39257 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 182365 T593 C203 P39257 oass.SolrIndexSearcher.<init> Opening Searcher< at >19fd5c9 realtime
[junit4:junit4]   2> 182365 T593 C203 P39257 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 182365 T593 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 3
[junit4:junit4]   2> ASYNC  NEW_CORE C204 name=collection1 org.apache.solr.core.SolrCore< at >1855381 url=http://127.0.0.1:45338/collection1 node=127.0.0.1:45338_ C204_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:45338_, base_url=http://127.0.0.1:45338}
[junit4:junit4]   2> 182366 T636 C204 P45338 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 182367 T636 C204 P45338 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 182368 T594 C203 P39257 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 182368 T594 C203 P39257 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 182369 T636 C204 P45338 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 182369 T636 C204 P45338 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 182369 T636 C204 P45338 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 182371 T596 C203 P39257 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0 
[junit4:junit4]   2> 182372 T636 C204 P45338 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 182372 T636 C204 P45338 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty4/index.20130524061917589
[junit4:junit4]   2> 182373 T636 C204 P45338 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >169873b lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >88d959) fullCopy=false
[junit4:junit4]   2> 182375 T593 C203 P39257 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
[junit4:junit4]   2> 182376 T636 C204 P45338 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 182376 T565 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 182377 T636 C204 P45338 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 182377 T636 C204 P45338 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 182377 T565 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"127.0.0.1:41343__onenodecollectioncore",
[junit4:junit4]   2>   "numShards":"1",
[junit4:junit4]   2>   "shard":"shard1",
[junit4:junit4]   2>   "roles":"none",
[junit4:junit4]   2>   "state":"active",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"onenodecollectioncore",
[junit4:junit4]   2>   "collection":"onenodecollection",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:41343_",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:41343"}
[junit4:junit4]   2> 182378 T636 C204 P45338 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >e3559d lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >bf6637),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >e3559d lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >bf6637),segFN=segments_2,generation=2}
[junit4:junit4]   2> 182378 T636 C204 P45338 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 182379 T636 C204 P45338 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 182379 T636 C204 P45338 oass.SolrIndexSearcher.<init> Opening Searcher< at >b9f35c main
[junit4:junit4]   2> 182381 T635 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher< at >b9f35c main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 182381 T616 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 182381 T571 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 182381 T636 C204 P45338 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty4/index.20130524061917589 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty4/index.20130524061917589;done=true>>]
[junit4:junit4]   2> 182381 T564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 182381 T584 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 182382 T636 C204 P45338 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty4/index.20130524061917589
[junit4:junit4]   2> 182381 T600 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 182381 T633 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 182383 T636 C204 P45338 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369390734578/jetty4/index.20130524061917589
[junit4:junit4]   2> 182383 T636 C204 P45338 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 182384 T636 C204 P45338 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 182384 T636 C204 P45338 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 182384 T636 C204 P45338 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 182385 T636 C204 P45338 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 182900 T542 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 182901 T542 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4]   2> 182902 T542 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C205 name=onenodecollectioncore org.apache.solr.core.SolrCore< at >45207a url=http://127.0.0.1:41343/onenodecollectioncore node=127.0.0.1:41343_ C205_STATE=coll:onenodecollection core:onenodecollectioncore props:{shard=shard1, roles=none, state=active, core=onenodecollectioncore, collection=onenodecollection, node_name=127.0.0.1:41343_, base_url=http://127.0.0.1:41343, leader=true}
[junit4:junit4]   2> 182923 T577 C205 P41343 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >1350aa1 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >131a783),segFN=segments_1,generation=1}
[junit4:junit4]   2> 182924 T577 C205 P41343 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 182925 T577 C205 P41343 oasup.LogUpdateProcessor.finish [onenodecollectioncore] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1435910283607408640)]} 0 2
[junit4:junit4]   2> 182933 T579 C205 P41343 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 182935 T579 C205 P41343 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >1350aa1 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >131a783),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >1350aa1 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >131a783),segFN=segments_2,generation=2}
[junit4:junit4]   2> 182936 T579 C205 P41343 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 182936 T579 C205 P41343 oass.SolrIndexSearcher.<init> Opening Searcher< at >1617037 main
[junit4:junit4]   2> 182937 T579 C205 P41343 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 182939 T640 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher< at >1617037 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):C1)}
[junit4:junit4]   2> 182939 T579 C205 P41343 oasup.LogUpdateProcessor.finish [onenodecollectioncore] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4]   2> 182943 T578 C205 P41343 oasc.SolrCore.execute [onenodecollectioncore] webapp= path=/select params={q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=1 
[junit4:junit4]   2> 182944 T542 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 182948 T580 C205 P41343 oasc.SolrCore.execute [onenodecollectioncore] webapp= path=/select params={q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0 
[junit4:junit4]   2> 182953 T577 C205 P41343 oasup.LogUpdateProcessor.finish [onenodecollectioncore] webapp= path=/update params={wt=javabin&version=2} {add=[2 (1435910283637817344)]} 0 2
[junit4:junit4]   2> 182956 T579 C205 P41343 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 182958 T579 C205 P41343 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >1350aa1 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >131a783),segFN=segments_2,generation=2}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >1350aa1 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >131a783),segFN=segments_3,generation=3}
[junit4:junit4]   2> 182959 T579 C205 P41343 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4]   2> 182959 T579 C205 P41343 oass.SolrIndexSearcher.<init> Opening Searcher< at >14b139a main
[junit4:junit4]   2> 182960 T579 C205 P41343 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 182961 T640 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher< at >14b139a main{StandardDirectoryReader(segments_3:5:nrt _0(5.0):C1 _1(5.0):C1)}
[junit4:junit4]   2> 182962 T579 C205 P41343 oasup.LogUpdateProcessor.finish [onenodecollectioncore] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4]   2> 182966 T578 C205 P41343 oasc.SolrCore.execute [onenodecollectioncore] webapp= path=/select params={q=*:*&wt=javabin&version=2&rows=0} hits=2 status=0 QTime=1 
[junit4:junit4]   2> ASYNC  NEW_CORE C206 name=collection1 org.apache.solr.core.SolrCore< at >e9fd url=http://127.0.0.1:35250/collection1 node=127.0.0.1:35250_ C206_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:35250_, base_url=http://127.0.0.1:35250, leader=true}
[junit4:junit4]   2> 182975 T560 C206 P35250 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >1b95730 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >108e71a),segFN=segments_1,generation=1}
[junit4:junit4]   2> 182976 T560 C206 P35250 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 182980 T560 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1435910283660886016)]} 0 6
[junit4:junit4]   2> ASYNC  NEW_CORE C207 name=collection1 org.apache.solr.core.SolrCore< at >b80f78 url=http://127.0.0.1:40578/collection1 node=127.0.0.1:40578_ C207_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:40578_, base_url=http://127.0.0.1:40578}
[junit4:junit4]   2> 182995 T612 C207 P40578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1435910283671371776)]} 0 3
[junit4:junit4]   2> ASYNC  NEW_CORE C208 name=collection1 org.apache.solr.core.SolrCore< at >12a69c8 url=http://127.0.0.1:41343/collection1 node=127.0.0.1:41343_ C208_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:41343_, base_url=http://127.0.0.1:41343, leader=true}
[junit4:junit4]   2> 182996 T577 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1435910283671371776)]} 0 13
[junit4:junit4]   2> 182998 T557 C206 P35250 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 183002 T557 C206 P35250 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >1b95730 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >108e71a),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >1b95730 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >108e71a),segFN=segments_2,generation=2}
[junit4:junit4]   2> 183002 T557 C206 P35250 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 183003 T557 C206 P35250 oass.SolrIndexSearcher.<init> Opening Searcher< at >f75b66 main
[junit4:junit4]   2> 183004 T557 C206 P35250 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 183005 T568 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher< at >f75b66 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):C1)}
[junit4:junit4]   2> 183006 T557 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4]   2> 183007 T596 C203 P39257 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 183008 T596 C203 P39257 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >ca4123 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >bf3c3),segFN=segments_2,generation=2}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >ca4123 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >bf3c3),segFN=segments_3,generation=3}
[junit4:junit4]   2> 183008 T596 C203 P39257 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4]   2> 183009 T596 C203 P39257 oass.SolrIndexSearcher.<init> Opening Searcher< at >b25336 main
[junit4:junit4]   2> 183009 T596 C203 P39257 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 183010 T602 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher< at >b25336 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 183011 T596 C203 P39257 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:41343/collection1/, StdNode: http://127.0.0.1:40578/collection1/, StdNode: http://127.0.0.1:45338/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2> 183016 T610 C207 P40578 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 183016 T578 C208 P41343 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 183020 T610 C207 P40578 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >a3ae20 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >1ce4de8),segFN=segments_2,generation=2}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >a3ae20 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >1ce4de8),segFN=segments_3,generation=3}
[junit4:junit4]   2> 183021 T610 C207 P40578 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4]   2> 183022 T578 C208 P41343 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >7a5452 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >f84f65),segFN=segments_2,generation=2}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >7a5452 lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >f84f65),segFN=segments_3,generation=3}
[junit4:junit4]   2> 183023 T578 C208 P41343 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4]   2> 183022 T610 C207 P40578 oass.SolrIndexSearcher.<init> Opening Searcher< at >9876fe main
[junit4:junit4]   2> 183023 T626 C204 P45338 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 183024 T578 C208 P41343 oass.SolrIndexSearcher.<init> Opening Searcher< at >1b5027d main
[junit4:junit4]   2> 183025 T618 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher< at >9876fe main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C1)}
[junit4:junit4]   2> 183026 T610 C207 P40578 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 183026 T626 C204 P45338 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >e3559d lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >bf6637),segFN=segments_2,generation=2}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory< at >e3559d lockFactory=org.apache.lucene.store.NativeFSLockFactory< at >bf6637),segFN=segments_3,generation=3}
[junit4:junit4]   2> 183026 T626 C204 P45338 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4]   2> 183026 T578 C208 P41343 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 183027 T626 C204 P45338 oass.SolrIndexSearcher.<init> Opening Searcher< at >1088e5d main
[junit4:junit4]   2> 183026 T586 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher< at >1b5027d main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C1)}
[junit4:junit4]   2> 183026 T610 C207 P40578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 10
[junit4:junit4]   2> 183028 T626 C204 P45338 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 183029 T578 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 13
[junit4:junit4]   2> 183029 T635 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher< at >1088e5d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 183030 T626 C204 P45338 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4]   2> 183030 T596 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 23
[junit4:junit4]   2> 183031 T542 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4]   2> 183032 T542 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 183884 T565 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 183884 T565 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2>   "operation":"state",
[junit4:junit4]   2>   "core_node_name":"127.0.0.1:45338__collection1",
[junit4:junit4]   2>   "numShards":"2",
[junit4:junit4]   2>   "shard":"shard2",
[junit4:junit4]   2>   "roles":null,
[junit4:junit4]   2>   "state":"active",
[junit4:junit4]   2>   "shard_state":"active",
[junit4:junit4]   2>   "core":"collection1",
[junit4:junit4]   2>   "collection":"collection1",
[junit4:junit4]   2>   "shard_range":null,
[junit4:junit4]   2>   "node_name":"127.0.0.1:45338_",
[junit4:junit4]   2>   "base_url":"http://127.0.0.1:45338"}
[junit4:junit4]   2> 183887 T616 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 183887 T564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 183887 T571 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 183887 T633 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 183887 T584 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 183887 T600 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 184033 T542 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 184034 T542 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4]   2> 184037 T560 C206 P35250 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=1 
[junit4:junit4]   2> 184038 T542 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 184039 T649 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager< at >bab18a name:ZooKeeperConnection Watcher:127.0.0.1:37853/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 184040 T542 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 184041 T542 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 184045 T578 C208 P41343 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&distrib=false&wt=javabin&version=2} hits=1 status=0 QTime=1 
[junit4:junit4]   2> 184046 T593 C203 P39257 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&distrib=false&wt=javabin&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 184049 T577 C208 P41343 oasc.SolrCore.execute [collection1] webapp= path=/select params={NOW=1369390759264&shard.url=127.0.0.1:41343/collection1/|127.0.0.1:40578/collection1/&fl=id,score&start=0&q=*:*&distrib=false&wt=javabin&isShard=true&fsv=true&version=2&rows=10} hits=1 status=0 QTime=0 
[junit4:junit4]   2> 184049 T594 C203 P39257 oasc.SolrCore.execute [collection1] webapp= path=/select params={NOW=1369390759264&shard.url=127.0.0.1:39257/collection1/|127.0.0.1:45338/collection1/&fl=id,score&start=0&q=*:*&distrib=false&wt=javabin&isShard=true&fsv=true&version=2&rows=10} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 184053 T579 C208 P41343 oasc.SolrCore.execute [collection1] webapp= path=/select params={NOW=1369390759264&shard.url=127.0.0.1:41343/collection1/|127.0.0.1:40578/collection1/&ids=1&q=*:*&distrib=false&wt=javabin&isShard=true&version=2} status=0 QTime=0 
[junit4:junit4]   2>  C204_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:45338_, base_url=http://127.0.0.1:45338}
[junit4:junit4]   2> 184054 T626 C204 P45338 oasc.SolrCore.execute [collection1] webapp= path=/select params={q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=7 
[junit4:junit4]   2> 184061 T558 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2 (1435910284796493824)]} 0 4
[junit4:junit4]   2> 184072 T627 C204 P45338 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1435910284804882432)]} 0 2
[junit4:junit4]   2> 184073 T596 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[2 (1435910284804882432)]} 0 8
[junit4:junit4]   2> 184074 T578 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2]} 0 11
[junit4:junit4]   2> 184078 T559 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3 (1435910284817465344)]} 0 2
[junit4:junit4]   2> 184088 T629 C204 P45338 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1435910284821659648)]} 0 3
[junit4:junit4]   2> 184089 T593 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3 (1435910284821659648)]} 0 8
[junit4:junit4]   2> 184093 T557 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[4 (1435910284832145408)]} 0 2
[junit4:junit4]   2> 184103 T610 C207 P40578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1435910284836339712)]} 0 3
[junit4:junit4]   2> 184104 T580 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[4 (1435910284836339712)]} 0 9
[junit4:junit4]   2> 184110 T560 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[5 (1435910284848922624)]} 0 3
[junit4:junit4]   2> 184117 T626 C204 P45338 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[5 (1435910284855214080)]} 0 2
[junit4:junit4]   2> 184118 T595 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[5 (1435910284855214080)]} 0 6
[junit4:junit4]   2> 184122 T558 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[6 (1435910284862554112)]} 0 2
[junit4:junit4]   2> 184131 T628 C204 P45338 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1435910284868845568)]} 0 2
[junit4:junit4]   2> 184131 T594 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[6 (1435910284868845568)]} 0 5
[junit4:junit4]   2> 184132 T577 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[6]} 0 8
[junit4:junit4]   2> 184136 T559 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[7 (1435910284878282752)]} 0 2
[junit4:junit4]   2> 184145 T627 C204 P45338 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1435910284883525632)]} 0 1
[junit4:junit4]   2> 184146 T596 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[7 (1435910284883525632)]} 0 6
[junit4:junit4]   2> 184146 T579 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[7]} 0 8
[junit4:junit4]   2> 184150 T557 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[8 (1435910284892962816)]} 0 1
[junit4:junit4]   2> 184158 T612 C207 P40578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1435910284896108544)]} 0 2
[junit4:junit4]   2> 184159 T578 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[8 (1435910284896108544)]} 0 7
[junit4:junit4]   2> 184162 T560 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[9 (1435910284905545728)]} 0 1
[junit4:junit4]   2> 184171 T629 C204 P45338 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[9 (1435910284910788608)]} 0 1
[junit4:junit4]   2> 184172 T593 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[9 (1435910284910788608)]} 0 6
[junit4:junit4]   2> 184173 T580 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[9]} 0 9
[junit4:junit4]   2> 184176 T558 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10 (1435910284920225792)]} 0 1
[junit4:junit4]   2> 184185 T609 C207 P40578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1435910284926517248)]} 0 2
[junit4:junit4]   2> 184185 T577 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[10 (1435910284926517248)]} 0 5
[junit4:junit4]   2> 184186 T595 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10]} 0 8
[junit4:junit4]   2> 184189 T559 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[11 (1435910284933857280)]} 0 1
[junit4:junit4]   2> 184198 T611 C207 P40578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1435910284940148736)]} 0 2
[junit4:junit4]   2> 184198 T579 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[11 (1435910284940148736)]} 0 5
[junit4:junit4]   2> 184199 T594 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[11]} 0 8
[junit4:junit4]   2> 184203 T557 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[12 (1435910284947488768)]} 0 2
[junit4:junit4]   2> 184211 T610 C207 P40578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[12 (1435910284953780224)]} 0 1
[junit4:junit4]   2> 184212 T578 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[12 (1435910284953780224)]} 0 5
[junit4:junit4]   2> 184213 T596 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[12]} 0 8
[junit4:junit4]   2> 184216 T560 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[13 (1435910284962168832)]} 0 1
[junit4:junit4]   2> 184223 T612 C207 P40578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[13 (1435910284966363136)]} 0 1
[junit4:junit4]   2> 184224 T580 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[13 (1435910284966363136)]} 0 6
[junit4:junit4]   2> 184227 T558 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[14 (1435910284974751744)]} 0 1
[junit4:junit4]   2> 184234 T609 C207 P40578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[14 (1435910284977897472)]} 0 1
[junit4:junit4]   2> 184234 T577 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[14 (1435910284977897472)]} 0 4
[junit4:junit4]   2> 184238 T559 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[15 (1435910284985237504)]} 0 1
[junit4:junit4]   2> 184246 T611 C207 P40578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[15 (1435910284991528960)]} 0 1
[junit4:junit4]   2> 184247 T579 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[15 (1435910284991528960)]} 0 4
[junit4:junit4]   2> 184248 T593 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[15]} 0 7
[junit4:junit4]   2> 184251 T557 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[16 (1435910284998868992)]} 0 1
[junit4:junit4]   2> 184259 T610 C207 P40578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[16 (1435910285005160448)]} 0 1
[junit4:junit4]   2> 184260 T578 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[16 (1435910285005160448)]} 0 5
[junit4:junit4]   2> 184261 T594 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[16]} 0 8
[junit4:junit4]   2> 184269 T560 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[17 (1435910285013549056)]} 0 6
[junit4:junit4]   2> 184284 T626 C204 P45338 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[17 (1435910285026131968)]} 0 4
[junit4:junit4]   2> 184285 T596 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[17 (1435910285026131968)]} 0 10
[junit4:junit4]   2> 184285 T580 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[17]} 0 13
[junit4:junit4]   2> 184288 T558 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[100 (1435910285038714880)]} 0 1
[junit4:junit4]   2> 184296 T612 C207 P40578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[100 (1435910285042909184)]} 0 1
[junit4:junit4]   2> 184296 T577 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[100 (1435910285042909184)]} 0 4
[junit4:junit4]   2> 184297 T595 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[100]} 0 7
[junit4:junit4]   2> 184301 T559 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[101 (1435910285050249216)]} 0 2
[junit4:junit4]   2> 184308 T609 C207 P40578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[101 (1435910285056540672)]} 0 1
[junit4:junit4]   2> 184309 T579 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[101 (1435910285056540672)]} 0 4
[junit4:junit4]   2> 184310 T593 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[101]} 0 7
[junit4:junit4]   2> 184314 T557 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[102 (1435910285064929280)]} 0 1
[junit4:junit4]   2> 184321 T611 C207 P40578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[102 (1435910285069123584)]} 0 1
[junit4:junit4]   2> 184321 T578 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[102 (1435910285069123584)]} 0 5
[junit4:junit4]   2> 184325 T560 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[103 (1435910285076463616)]} 0 1
[junit4:junit4]   2> 184330 T628 C204 P45338 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[103 (1435910285079609344)]} 0 1
[junit4:junit4]   2> 184331 T594 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[103 (1435910285079609344)]} 0 4
[junit4:junit4]   2> 184334 T558 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[104 (1435910285086949376)]} 0 1
[junit4:junit4]   2> 184342 T627 C204 P45338 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[104 (1435910285091143680)]} 0 1
[junit4:junit4]   2> 184343 T596 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[104 (1435910285091143680)]} 0 5
[junit4:junit4]   2> 184344 T580 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[104]} 0 7
[junit4:junit4]   2> 184347 T559 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[105 (1435910285099532288)]} 0 1
[junit4:junit4]   2> 184355 T629 C204 P45338 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[105 (1435910285104775168)]} 0 2
[junit4:junit4]   2> 184355 T595 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[105 (1435910285104775168)]} 0 4
[junit4:junit4]   2> 184356 T577 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[105]} 0 7
[junit4:junit4]   2> 184359 T557 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[106 (1435910285112115200)]} 0 1
[junit4:junit4]   2> 184366 T626 C204 P45338 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[106 (1435910285117358080)]} 0 1
[junit4:junit4]   2> 184367 T593 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[106 (1435910285117358080)]} 0 4
[junit4:junit4]   2> 184367 T579 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[106]} 0 6
[junit4:junit4]   2> 184370 T560 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[107 (1435910285124698112)]} 0 1
[junit4:junit4]   2> 184378 T610 C207 P40578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[107 (1435910285128892416)]} 0 1
[junit4:junit4]   2> 184379 T578 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[107 (1435910285128892416)]} 0 5
[junit4:junit4]   2> 184380 T594 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[107]} 0 8
[junit4:junit4]   2> 184383 T558 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[108 (1435910285137281024)]} 0 1
[junit4:junit4]   2> 184390 T612 C207 P40578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[108 (1435910285142523904)]} 0 1
[junit4:junit4]   2> 184391 T580 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[108 (1435910285142523904)]} 0 5
[junit4:junit4]   2> 184391 T596 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[108]} 0 6
[junit4:junit4]   2> 184395 T559 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[109 (1435910285149863936)]} 0 2
[junit4:junit4]   2> 184400 T609 C207 P40578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[109 (1435910285153009664)]} 0 1
[junit4:junit4]   2> 184401 T577 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[109 (1435910285153009664)]} 0 4
[junit4:junit4]   2> 184404 T557 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[110 (1435910285159301120)]} 0 1
[junit4:junit4]   2> 184409 T611 C207 P40578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[110 (1435910285162446848)]} 0 0
[junit4:junit4]   2> 184410 T579 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[110 (1435910285162446848)]} 0 4
[junit4:junit4]   2> 184413 T560 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[111 (1435910285168738304)]} 0 1
[junit4:junit4]   2> 184421 T610 C207 P40578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[111 (1435910285173981184)]} 0 2
[junit4:junit4]   2> 184421 T578 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[111 (1435910285173981184)]} 0 4
[junit4:junit4]   2> 184422 T595 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[111]} 0 7
[junit4:junit4]   2> 184425 T558 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[112 (1435910285181321216)]} 0 1
[junit4:junit4]   2> 184432 T628 C204 P45338 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[112 (1435910285185515520)]} 0 1
[junit4:junit4]   2> 184432 T593 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[112 (1435910285185515520)]} 0 5
[junit4:junit4]   2> 184435 T559 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[113 (1435910285191806976)]} 0 1
[junit4:junit4]   2> 184442 T612 C207 P40578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[113 (1435910285197049856)]} 0 1
[junit4:junit4]   2> 184443 T580 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[113 (1435910285197049856)]} 0 4
[junit4:junit4]   2> 184443 T594 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[113]} 0 6
[junit4:junit4]   2> 184446 T560 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[114 (1435910285203341312)]} 0 1
[junit4:junit4]   2> 184452 T609 C207 P40578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[114 (1435910285206487040)]} 0 1
[junit4:junit4]   2> 184452 T577 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[114 (1435910285206487040)]} 0 4
[junit4:junit4]   2> 184455 T559 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[115 (1435910285213827072)]} 0 1
[junit4:junit4]   2> 184462 T629 C204 P45338 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[115 (1435910285216972800)]} 0 1
[junit4:junit4]   2> 184463 T596 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[115 (1435910285216972800)]} 0 5
[junit4:junit4]   2> 184466 T557 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[116 (1435910285224312832)]} 0 1
[junit4:junit4]   2> 184475 T626 C204 P45338 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[116 (1435910285230604288)]} 0 2
[junit4:junit4]   2> 184475 T595 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[116 (1435910285230604288)]} 0 5
[junit4:junit4]   2> 184476 T578 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[116]} 0 7
[junit4:junit4]   2> 184480 T558 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[117 (1435910285238992896)]} 0 1
[junit4:junit4]   2> 184487 T627 C204 P45338 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[117 (1435910285244235776)]} 0 1
[junit4:junit4]   2> 184488 T594 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[117 (1435910285244235776)]} 0 4
[junit4:junit4]   2> 184488 T580 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[117]} 0 6
[junit4:junit4]   2> 184491 T560 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[118 (1435910285250527232)]} 0 1
[junit4:junit4]   2> 184498 T611 C207 P40578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[118 (1435910285255770112)]} 0 1
[junit4:junit4]   2> 184499 T579 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[118 (1435910285255770112)]} 0 4
[junit4:junit4]   2> 184499 T596 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[118]} 0 6
[junit4:junit4]   2> 184503 T559 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[119 (1435910285263110144)]} 0 1
[junit4:junit4]   2> 184513 T629 C204 P45338 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[119 (1435910285266255872)]} 0 1
[junit4:junit4]   2> 184514 T593 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[119 (1435910285266255872)]} 0 9
[junit4:junit4]   2> 184517 T557 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[120 (1435910285277790208)]} 0 1
[junit4:junit4]   2> 184524 T628 C204 P45338 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[120 (1435910285283033088)]} 0 0
[junit4:junit4]   2> 184525 T595 C203 P39257 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:41343/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[120 (1435910285283033088)]} 0 4
[junit4:junit4]   2> 184526 T578 C208 P41343 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[120]} 0 7
[junit4:junit4]   2> 184529 T558 C206 P35250 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[121 (1435910285290373120)]} 0 1
[junit4:junit4]   2> 184536 T626 C204 P45338 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:39257/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[121 (1435910285295616000)]} 0 1
[junit4:junit4]   2> 184537 T594 C203 P39257 oasup.LogUpdateProcessor.finish [collection1]

[...truncated too long message...]

junit4]   1>               "range":"80000000-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{"127.0.0.1:41343__onenodecollectioncore":{
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "roles":"none",
[junit4:junit4]   1>                   "state":"down",
[junit4:junit4]   1>                   "core":"onenodecollectioncore",
[junit4:junit4]   1>                   "collection":"onenodecollection",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:41343_",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:41343",
[junit4:junit4]   1>                   "leader":"true"}}}},
[junit4:junit4]   1>           "router":"compositeId"}}
[junit4:junit4]   1>   /solr/aliases.json (0)
[junit4:junit4]   1>   /solr/live_nodes (4)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:40578_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:39257_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:35250_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:45338_ (0)
[junit4:junit4]   1>   /solr/overseer (3)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       
[junit4:junit4]   1>    /solr/overseer/queue (1)
[junit4:junit4]   1>     /solr/overseer/queue/qn-0000000027 (0)
[junit4:junit4]   1>     DATA:
[junit4:junit4]   1>         {
[junit4:junit4]   1>           "state":"active",
[junit4:junit4]   1>           "operation":"leader",
[junit4:junit4]   1>           "core":"collection1",
[junit4:junit4]   1>           "collection":"collection1",
[junit4:junit4]   1>           "shard":"shard1",
[junit4:junit4]   1>           "base_url":"http://127.0.0.1:40578"}
[junit4:junit4]   1>    /solr/overseer/queue-work (0)
[junit4:junit4]   1>    /solr/overseer/collection-queue-work (0)
[junit4:junit4]   1>   /solr/collections (3)
[junit4:junit4]   1>    /solr/collections/onenodecollection (2)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {
[junit4:junit4]   1>          "configName":"conf1",
[junit4:junit4]   1>          "router":"compositeId"}
[junit4:junit4]   1>     /solr/collections/onenodecollection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/onenodecollection/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/onenodecollection/leader_elect/shard1/election (0)
[junit4:junit4]   1>     /solr/collections/onenodecollection/leaders (0)
[junit4:junit4]   1>    /solr/collections/collection1 (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/collection1/shards (0)
[junit4:junit4]   1>     /solr/collections/collection1/leader_elect (2)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard1/election (1)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89744391181500426-127.0.0.1:40578__collection1-n_0000000001 (0)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard2 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard2/election (2)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard2/election/89744391181500428-127.0.0.1:45338__collection1-n_0000000001 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard2/election/89744391181500424-127.0.0.1:39257__collection1-n_0000000000 (0)
[junit4:junit4]   1>     /solr/collections/collection1/leaders (2)
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:40578_",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:40578"}
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard2 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:39257_",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:39257"}
[junit4:junit4]   1>    /solr/collections/control_collection (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/control_collection/shards (0)
[junit4:junit4]   1>     /solr/collections/control_collection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4]   1>        /solr/collections/control_collection/leader_elect/shard1/election/89744391181500419-127.0.0.1:35250__collection1-n_0000000000 (0)
[junit4:junit4]   1>     /solr/collections/control_collection/leaders (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:35250_",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:35250"}
[junit4:junit4]   1>   /solr/overseer_elect (2)
[junit4:junit4]   1>    /solr/overseer_elect/election (4)
[junit4:junit4]   1>     /solr/overseer_elect/election/89744391181500424-127.0.0.1:39257_-n_0000000002 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89744391181500426-127.0.0.1:40578_-n_0000000003 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89744391181500419-127.0.0.1:35250_-n_0000000000 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89744391181500428-127.0.0.1:45338_-n_0000000004 (0)
[junit4:junit4]   1>    /solr/overseer_elect/leader (0)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"id":"89744391181500419-127.0.0.1:35250_-n_0000000000"}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=7208F616AD4E319B -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_SG -Dtests.timezone=America/Louisville -Dtests.file.encoding=UTF-8
[junit4:junit4] ERROR   35.5s J1 | BasicDistributedZk2Test.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:40578/collection1 returned non ok status:503, message:Service Unavailable
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([7208F616AD4E319B:F3EE780EDA1151A7]:0)
[junit4:junit4]    > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4:junit4]    > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4]    > at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4:junit4]    > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.index_specific(AbstractFullDistribZkTestBase.java:592)
[junit4:junit4]    > at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:304)
[junit4:junit4]    > at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:117)
[junit4:junit4]    > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4]    > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 194816 T542 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Asserting, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=en_SG, timezone=America/Louisville
[junit4:junit4]   2> NOTE: Linux 3.2.0-41-generic i386/Oracle Corporation 1.7.0_21 (32-bit)/cpus=8,threads=3,free=208931968,total=322961408
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestReload, SpellCheckCollatorTest, EchoParamsTest, SpellPossibilityIteratorTest, OpenExchangeRatesOrgProviderTest, CurrencyFieldXmlFileTest, RequiredFieldsTest, SolrPluginUtilsTest, XmlUpdateRequestHandlerTest, RequestHandlersTest, TestAddFieldRealTimeGet, MultiTermTest, CollectionsAPIDistributedZkTest, CoreContainerCoreInitFailuresTest, TestBM25SimilarityFactory, XsltUpdateRequestHandlerTest, ZkSolrClientTest, TestRecovery, TestSolrXml, IndexReaderFactoryTest, NotRequiredUniqueKeyTest, TestCSVLoader, TestPartialUpdateDeduplication, TestAnalyzedSuggestions, BasicDistributedZk2Test]
[junit4:junit4] Completed on J1 in 35.49s, 1 test, 1 error <<< FAILURES!

[...truncated 780 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:380: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:360: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:437: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1240: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:884: There were test failures: 295 suites, 1231 tests, 1 error, 13 ignored (7 assumptions)

Total time: 39 minutes 50 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_21 -client -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe< at >lucene.apache.org
For additional commands, e-mail: dev-help< at >lucene.apache.org

[jira] [Created] (LUCENE-5016) Sampling can break FacetResult labeling

Rob Audenaerde (JIRA — 2013-05-24T09:18:20

Rob Audenaerde created LUCENE-5016:
--------------------------------------

             Summary: Sampling can break FacetResult labeling 
                 Key: LUCENE-5016
                 URL: https://issues.apache.org/jira/browse/LUCENE-5016
             Project: Lucene - Core
          Issue Type: Bug
          Components: modules/facet
    Affects Versions: 4.3
            Reporter: Rob Audenaerde
            Priority: Minor


When sampling FacetResults, the TopKInEachNodeHandler is used to get the FacetResults.

This is my case:
A FacetResult is returned (which matches a FacetRequest) from the StandardFacetAccumulator. The facet has 0 results. The labelling of the root-node seems incorrect. I know, from the StandardFacetAccumulator, that the rootnode has a label, so I can use that one.

Currently the recursivelyLabel method uses the taxonomyReader.getPath() to retrieve the label. I think we can skip that for the rootNode when there are no children (and gain a little performance on the way too?)





--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira