gmane.comp.sysutils.bcfg2.devel

Re: Problem with BDStats and MySQL

Rodney Young — 2012-05-11T14:11:43

That worked like a charm! Thank you all for a super config management tool
and for your help!
Rodney



On Thu, May 10, 2012 at 7:58 PM, Sol Jerome <solj< at >soljerome.com> wrote:

Re: Problem with BDStats and MySQL

Sol Jerome — 2012-05-10T23:58:58

Sorry. Patch attached.

* May 10, 2012, at 18:02:22 PM, Sol Jerome <solj< at >soljerome.com> wrote:
diff --git a/src/lib/Bcfg2/Server/Reports/updatefix.py b/src/lib/Bcfg2/Server/Reports/updatefix.py
index b5e41b8..192b94b 100644
--- a/src/lib/Bcfg2/Server/Reports/updatefix.py
+++ b/src/lib/Bcfg2/Server/Reports/updatefix.py
< at >< at > -63,10 +63,20 < at >< at > def _interactions_constraint_or_idx():
 def _remove_table_column(tbl, col):
     """sqlite doesn't support deleting a column via alter table"""
     cursor = connection.cursor()
-    try:
+    db_engine = Bcfg2.Server.Reports.settings.DATABASES['default']['ENGINE']
+    if db_engine == 'django.db.backends.mysql':
+        db_name = Bcfg2.Server.Reports.settings.DATABASES['default']['NAME']
+        column_exists = cursor.execute('select * from information_schema.columns '
+                                       'where table_schema="%s" and '
+                                       'table_name="%s" '
+                                       'and column_name="%s";' % (db_name,

Re: Problem with BDStats and MySQL

Sol Jerome — 2012-05-10T23:02:22

Please try the attached patch. It should fix this particular problem.


1.2.2 is the latest stable release, but the code you have is from the
git master branch which hasn't been tagged. What platform are you
running? Are there no native packages available?


Sol

Re: Problem with BDStats and MySQL

Rodney Young — 2012-05-10T18:31:59

Thank you.
Results:
root< at >server ~>patch
/usr/lib/python2.4/site-packages/Bcfg2/Server/Reports/updatefix.py <
patch.diff
patching file
/usr/lib/python2.4/site-packages/Bcfg2/Server/Reports/updatefix.py
root< at >server ~>bcfg2-server
Traceback (most recent call last):
  File "/usr/sbin/bcfg2-server", line 71, in ?
    ca=setup['ca'],
  File "/usr/lib/python2.4/site-packages/Bcfg2/Component.py", line 61, in
run_component
    component = component_cls(cfile=cfile, **cls_kwargs)
  File "/usr/lib/python2.4/site-packages/Bcfg2/Server/Core.py", line 94, in
__init__
    self.init_plugins(plugin)
  File "/usr/lib/python2.4/site-packages/Bcfg2/Server/Core.py", line 166,
in init_plugins
    mod = getattr(__import__("Bcfg2.Server.Plugins.%s" %
  File "/usr/lib/python2.4/site-packages/Bcfg2/Server/Plugins/DBStats.py",
line 14, in ?
    import Bcfg2.Server.Reports.importscript
  File
"/usr/lib/python2.4/site-packages/Bcfg2/Server/Reports/importscript.py",
line 30, in ?
    from Bcfg2.Server.Reports.updatefix import update_data

Re: Problem with BDStats and MySQL

Sol Jerome — 2012-05-10T18:15:00

Looks like you may have hit a bug in the current git code. I would
recommend running from a regular release if you are relatively new to
bcfg2.

That being said, can you apply the following patch and paste the
resulting traceback?

diff --git a/src/lib/Bcfg2/Server/Reports/updatefix.py b/src/lib/Bcfg2/Server/Reports/updatefix.py
index b5e41b8..37523ab 100644
--- a/src/lib/Bcfg2/Server/Reports/updatefix.py
+++ b/src/lib/Bcfg2/Server/Reports/updatefix.py
< at >< at > -63,6 +63,8 < at >< at > def _interactions_constraint_or_idx():
 def _remove_table_column(tbl, col):
     """sqlite doesn't support deleting a column via alter table"""
     cursor = connection.cursor()
+    cursor.execute('alter table %s '
+                   'drop column %s;' % (tbl, col))
     try:
         cursor.execute('alter table %s '
                        'drop column %s;' % (tbl, col))

* May 10, 2012, at 13:55:12 PM, Rodney Young <ryoung999< at >gmail.com> wrote:

Problem with BDStats and MySQL

Rodney Young — 2012-05-10T17:55:12

Hello,
I hope this is the correct place to ask for help for a relative newbie. If
not, please let me know.

Having searched the archives, I don't see this specific problem addressed.
I am sure it is something simple I am missing.

I configured bcfg2-server to use BDStats plugin. I want to use a MySQL
database for flexibility. I have the database configured, tables creates,
packages installed, and /etc/bcfg2.conf edited. When I try to start the
bcfg2 daemon the status ends up "bcfg2-server dead but pid file exists".
When I don't daemonize:

root< at >server ~>bcfg2-server
Traceback (most recent call last):
  File "/usr/sbin/bcfg2-server", line 71, in ?
    ca=setup['ca'],
  File "/usr/lib/python2.4/site-packages/Bcfg2/Component.py", line 61, in
run_component
    component = component_cls(cfile=cfile, **cls_kwargs)
  File "/usr/lib/python2.4/site-packages/Bcfg2/Server/Core.py", line 94, in
__init__
    self.init_plugins(plugin)
  File "/usr/lib/python2.4/site-packages/Bcfg2/Server/Core.py", line 166,
in init_plugin

Re: Client Tool Drivers for bcfg2

Calvin Cheng — 2012-04-30T11:22:52

Yes. I found this after spending more time browsing through the source code.

Thanks for pointing it out.

The other problem I can't seem to resolve relates to

(1) https://github.com/Bcfg2/bcfg2/issues/25

and

(2) I posted a question on irc channel asking what the command is to build
the docs using sphinx? Since the conf.py file is in the doc directory, how
should I give my sphinx build command?




On Mon, Apr 30, 2012 at 11:06 AM, Calvin Cheng <calvin< at >calvinx.com> wrote:

Re: Client Tool Drivers for bcfg2

Sol Jerome — 2012-04-30T10:19:47

Not sure if it's what you're looking for, but there's a Pacman client
tool driver at

http://trac.mcs.anl.gov/projects/bcfg2/browser/src/lib/Bcfg2/Client/Tools/Pacman.py

* Apr 30, 2012, at 11:06:32 AM, Calvin Cheng <calvin< at >calvinx.com> wrote:

Client Tool Drivers for bcfg2

Calvin Cheng — 2012-04-30T03:06:32

Hello,

I am new to bcfg2 and am currently experimenting with it.

The first thing I noticed though is that it doesn't seem to offer client
tool drivers for arch linux.

Has anyone written something like that for arch linux? If so, I would like
to check it out and hopefully, some one could incorporate it into bcfg2
source.

Re: OpenStack and bcfg2

Narayan Desai — 2012-04-21T06:31:17

On Apr 20, 2012, at 12:38 PM, Michael March wrote:


Nope, bandwidth in the traditional sense. We've got the system connected up to the ESNet experimental 100 gigabit cross country backbone. We managed to get 95 gigabit sustained out of the system, using a surprisingly small number (10) of hosts, with 1 vm on each. (the hosts were only connected with 1x10GE) This was a wide area memory to memory transfer, so no disks were involved; that is something that we will be doing soon, hopefully. We were frankly astounded with the single node performance, as well as the fact that we were able to get openstack to do the right thing here without much arm twisting, once Jason figured out the right modes to use for the network. We're starting to figure out how to fit this into a larger scale system.


We're using onieric with diablo, and precise with our essex test builds. We're managing everything with bcfg2, top to bottom.
 -nld

Re: OpenStack and bcfg2

Michael Jinks — 2012-04-20T19:51:25

I for one would be interested in reading the exchange, even if it is a
bit off topic for bcfg2.

Re: OpenStack and bcfg2

Michael March — 2012-04-20T17:38:17

"Bandwidth" meaning better utilization of your systems?


Do you even manage the CloudStack config itself with bcfg2? What host
OS are you guys using ?

Re: OpenStack and bcfg2

Narayan Desai — 2012-04-20T17:29:53

Hey. Yeah, I saw your name come up recently on the list as well. 

I've been spending a lot of time with openstack over the last year or so. It is a really nice piece of software; the architecture is sound, and we've started being able to do some really interesting things with it. We've managed to get some insane bandwidth out of our system, I gave a full talk about it yesterday. The slides will show up here:
http://www.slideshare.net/group/openstackcloud
soon. I'm a big fan of openstack; it works pretty well, even at the several hundred node mark. The architecture is pretty good overall; while there are a few pain points, you can build a pretty nice stable system based on it. 

To keep things on topic, it is all managed with bcfg2 ;)

I'm happy to answer any detailed questions you have about openstack, either on or off list. 
 -nld

On Apr 20, 2012, at 9:32 AM, Michael March wrote:

OpenStack and bcfg2

Michael March — 2012-04-20T14:32:29

Narayan,

So I couldn't help noticing your email today on the OpenStack list (I
swear I'm not cyberstalking you :)  ) so I was wondering if you could
give a few sentences about your impressions of OpenStack in general
and specifically how well bcfg2 works with it.

My company is considering a OpenStack trail and any quick words you
have on it would be great.


--

Michael F. March ----- mmarch< at >gmail.com
Ph: (415) 894-9269 ---- Fax: (602)296-0400
Twitter: cowmix -------------- Skype: Cowmix

Re: PHP Pear Packages

Chris St. Pierre — 2012-03-31T23:59:44

Nope. As it happens, mixing packaging systems -- e.g., using PEAR and RPM
on the same machine -- is almost always a bad idea, and will bite you when
both packaging systems fight for the same files.

I'd suggest using something like pear2rpm (or a .deb equivalent, assuming
one exists) to build packages if anything you can't find from reputable
sources on pkgs.org.
On Mar 31, 2012 6:14 PM, "mitchell" <mukareste< at >tufala.net> wrote:

PHP Pear Packages

mitchell — 2012-03-31T23:14:03

Hello,

Is it possible to manage PHP Pear packages with bcfg2?

Thank you in advance for your reply!

# mitchell

Re: bcfg2 client and preinstall scripts

Gordon Messmer — 2012-03-22T01:08:51

Verified.  I think this is actually a policy bug.  I've filed a request 
for the selinux-policy package:
https://bugzilla.redhat.com/show_bug.cgi?id=805742

Re: bcfg2 client and preinstall scripts

Jonathan Billings — 2012-03-22T01:03:03

You'd have to remove the dontaudits from the policy to see this.
(semodule -DB, I believe).

I believe there's a role transition from unconfined_r to rpm_t that
allows useradd and groupadd, which allows stuff like 'yum' to run in
cron, but not something like bcfg2, unless it also has the rpm_exec_t
label.

Re: bcfg2 client and preinstall scripts

Gordon Messmer — 2012-03-22T00:17:28

Thanks, I'll test and verify that.  It doesn't make much sense, though. 
  The bcfg2 client is unconfined and there are no AVCs logged.

Re: bcfg2 client and preinstall scripts

Jonathan Billings — 2012-03-22T00:02:42

This is a known issue:

http://trac.mcs.anl.gov/projects/bcfg2/ticket/1095

Basically, the SELinux context in which you're running bcfg2 doesn't
allow useradd and groupadd capability.

The real solution is to convince Red Hat to add /usr/sbin/bcfg2 to
their policy to be labeled as rpm_exec_t.  I added a temporary
solution to that ticket.

bcfg2 client and preinstall scripts

Gordon Messmer — 2012-03-21T23:31:54

I've noticed recently that RPM preinstall scripts don't get run when I 
use the bcfg2 client to set up new systems (CentOS 6, for instance). 
Consequently, new user accounts don't get installed when a package like 
bind or postgresql-server is installed.

Is anyone else seeing that problem?