gmane.linux.redhat.fedora.infrastructure

Yet another freeze break: reviewstatus

Kevin Fenzi — 2012-05-24T21:45:02

I'd like to revert puppet commits: 

55103ec6ce3a80234391229f6b10e220fa13e72d
5b131d0e489f5349d5cef6a8e0ffdc2febda0441

This reverts review-stats.py to the version that we had before monday,
which was working with the old python-bugzilla (which we have already
reverted to). 

I've tested it locally and it does only make 6 bugzilla calls when used
with the python-bugzilla version we have reverted to, so we shouldn't
be causing undue load on bugzilla. 

I'd also like to: 

diff --git a/modules/review-stats/manifests/init.pp b/modules/review-stats/manifests/init.pp
index 9a016a5..0376a77 100644
--- a/modules/review-stats/manifests/init.pp
+++ b/modules/review-stats/manifests/init.pp
< at >< at > -57,7 +57,7 < at >< at > class review-stats::build inherits review-stats {
         command => "/usr/bin/python /usr/local/bin/pyGetReviewByFlags.py -t /usr/local/share/review-stats -d 
         user    => "apache",
         minute  => [ 0, 30 ],
-        ensure => "absent",
+        ensure => "present",
     }
 
 }

to re-enable it. 

+1s

[PATCH] - add db-fas01 to dns - add to puppet - based in larger partoff of db01's recipe

2012-05-24T19:28:22

From: Seth Vidal <skvidal< at >fedoraproject.org>

---
 manifests/nodes/db-fas01.phx2.fedoraproject.org  |   18 ++++++++++++++++++
 modules/bind/files/master/126.5.10.in-addr.arpa  |    4 ++--
 modules/bind/files/master/phx2.fedoraproject.org |    3 ++-
 3 files changed, 22 insertions(+), 3 deletions(-)
 create mode 100644 manifests/nodes/db-fas01.phx2.fedoraproject.org

diff --git a/manifests/nodes/db-fas01.phx2.fedoraproject.org b/manifests/nodes/db-fas01.phx2.fedoraproject.org
new file mode 100644
index 0000000..ac90bf9
--- /dev/null
+++ b/manifests/nodes/db-fas01.phx2.fedoraproject.org
< at >< at > -0,0 +1,18 < at >< at >
+node db01-fas.phx2.fedoraproject.org {
+    $bacula5 = "true"
+    # re-enable this once we have db's setup. 
+    # $backup_db_often = true
+    include phx
+    include db
+    include appDB-el6
+    collectd::collectd { 'log02': }
+    collectd::postgres { 'postgres':
+       databases => ['fas']
+    }
+
+    # Workaround for bug 768055
+    semanage_fcontext { '/usr/lib64/nagios/plugins/check_disk':
+

Freeze Break: shutdown search01-dev on virthost05 - setup db-fas01on virthost05

seth vidal — 2012-05-24T18:15:27

This will be a first step to migrate to a private fas postgres instance.

In order to free up mem and procs I would like to shutdown search01-dev
on virthost05 and bring up db-fas01 on there.

The goal would be a private postgres db server for fas alone.


I will be kickstarting a vm on virthost05 and then adding entries to
puppet/dns to accommodate this.

I need some +1's to break the freeze to make this happen.

thanks,
-sv
_______________________________________________
infrastructure mailing list
infrastructure< at >lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure

[Change Request] Fix pkgdb privileged operations for oldpython-bugzilla

Toshio Kuratomi — 2012-05-24T15:01:28

As part of two situations I've pushed out a hotfix to pkgdb and would like
two +1's for the change.

The situations:
* Continuing work to get our apps working with the old python-bugzilla
  package from yesterday's problems between infrastructure and bugzilla
* Unknown causes of downtime for the fas servers.

We're currently trying to determine what's causing the second situation to
recur ~ every two hours.  As part of that we're trying to fix anything that
is out of the ordinary. So I've pushed this fix out and verified it works
with the reporter.  If I could get two +1's for after the fact application
during change freeze, that would be great.

The change:
When PackageDB makes changes to who owns a package or creates a new package
it needs to login to bugzilla and find out if the new owner has a bugzilla
account.  Those connections were failing for the same reason as fas's
export-bugzilla was failing yesterday: the older version of python-bugzilla
does not know how to get this information out of the new ve

Plan for tomorrow's Fedora Infrastructure meeting (2012-05-24 18UTC)

Kevin Fenzi — 2012-05-23T23:52:13

The infrastructure team will be having it's weekly meeting tomorrow, 
2012-05-24 at 18:00 UTC in #fedora-meeting on the freenode network.

Suggested topics:

#topic New folks introductions and Apprentice tasks.

If any new folks want to give a quick one line bio or any apprentices
would like to ask general questions, they can do so here. 

#topic two factor auth status

#topic Fedora 17 Release tickets

#topic Applications status / discussion

Check in on status of our applications: pkgdb, fas, bodhi, koji,
community, voting, tagger, packager, dpsearch, etc. 
If there's new releases, bugs we need to work around or things to note. 

#topic Upcoming Tasks/Items 

#info 2012-05-08 to 2012-05-29 FINAL FREEZE
#info 2012-05-29 - F17 release
#info 2012-06-01 - nag fi-apprentices.
#info 2011-06-03 - gitweb-cache removal day.
#info 2012-06-04 - class B reboots?
#info 2012-06-05 - class A reboots?
#info 2012-06-08 OOW: osuosl01.fedoraproject.org
#info 2012-06-17 OOW: sign-vault02.phx2.fedoraproject.org
#info 2012-06-2

Questions regarding Koji, fedpkg and SCM

Jeremy Davis — 2012-05-23T23:05:40

Hello List,

I hope I picked the correct mailing list to ask these types of questions.

In my environment we are trying to setup a koji build system using the same
structure that you all use for the Fedora project. This involves using
fedpkg (modified for our environment) to import the SRPM into the SCM and
then tell koji to build. We have everything working with our environment
but have to do a couple of things manually. Mainly the SCM creation and
adding a tag for the package in koji before the user is allow to add their
srpm to the SCM and build with koji (get the error that it can't tag if a
tag is not created before hand). Once we create the SCM and add the tag
into Koji everything works as it should based on the documentation I have
read.

My question is this. Do you by chance have any tools that automate the SCM
creation and koji tag adding? Is this how you all manage packages in
Fedora? Do you have to manually create SCM and koji tags when a user wants
to add a new package to Fedora? Any assistance y

[Freeze break Request] Disable bugzilla integration

Toshio Kuratomi — 2012-05-23T15:39:23

The bugzilla admins at redhat notified us that they were having load issues
since the bugzilla upgrade caused by infrastructure's hosts.  It seems that
at least one of our scripts is exercising bugs in the new bugzilla codebase.
They've asked us to turn off all of our cron jobs for now so that they can
stabilise the platform and then we'll go through and see if we can identify
the problem query(-ies)  and fix it either on our side or in bugzilla.

Since this is an emergency, we've disabled the cron jobs first -- sending
the patch here for +1's to break freeze and so we know what to revert when
the time comes.

While these are disabled, the following things will not work:

* changes in user status in fas (users joining and leaving packager or
  fedorabugs) will not be reflected to bugzilla
* The cached review status pages will not update
* The easyfix.fedoraproject.org bugs list will not update
* Changes in package ownership will not propogate from the packagedb to
  bugzilla
* New packages won't be added to

[PATCH] No cookie for easyfix

2012-05-23T14:50:37

From: Pierre-Yves Chibon <pingou< at >pingoured.fr>

---
 modules/gather-easyfix/files/gather_easyfix.py |    3 ++-
 1 files changed, 2 insertions(+), 1 deletions(-)

diff --git a/modules/gather-easyfix/files/gather_easyfix.py b/modules/gather-easyfix/files/gather_easyfix.py
index 9a42777..4a6cd3e 100755
--- a/modules/gather-easyfix/files/gather_easyfix.py
+++ b/modules/gather-easyfix/files/gather_easyfix.py
< at >< at > -38,7 +38,8 < at >< at > from kitchen.text.converters import to_bytes
 from jinja2 import Template
 
 __version__ = '0.1.1'
-bzclient = RHBugzilla(url='https://bugzilla.redhat.com/xmlrpc.cgi')
+bzclient = RHBugzilla(url='https://bugzilla.redhat.com/xmlrpc.cgi', 
+   cookiefile=None)
 # So the bugzilla module has some way to complain
 logging.basicConfig()

[PATCH] Typos...

2012-05-23T14:40:03

From: Pierre-Yves Chibon <pingou< at >pingoured.fr>

---
 modules/review-stats/files/review-stats.py |    2 +-
 1 files changed, 1 insertions(+), 1 deletions(-)

diff --git a/modules/review-stats/files/review-stats.py b/modules/review-stats/files/review-stats.py
index 0afe64b..ea5b89a 100755
--- a/modules/review-stats/files/review-stats.py
+++ b/modules/review-stats/files/review-stats.py
< at >< at > -180,7 +180,7 < at >< at > def run_query(bz):
         querydata['v1'] = 'fedora-review' + i
         b1 = bz.query(querydata)
         for bug in b1:
-            b1.last_change_time = datetime.datetime.strptime(b1.last_change_time.value, "%Y%m%dT%H:%M:%S")
+            bug.last_change_time = datetime.datetime.strptime(bug.last_change_time.value, "%Y%m%dT%H:%M:%S")
             bugdata[bug.bug_id] = {}
             bugdata[bug.bug_id]['hidden'] = 0
             bugdata[bug.bug_id]['blocks'] = []

Freeze break request: Update python-bugzilla on fas, bapp01, app

Kevin Fenzi — 2012-05-21T16:38:14

After the bugzilla upgrade this weekend a few things we run related to
bugzilla are having issues: 

1) on fas01, the script that sets fedorabugs and fedora_contrib on users
in those fedora groups isn't working. 

2) on bapp01, the cron job that gathers easyfix bugzilla bugs is not
working. 

3) pkgdb, which runs on app servers isnt' able to handle adding new
packages. (we aren't sure what the error here is, but is likely bz
related). 

I have taken a snapshot of python-bugzilla and built a package of it. 
Changes: 
http://git.fedorahosted.org/git/?p=python-bugzilla.git
Scratch build: 
http://koji.fedoraproject.org/koji/taskinfo?taskID=4091680
(This is just a git head checkout build)

1) I have tested on fas01.stg the script that sets permissions
against partner-bugzilla.redhat.com and the updated python-bugzilla. It
no longer errors and completes normally. 

2) gather easyfix needs more changes and is not fixed by
python-bugzilla update. Look for fix after this email from pingou. 

3) We aren't sure the new

hello to everybody

cyberworm — 2012-05-21T03:38:58

My name is I G 
I live in the US /Eastern time. I've been working as a Linux/KVM/Windows
Administrator for 4 years now 
I've been working mainly with redhat servers and I also have some
scripting skills,(python,bash). 
I want to contribute to the fedora project, specially in the
infrastructure side because I feel if we all work
together towards the same side, we will make the fedora project one of
the greatest ever. I am looking to do more in the infrastructure side
since I am an infrastructure guy and I can bring a excellent attitude,
responsibility, desire to work hard and a good amount of technical
knowledge to the team. I am also bilingual.
I can contribute between 7 to 10 hours a week.

I am also looking for a sponsor or a mentor hopefully somebody out there
will help me out with this request

Thank you for reading and I am looking forward to contribute to this
wonderful community.

Thank you
Cyberworm
cyberworm54< at >dc317.org

_______________________________________________
infrastructure mailing list
inf

Introduction

Onalenna Junior Makhura — 2012-05-20T09:02:26

Hi,

I have been a member of this list for a few years now but due to some 
constraints I have not been able to actively participate. I would now 
like to start be active in Fedora development. I have been using fedora 
as my 1st choice OS since Fedora Core 6.

I would be very glad to have someone who can show me the ropes.

Regards,

Onalenna Junior Makhura
_______________________________________________
infrastructure mailing list
infrastructure< at >lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure

tagger inodes and beaker

Brennan Ashton — 2012-05-19T19:58:59

So today my email was flooded by tracebacks from tagger via fedora community.
Suggesting that no disk space was left on  packages01.phx2.fedoraproject.org

OSError: [Errno 28] No space left on device:
'/var/cache/fedoratagger/cache/sessions/container_file_lock/d/d9/d9132d5318c4be5a878b6a1bd31b77c320649f82.lock'

nirik did a little looking and found that there was space, but no
inodes were left. Tagger has created an enormous amount of files in
/var/cache/fedoratagger/cache/sessions/

I looked at the tagger code quickly and it seems that for anonymous
voting sessions are saved. [1]

However as far as I am aware unless you use session.delete()  the
session stays around forever on the backend. [2]

nirik purged the cache so there should be enough inodes, but we need
to figure out some way to clean the cache as that filled up quite
quickly.
We might also want to look and see if any other apps using beaker are
not cleaning up their cache.

[1] https://github.com/ralphbean/fedora-tagger/commit/78f48fe97da5bcfadea5

Plan for tomorrow's Fedora Infrastructure meeting (2012-05-17 at18UTC)

Kevin Fenzi — 2012-05-17T02:26:01

The infrastructure team will be having it's weekly meeting tomorrow, 
2012-05-17 at 18:00 UTC in #fedora-meeting on the freenode network.

Suggested topics:

#topic New folks introductions and Apprentice tasks.

If any new folks want to give a quick one line bio or any apprentices
would like to ask general questions, they can do so here. 

#topic two factor auth status

#topic Applications status / discussion

Check in on status of our applications: pkgdb, fas, bodhi, koji,
community, voting, tagger, packager, dpsearch, etc. 
If there's new releases, bugs we need to work around or things to note. 

#topic Upcoming Tasks/Items 

#info 2012-05-08 to 2012-05-22 FINAL FREEZE
#info 2012-05-22 - F17 release
#info 2012-06-01 - nag fi-apprentices.
#info 2011-06-03 - gitweb-cache removal day.
#info 2012-06-08 OOW: osuosl01.fedoraproject.org
#info 2012-06-17 OOW: sign-vault02.phx2.fedoraproject.org
#info 2012-06-21 to 2012-07-04 Kevin is off on trains and boats.

#topic Meeting tagged tickets: 
https://fedorahosted.or

FYI, pkgs git process cleanup

Kevin Fenzi — 2012-05-15T20:12:21

We started getting some failed builds today due to koji not being able
to get git checkouts from pkgs01. 

$ git clone -n
git://pkgs.fedoraproject.org/gnome-shell /var/lib/mock/f17-build-1342530-216385/root/tmp/scmroot/gnome-shell
fatal: read error: Connection reset by peer Cloning
into /var/lib/mock/f17-build-1342530-216385/root/tmp/scmroot/gnome-shell...

and

$ git clone -n
git://pkgs.fedoraproject.org/digikam /var/lib/mock/f17-build-1342529-216385/root/tmp/scmroot/digikam
fatal: read error: Connection reset by peer Cloning
into /var/lib/mock/f17-build-1342529-216385/root/tmp/scmroot/digikam...

There were some IP's hitting pkgs01 pretty hard on checkouts, but that
turns out to not be the real issue. There were a number of old stale
connections laying around, making it so it hit xinetd limits much
faster than normal. 

I killed 46 old git upload-pack processes and 51 old stale ssh
connections that were all from Feb, then restarted xinetd. This seemed
to clear things up. 

We may want to look at a automate

freeze break request: install trac-agilo-plugin on hosted

Kevin Fenzi — 2012-05-15T15:58:41

Since trac-agilo-plugin is now through review and available in EPEL,
I'd like to install it on hosted for
https://fedorahosted.org/fedora-infrastructure/ticket/3081

I have tested it locally here and it seems to work ok. 
We may need to see if it adds any additional load on hosted, but
hopefully it won't. 

+1's ? 

kevin
--
diff --git a/manifests/services/hosted.fedoraproject.org.pp
b/manifests/services/hosted.fedoraproject.org.pp index 7b33939..49c61af
100644 --- a/manifests/services/hosted.fedoraproject.org.pp
+++ b/manifests/services/hosted.fedoraproject.org.pp
< at >< at > -131,6 +131,9 < at >< at > class hosted-server {
     package { babel:
         ensure => present,
     }
+    package { trac-agilo-plugin:
+        ensure => present,
+    }
     #
     # We need this for the fedorahosted website build. 
     #
_______________________________________________
infrastructure mailing list
infrastructure< at >lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure

Meeting Agenda Item: Introduction Luciano Facchinelli

Luciano Facchinelli — 2012-05-15T04:04:18

Hi Everyone !

This is kind a re-introduction, i did a intro a few months ago but due some
family issue i went offline a little bit.

Now I'm back and ready to help Fedora :-)

So.. a little FAQ about myself :-)


   - Name : Luciano Facchinelli
   - Age : 22 years old
   - Country : Uruguay, South America
   - UTC : -3
   - Irc Handle : virusuy <http://fedoraproject.org/wiki/Communicate/IRCHowTo>
   - What skills you have to offer and which you would like to learn: I'm a
   Unix/Linux Sysadmin, so, i can help wherever you want. I would like to
   learn more about Puppets, for example.

So, that's all

I'm reading infrastructure's wiki page to know how can i contribute and how
should i do


See you around


Regards

Luciano
_______________________________________________
infrastructure mailing list
infrastructure< at >lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure

HOTFIX: MM crawler (ticket #3268)

Matt Domsch — 2012-05-12T01:51:15

https://fedorahosted.org/fedora-infrastructure/ticket/3268
notes that a mirror might not be removed from the list even though
it's stale.

In particular, there is a code path called add_parents() whose job it
is to mark all parent directories of a target directory up-to-date or
not, if those parent directories had not already been determined to be
up-to-date for themselves.  This can happen if a directory has no
files in it, for example, only child directories.  This code path had
an incorrect key lookup, specifically:

-        parent = '/'.join(splitpath[:-1])
-        try:
-            hcd = host_category_dirs[(hc, parent)]

which was looking up the parent directory in the host_category_dirs
cache (which is later operated on).  However, the actual key here is
not a the string form of the parent directory name, it is a Directory
object.  So it's looking up the wrong thing, failing the lookup, and
then proceeding to mark all its parent directories up-to-date
incorrectly.  In particular, it is marking all pa

Change to aliases file

Nick Bebout — 2012-05-11T20:49:38

From 292a2642aaece827b47543b14e665aac1fb14181 Mon Sep 17 00:00:00 2001
From: Nick Bebout <nb< at >fedoraproject.org>
Date: Fri, 11 May 2012 15:47:13 -0500
Subject: [PATCH] Add ham-radio-exams alias

---
 configs/system/smtp/aliases.template.erb |    1 +
 1 files changed, 1 insertions(+), 0 deletions(-)

diff --git a/configs/system/smtp/aliases.template.erb
b/configs/system/smtp/aliases.template.erb
index b972e38..fadff90 100644
--- a/configs/system/smtp/aliases.template.erb
+++ b/configs/system/smtp/aliases.template.erb
< at >< at > -155,6 +155,7 < at >< at > secalert: security-private< at >lists.fedoraproject.org
 webmaster: websites< at >lists.fedoraproject.org
 logo: iweller< at >redhat.com
 kernel-team: davej< at >redhat.com,jwboyer< at >redhat.com,jforbes< at >redhat.com
+ham-radio-exams: nb,jbwillia

 # Misc Aliases
 #rel-eng:
jkeating< at >redhat.com,jkatz< at >redhat.com,notting< at >redhat.com,spot< at >redhat.com,jwboyer< at >gmail.com,tcallawa< at >redhat.com,wwoods< at >redhat.com,wtogami< at >redhat.com,rdieter< at >math.unl.edu,lmacken< at >redhat.com,poelstra< at >redhat.com

Change to aliases file

Nick Bebout — 2012-05-11T20:49:22

From 292a2642aaece827b47543b14e665aac1fb14181 Mon Sep 17 00:00:00 2001
From: Nick Bebout <nb< at >fedoraproject.org>
Date: Fri, 11 May 2012 15:47:13 -0500
Subject: [PATCH] Add ham-radio-exams alias

---
 configs/system/smtp/aliases.template.erb |    1 +
 1 files changed, 1 insertions(+), 0 deletions(-)

diff --git a/configs/system/smtp/aliases.template.erb
b/configs/system/smtp/aliases.template.erb
index b972e38..fadff90 100644
--- a/configs/system/smtp/aliases.template.erb
+++ b/configs/system/smtp/aliases.template.erb
< at >< at > -155,6 +155,7 < at >< at > secalert: security-private< at >lists.fedoraproject.org
 webmaster: websites< at >lists.fedoraproject.org
 logo: iweller< at >redhat.com
 kernel-team: davej< at >redhat.com,jwboyer< at >redhat.com,jforbes< at >redhat.com
+ham-radio-exams: nb,jbwillia

 # Misc Aliases
 #rel-eng:
jkeating< at >redhat.com,jkatz< at >redhat.com,notting< at >redhat.com,spot< at >redhat.com,jwboyer< at >gmail.com,tcallawa< at >redhat.com,wwoods< at >redhat.com,wtogami< at >redhat.com,rdieter< at >math.unl.edu,lmacken< at >redhat.com,poelstra< at >redhat.com

Freeze break: update boot.fedoraproject.org to latest ipxe

Kevin Fenzi — 2012-05-11T16:31:17

This has been something I have had on my todo list for a long time and
keep not getting to, so I would like to now. ;) 

Currently boot.fedoraproject.org is using gpxe. These gpxe images were
generated 2010-08, so they are pretty old. In the mean time, gpxe
development has stopped, and efforts have moved on to the new ipxe
project. ipxe has added a bunch more hardware support, including some
wireless cards, efi support, etc. 

I'd like to replace the existing binaries on secondary01: 

$ ls -la /srv/pub/alt/bfo/bfo*
-rw-rw-r--. 1 mmcgrath sysadmin-main 307200 Aug 24  2010 /srv/pub/alt/bfo/bfo.dsk
-rw-rw-r--. 1 mmcgrath sysadmin-main 686080 Aug 24  2010 /srv/pub/alt/bfo/bfo.iso
-rw-rw-r--. 1 mmcgrath sysadmin-main 308820 Aug 24  2010 /srv/pub/alt/bfo/bfo.lkrn
-rw-rw-r--. 1 mmcgrath sysadmin-main 344064 Aug 24 2010 /srv/pub/alt/bfo/bfo.usb

with new shiny ipxe binaries: 

-rw-rw-r--. 1 kevin kevin  362496 May 11 09:52 bin/ipxe.dsk
-rw-rw-r--. 1 kevin kevin 1048576 May 11 09:55 bin/ipxe.iso
-rw-rw-r--. 1 kevin

gmane.linux.redhat.fedora.infrastructure

Yet another freeze break: reviewstatus

[PATCH] - add db-fas01 to dns - add to puppet - based in larger partoff of db01's recipe

Freeze Break: shutdown search01-dev on virthost05 - setup db-fas01on virthost05

[Change Request] Fix pkgdb privileged operations for oldpython-bugzilla

Plan for tomorrow's Fedora Infrastructure meeting (2012-05-24 18UTC)

Questions regarding Koji, fedpkg and SCM

[Freeze break Request] Disable bugzilla integration

[PATCH] No cookie for easyfix

[PATCH] Typos...

Freeze break request: Update python-bugzilla on fas*, bapp01, app*

hello to everybody

Introduction

tagger inodes and beaker

Plan for tomorrow's Fedora Infrastructure meeting (2012-05-17 at18UTC)

FYI, pkgs git process cleanup

freeze break request: install trac-agilo-plugin on hosted

Meeting Agenda Item: Introduction Luciano Facchinelli

HOTFIX: MM crawler (ticket #3268)

Change to aliases file

Change to aliases file

Freeze break: update boot.fedoraproject.org to latest ipxe

Freeze break request: Update python-bugzilla on fas, bapp01, app