gmane.os.solaris.opencsw.maintainers

Re: cannot set overrides for Emacs: please review

Maciej (Matchek) Bliziński — 2012-05-25T15:03:32

2012/5/25 Ben Walton <bwalton< at >opencsw.org>:

It could be much simpler. Read the overrides from disk, generate
overrides from the recipe. If there's a mismatch, fail early with a
helpful error message. It's already an improvement and doesn't include
much complexity in the code or the execution path.
_______________________________________________
maintainers mailing list
maintainers< at >lists.opencsw.org
https://lists.opencsw.org/mailman/listinfo/maintainers
.:: This mailing list's archive is public. ::.

Re: mgar question: repackage for platformsmodulation

Maciej (Matchek) Bliziński — 2012-05-25T14:46:33

2012/5/25  <pfelecan-RJLij68YbUJAfugRpC6u6w< at >public.gmane.org>:

Sometimes GAR doesn't generate what you think it generates. For
dealing with checkpkg, I recommend forgetting about GAR for a second
and examining the actual package. Either the easy way via the browser
(start with buildfarm.opencsw.org) or the hard way, using pkgtrans.
Going from the GAR recipe directly to checkpkg error tags is a long
way and you can easily get confused if you don't examine what's
checkpkg actually seeing.


There are two very useful ones: platforms-remerge and platforms-repackage.
_______________________________________________
maintainers mailing list
maintainers-ZwoEplunGu0I44EcYr5p3di2O/JbrIOy< at >public.gmane.org
https://lists.opencsw.org/mailman/listinfo/maintainers
.:: This mailing list's archive is public. ::.

Re: cannot set overrides for Emacs: please review

Ben Walton — 2012-05-25T14:47:08

Excerpts from Maciej (Matchek) Bliziński's message of Fri May 25 10:43:17 -0400 2012:


This is likely a bit unorthodox, but if the target that generates the
overrides file had a dependency on trunk/Makefile, we could
automatically trigger a rebuild when the Makefile changes...

(There is probably a good reason not to do this though.)

Thanks
-Ben
--
Ben Walton
Systems Programmer - CHASS
University of Toronto
C:416.407.5610 | W:416.978.4302

_______________________________________________
maintainers mailing list
maintainers< at >lists.opencsw.org
https://lists.opencsw.org/mailman/listinfo/maintainers
.:: This mailing list's archive is public. ::.

Re: cannot set overrides for Emacs: please review

Maciej (Matchek) Bliziński — 2012-05-25T14:43:17

2012/5/25 Ben Walton <bwalton-RJLij68YbUJAfugRpC6u6w< at >public.gmane.org>

That's the most common typical problem.

Dago, even when GAR doesn't regenerate the overrides during repackage
stage, could it at least detect that there's a problem?

Peter, do you read the devel< at > mailing list? If not, I recommend
reading it at least for some time, to see what other people are doing,
and also to get feedback on your commits.

Maciej
_______________________________________________
maintainers mailing list
maintainers-ZwoEplunGu0I44EcYr5p3di2O/JbrIOy< at >public.gmane.org
https://lists.opencsw.org/mailman/listinfo/maintainers
.:: This mailing list's archive is public. ::.

mgar question: repackage for platforms modulation

2012-05-25T14:06:16

I'm "playing" with checkpkg overrides and must re-do the packaging for all
the platforms quite a few times.

Using "replatforms" is the rough equivalent of "clean platforms" which
means that everything is redone each time; quite longish for a big package
such as Emacs with 3 specific modulations in addition to the platform
ones.

Using "repackage" does the job for only the current platform which is not
enough when inter-architecture issues are tickling checkpkg...

I there a shorter and more complete way of doing this[1]?

TIA

[1] i.e., "repackage" for all platforms in one step
_______________________________________________
maintainers mailing list
maintainers-ZwoEplunGu0I44EcYr5p3di2O/JbrIOy< at >public.gmane.org
https://lists.opencsw.org/mailman/listinfo/maintainers
.:: This mailing list's archive is public. ::.

Re: cannot set overrides for Emacs: please review

Ben Walton — 2012-05-25T14:03:58

Excerpts from pfelecan's message of Fri May 25 09:59:50 -0400 2012:

Hi Peter,


After modifying overrides, you need to run: mgar remerge

The merge step generates the overrides file and it needs to be rebuilt
after any change.

Thanks
-Ben
--
Ben Walton
Systems Programmer - CHASS
University of Toronto
C:416.407.5610 | W:416.978.4302

_______________________________________________
maintainers mailing list
maintainers-ZwoEplunGu0I44EcYr5p3di2O/JbrIOy< at >public.gmane.org
https://lists.opencsw.org/mailman/listinfo/maintainers
.:: This mailing list's archive is public. ::.

cannot set overrides for Emacs: please review

2012-05-25T13:59:50

I'm approaching the end of the GARification for Emacs. However I'm stuck
with 5 overrides which are not taken into account eventough they are
explicited in the recipe.

- log:

RUNTIME_DEP_PKGS_CSWemacs-common += CSWemacscommon
If any of the reported errors were false positives, you can override them
pasting the lines below to the GAR recipe.
CHECKPKG_OVERRIDES_CSWemacs +=
file-with-bad-content|/usr/local|root/opt/csw/bin/emacs-athena
CHECKPKG_OVERRIDES_CSWemacs +=
file-with-bad-content|/usr/share|root/opt/csw/bin/emacs-athena
CHECKPKG_OVERRIDES_CSWemacs-gtk +=
file-with-bad-content|/usr/local|root/opt/csw/bin/emacs-gtk
CHECKPKG_OVERRIDES_CSWemacs-gtk +=
file-with-bad-content|/usr/share|root/opt/csw/bin/emacs-gtk

- Makefile:

CHECKPKG_OVERRIDES_CSWemacs-common+=missing-dependency|CSWemacscommon

CHECKPKG_OVERRIDES_CSWemacs+=file-with-bad-content|/usr/local|root/opt/csw/bin/emacs-athena
CHECKPKG_OVERRIDES_CSWemacs+=file-with-bad-content|/usr
/share|root/opt/csw/bin/emacs-athena

CHECKPKG_OVERRIDES_CSWemacs-gtk+=file-with-bad-content|/usr/local|root/opt/csw/bin/emacs-gtk
CHECKPKG_OVERRIDES_CSWemacs-gtk+=file-with-bad-content|/usr/share|root/opt/csw/bin/emacs-gtk

- buildfarm logs

  emacs_common:
http://buildfarm.opencsw.org/pkgdb/srv4/0213609a932f87a2bd387ae4312ef420/
  emacs:       
http://buildfarm.opencsw.org/pkgdb/srv4/e70220797cdeac77550d274c96b73e26/
  emacs_gtk:   
http://buildfarm.opencsw.org/pkgdb/srv4/ed88fc2a74985edc60ccec19cfdda9c6/

TIA



_______________________________________________
maintainers mailing list
maintainers-ZwoEplunGu0I44EcYr5p3di2O/JbrIOy< at >public.gmane.org
https://lists.opencsw.org/mailman/listinfo/maintainers
.:: This mailing list's archive is public. ::.

Re: checkpkg problem under Solaris 11 ?

Maciej (Matchek) Bliziński — 2012-05-25T11:07:59

2012/5/25 Maciej (Matchek) Bliziński <maciej< at >opencsw.org>:

After a bit of digging around, I arrived at the obvious conclusion: On
Solaris 11, the /var/sadm/install/contents file does not contain any
information about system files. We need to implement a new method of
getting files into the database, or create a fake file that can be
used as a compatibility layer.

In other words, Solaris 11 is too different from Solaris 10 for our
code to just work.
_______________________________________________
maintainers mailing list
maintainers< at >lists.opencsw.org
https://lists.opencsw.org/mailman/listinfo/maintainers
.:: This mailing list's archive is public. ::.

Re: Problem with csw-upload-pkg?

Maciej (Matchek) Bliziński — 2012-05-25T09:49:19

2012/5/25 Peter Bonivart <bonivart< at >opencsw.org>:

I looked around the code and could not find any problems. Added some
more logging to the application, and saw that the live web app did not
pick up the changes. So I restarted apache... and the problem
disappeared. So we don't know what was the problem, but the next time
we'll have some more logging information available.

Maciej
_______________________________________________
maintainers mailing list
maintainers< at >lists.opencsw.org
https://lists.opencsw.org/mailman/listinfo/maintainers
.:: This mailing list's archive is public. ::.

Re: Problem with csw-upload-pkg?

Peter Bonivart — 2012-05-25T09:24:42

On Fri, May 25, 2012 at 10:57 AM, Maciej (Matchek) Bliziński
<maciej< at >opencsw.org> wrote:

Thanks. I've had the problem since the 22nd though.

/peter
_______________________________________________
maintainers mailing list
maintainers< at >lists.opencsw.org
https://lists.opencsw.org/mailman/listinfo/maintainers
.:: This mailing list's archive is public. ::.

Re: Problem with csw-upload-pkg?

Maciej (Matchek) Bliziński — 2012-05-25T08:57:19

2012/5/25 Peter Bonivart <bonivart-RJLij68YbUJAfugRpC6u6w< at >public.gmane.org>:

Will investigate. I fear it's a side effect of my yesterday
unsuccessful attempt to set up 5.11 checkpkg infra.
_______________________________________________
maintainers mailing list
maintainers-ZwoEplunGu0I44EcYr5p3di2O/JbrIOy< at >public.gmane.org
https://lists.opencsw.org/mailman/listinfo/maintainers
.:: This mailing list's archive is public. ::.

Re: checkpkg problem under Solaris 11 ?

Maciej (Matchek) Bliziński — 2012-05-25T08:52:02

2012/5/25 Yann Rouillard <yann< at >pleiades.fr.eu.org>

I'm not sure if GAR's behavior is defined in this case, or what
options it would use. checkpkg doesn't care what it is called by, so
as far as checkpkg debugging is concerned, you only need to look at
the checkpkg invocation and checkpkg configuration (e.g. which
database does it use?).


Yes, it's normal in the sense that it has never been set up nor
tested, it yet has to be done.
_______________________________________________
maintainers mailing list
maintainers< at >lists.opencsw.org
https://lists.opencsw.org/mailman/listinfo/maintainers
.:: This mailing list's archive is public. ::.

Problem with csw-upload-pkg?

Peter Bonivart — 2012-05-25T08:06:15

I have some weird problem with checkpkg. I'm trying to upload the bind
set of packages which I have done many times before, they were just
built in GAR passing checkpkg checks.

bonivart< at >login[build.2012-05-22]$ pwd
/home/bonivart/staging/build.2012-05-22
bonivart< at >login[build.2012-05-22]$ ls
bind-9.8.3,REV=2012.05.22-SunOS5.9-i386-CSW.pkg.gz
bind-9.8.3,REV=2012.05.22-SunOS5.9-sparc-CSW.pkg.gz
bind_chroot-9.8.3,REV=2012.05.22-SunOS5.9-all-CSW.pkg.gz
bind_dev-9.8.3,REV=2012.05.22-SunOS5.9-i386-CSW.pkg.gz
bind_dev-9.8.3,REV=2012.05.22-SunOS5.9-sparc-CSW.pkg.gz
bind_utils-9.8.3,REV=2012.05.22-SunOS5.9-i386-CSW.pkg.gz
bind_utils-9.8.3,REV=2012.05.22-SunOS5.9-sparc-CSW.pkg.gz
libbind-9.8.3,REV=2012.05.22-SunOS5.9-i386-CSW.pkg.gz
libbind-9.8.3,REV=2012.05.22-SunOS5.9-sparc-CSW.pkg.gz
bonivart< at >login[build.2012-05-22]$ csw-upload-pkg *
Processing 9 file(s). Please wait.
Uploading 'bind-9.8.3,REV=2012.05.22-SunOS5.9-i386-CSW.pkg.gz'
ERROR:root:File metadata was not found in the database.  This happens
when the package you're trying to upload was never unpacked and
imported into the database.  To fix the problem, run checkpkg against
your package and try importing again.
Traceback (most recent call last):
  File "/home/bonivart/opencsw/.buildsys/v2/bin/csw-upload-pkg", line
627, in <module>
    uploader.Upload()
  File "/home/bonivart/opencsw/.buildsys/v2/bin/csw-upload-pkg", line
173, in Upload
    raise DataError("file_metadata is empty: %s" % repr(file_metadata))
__main__.DataError: file_metadata is empty: None

Is it the actual upload that is the problem because it fails quickly
and the traceback mentions it?

/peter
_______________________________________________
maintainers mailing list
maintainers-ZwoEplunGu0I44EcYr5p3di2O/JbrIOy< at >public.gmane.org
https://lists.opencsw.org/mailman/listinfo/maintainers
.:: This mailing list's archive is public. ::.

Re: checkpkg problem under Solaris 11 ?

Yann Rouillard — 2012-05-25T07:31:31

Hi Maciej,

The errors happen when I do a "mgar package" on Solaris 11 sparc. I will
check what is the exact checkpkg command launched so you can easily
reproduce it.

BTW, is this normal that we can't check against 5.11 ?

Yann


2012/5/24 Maciej (Matchek) Bliziński <maciej-RJLij68YbUJAfugRpC6u6w< at >public.gmane.org>

_______________________________________________
maintainers mailing list
maintainers-ZwoEplunGu0I44EcYr5p3di2O/JbrIOy< at >public.gmane.org
https://lists.opencsw.org/mailman/listinfo/maintainers
.:: This mailing list's archive is public. ::.

Re: checkpkg problem under Solaris 11 ?

Maciej (Matchek) Bliziński — 2012-05-24T21:50:30

Continuing to investigate: I'm doing the wrong thing, checking a 5.11
package against a 5.10 catalog (into which it can never be inserted).
Checking works:

$ bin/checkpkg --arch sparc --os-release SunOS5.10 --catalog-release
unstable /home/yann/build/libssl_dev-1.0.1c\,REV\=2012.05.24-SunOS5.11-sparc-UNCOMMITTED.pkg.gz
INFO:root:Juicing the srv4 package stream files...
100% |#####################################################################################################################################################################|
INFO:root:Unwrapping candies...
100% |#####################################################################################################################################################################|
INFO:root:Tasting candies one by one...
100% |#####################################################################################################################################################################|
INFO:root:Tasting them all at once...
INFO:root:Stuffing the candies under the pillow...
100% |#####################################################################################################################################################################|
CSWlibssl-dev:
* File root/opt/csw/share/doc/libssl_dev/CHANGES contains bad content:
'/usr/local'. If it's a legacy file you can't modify, or if you
investigated the issue and the string does not pose a real issue, you can
override this error.
* File root/opt/csw/share/doc/libssl_dev/INSTALL contains bad content:
'/usr/local'. If it's a legacy file you can't modify, or if you
investigated the issue and the string does not pose a real issue, you can
override this error.
* File root/opt/csw/share/doc/libssl_dev/FAQ contains bad content:
'/usr/local'. If it's a legacy file you can't modify, or if you
investigated the issue and the string does not pose a real issue, you can
override this error.
If any of the reported errors were false positives, you can override them
pasting the lines below to the GAR recipe.
CHECKPKG_OVERRIDES_CSWlibssl-dev += pkginfo-opencsw-repository-uncommitted
Please note that checkpkg isn't suggesting you should simply add these overrides
to the Makefile. It only informs what the overrides could look like. You need
to understand what are the reported issues about and use your best judgement to
decide whether to fix the underlying problems or override them. For more
information, scroll up and read the detailed messages. To easily inspect
packages you've just built, visit: http://buildfarm.opencsw.org/pkgdb/srv4/

...so I'm not able to reproduce the error you're getting. Can you
provide more information?
_______________________________________________
maintainers mailing list
maintainers< at >lists.opencsw.org
https://lists.opencsw.org/mailman/listinfo/maintainers
.:: This mailing list's archive is public. ::.

Re: checkpkg problem under Solaris 11 ?

Maciej (Matchek) Bliziński — 2012-05-24T21:46:15

2012/5/24 Maciej (Matchek) Bliziński <maciej-RJLij68YbUJAfugRpC6u6w< at >public.gmane.org>



Maybe I should clarify what I mean: the package database on the buildfarm
does not have the system files imported. Here's what happens when you try
to test the package, the error message says it all:

$ bin/checkpkg --arch sparc --os-release SunOS5.11 --catalog-release
unstable /home/yann/build/libssl_dev-1.0.1c\,
REV\=2012.05.24-SunOS5.11-sparc-UNCOMMITTED.pkg.gz
INFO:root:Juicing the srv4 package stream files...
100%
|#####################################################################################################################################################################|
Traceback (most recent call last):
  File "bin/checkpkg", line 197, in <module>
    main()
  File "bin/checkpkg", line 148, in main
    dm.VerifyContents(sqo_osrel, sqo_arch)
  File "/home/maciej/src/opencsw-git/gar/v2/lib/python/database.py", line
139, in VerifyContents
    sqo_osrel.short_name, sqo_arch.name))
database.DatabaseError: Checkpkg can't find system files for SunOS5.11
sparc in the cache database.  These are files such as /usr/lib/libc.so.1.
 Private DB setup: you can only check packages built for the same Solaris
version you're running on this machine.  For instance, you can't check a
SunOS5.9 package on SunOS5.10. Shared DB setup (e.g. OpenCSW maintainers):
If you have one home directory on multiple hosts, make sure you run
checkpkg on the host you intended to.  To fix, go to a sparc SunOS5.11 host
and execute: pkgdb system-files-to-file; pkgdb import-system-file
install-contents-SunOS5.11-sparc.pickle; See
http://wiki.opencsw.org/checkpkg for more information.

I'll see if I can prepare the package database to support Solaris 11 checks.
_______________________________________________
maintainers mailing list
maintainers-ZwoEplunGu0I44EcYr5p3di2O/JbrIOy< at >public.gmane.org
https://lists.opencsw.org/mailman/listinfo/maintainers
.:: This mailing list's archive is public. ::.

Re: checkpkg problem under Solaris 11 ?

Maciej (Matchek) Bliziński — 2012-05-24T21:42:07

2012/5/24 Yann Rouillard <yann-sfefEsa/hvEONl+O2FatCh2eb7JE58TQ< at >public.gmane.org>


One question ‒ how can you check any 5.11 package at all, since checkpkg
doesn't support checking packages against SunOS5.11 catalogs?
_______________________________________________
maintainers mailing list
maintainers-ZwoEplunGu0I44EcYr5p3di2O/JbrIOy< at >public.gmane.org
https://lists.opencsw.org/mailman/listinfo/maintainers
.:: This mailing list's archive is public. ::.

Re: checkpkg problem under Solaris 11 ?

Yann Rouillard — 2012-05-24T21:39:38

You should be able to reproduce it by using the checkpkg command on the
solaris 11 package I built:
/home/yann/build/libssl_dev-1.0.1c\,REV\=2012.05.24-SunOS5.11-sparc-UNCOMMITTED.pkg.gz

Yann

2012/5/24 Maciej (Matchek) Bliziński <maciej-RJLij68YbUJAfugRpC6u6w< at >public.gmane.org>

_______________________________________________
maintainers mailing list
maintainers-ZwoEplunGu0I44EcYr5p3di2O/JbrIOy< at >public.gmane.org
https://lists.opencsw.org/mailman/listinfo/maintainers
.:: This mailing list's archive is public. ::.

Re: checkpkg problem under Solaris 11 ?

Maciej (Matchek) Bliziński — 2012-05-24T21:27:45

2012/5/24 Yann Rouillard <yann-sfefEsa/hvEONl+O2FatCh2eb7JE58TQ< at >public.gmane.org>


OK, how exactly can I reproduce the problem?
_______________________________________________
maintainers mailing list
maintainers-ZwoEplunGu0I44EcYr5p3di2O/JbrIOy< at >public.gmane.org
https://lists.opencsw.org/mailman/listinfo/maintainers
.:: This mailing list's archive is public. ::.

Re: checkpkg problem under Solaris 11 ?

Yann Rouillard — 2012-05-24T21:14:49

I was able to build openssl 1.0 without problem under Solaris 9 and 10, so
I am not sure it is a problem with the old stub.
Anyway, it really seems empty:
http://buildfarm.opencsw.org/pkgdb/srv4/897ab235d427900d2e3aeb5013b47865/files/

Yann

2012/5/24 Maciej (Matchek) Bliziński <maciej-RJLij68YbUJAfugRpC6u6w< at >public.gmane.org>

_______________________________________________
maintainers mailing list
maintainers-ZwoEplunGu0I44EcYr5p3di2O/JbrIOy< at >public.gmane.org
https://lists.opencsw.org/mailman/listinfo/maintainers
.:: This mailing list's archive is public. ::.

Re: checkpkg problem under Solaris 11 ?

Maciej (Matchek) Bliziński — 2012-05-24T21:01:11

Try looking if the old stub is really empty. Have you looked? Maybe you
looked in the wrong place? Start with buildfarm.opencsw.org.
_______________________________________________
maintainers mailing list
maintainers-ZwoEplunGu0I44EcYr5p3di2O/JbrIOy< at >public.gmane.org
https://lists.opencsw.org/mailman/listinfo/maintainers
.:: This mailing list's archive is public. ::.