http://blog.gmane.org/gmane.comp.lang.perl.perl5.porters hourly 1 1901-01-01T00:00+00:00 http://gmane.org/img/gmane-25t.png http://gmane.org http://comments.gmane.org/gmane.comp.lang.perl.perl5.porters/64642 Automated smoke report for 5.11.0 patch 34995 maldoror.bath.planit.group: Intel(R) Core(TM)2 CPU 6700 < at > 2.66GHz(~2660 MHz) (x86/2 cpu) on MSWin32 - WinXP/.Net SP3 using cl version 13.10.3077 smoketime 5 hours 30 minutes (average 16 minutes 32 seconds) Summary: FAIL(F) O = OK F = Failure(s), extended report at the bottom X = Failure(s) under TEST but not under harness ? = still running or test results not (yet) available Build failures during: - = unknown or N/A c = Configure, m = make, M = make (after miniperl), t = make test-prep 34995 Configuration (common) -DCCTYPE=MSVC70FREE -DINST_TOP=$(INST_DRV)\Smoke\doesntexist ----------- --------------------------------------------------------- O O O O -Dusemymalloc O O -Duselargefiles O O -Duselargefiles -Dusemymalloc O O -Duseithreads -Uuseimpsys O O -Duseithreads -Uuseimpsys -Dusemymalloc O O -Duseithreads -Uuseimpsys -Duselargefiles O O -Duseithreads -Uuseimpsys -Duselargefiles -Dusemymalloc O F -Duseithreads O O -Duseithreads -Duselargefiles | +--------- -DDEBUGGING +----------- no debugging Locally applied patches: DEVEL SMOKE34995 Failures: (common-args) -DCCTYPE=MSVC70FREE -DINST_TOP=$(INST_DRV)\Smoke\doesntexist [default] -DDEBUGGING -Duseithreads ../ext/IO/t/io_sock.t.......................................FAILED ../ext/PerlIO/t/ioleaks.t...................................FAILED ../lib/Attribute/Handlers/t/linerep.t.......................FAILED Compiler messages(MSWin32): Cwd.xs(77) : warning C4101: 'symlink' : unreferenced local variable Steve Hay 2008-12-04T04:28:00 http://comments.gmane.org/gmane.comp.lang.perl.perl5.porters/64640 Attached is a patch for this problem. The root of the problem is that casefold() did not realize that there could be multiple lines in the input file for a given character, and so retained only information from whatever happened to be the last line. I solved this by adding fields to the returned hash to return information from the other lines. The existing fields return the exact same information as before, so no existing code should be broken. casefold() was also expecting syntax in the Unicode database that was changed in Version 3.2 (We're at 5.1 now). I changed it so it accepts either syntax, so that it can correctly be run on old and new versions of Unicode. I also took the liberty of significantly upgrading the documentation for this module, correcting wrong statements, broken links, using better pod constructs, etc, and added detail about the interface so that hopefully a reader won't have to experiment or read the code, as I had to do, to find out what really gets returned. --- UCD.pm.blead2008-11-17 04:58:31.000000000 -0700 +++ UCD.pm2008-12-03 19:22:07.000000000 -0700 < at >< at > -61,9 +61,20 < at >< at > =head1 DESCRIPTION -The Unicode::UCD module offers a simple interface to the Unicode +The Unicode::UCD module offers a series of functions that +provide a simple interface to the Unicode Character Database. +=head2 code point argument + +Some of the functions are called with a I<code point argument>, which is either +a decimal or a hexadecimal scalar designating a Unicode code point, or C<U+> +followed by hexadecimals designating a Unicode code point. In other words, if +you want a code point to be interpreted as a hexadecimal number, you must +prefix it with either C<0x> or C<U+>, because a string like e.g. C<123> will be +interpreted as a decimal code point. Also note that Unicode is B<not> limited +to 16 bits (the number of Unicode code points is open-ended, in theory +unlimited): you may have more than 4 hexdigits. =cut my $UNICODEFH; < at >< at > -92,46 +103,136 < at >< at > return $f; } -=head2 charinfo +=head2 B<charinfo()> use Unicode::UCD 'charinfo'; my $charinfo = charinfo(0x41); -charinfo() returns a reference to a hash that has the following fields -as defined by the Unicode standard: +This returns information about the input L</code point argument> +as a reference to a hash of fields as defined by the Unicode +standard. If the L</code point argument> is not assigned in the standard +(i.e., has the general category C<Cn> meaning C<Unassigned>) +or is a non-character (meaning it is guaranteed to never be assigned in +the standard), +B<undef> is returned. + +Fields that aren't applicable to the particular code point argument exist in the +returned hash, and are empty. + +The keys in the hash with the meanings of their values are: + +=over + +=item B<code> + +the input L</code point argument> expressed in hexadecimal, with leading zeros +added if necessary to make it contain at least four hexdigits + +=item B<name> + +name of I<code>, all IN UPPER CASE. +Some control-type code points do not have names. +This field will be empty for C<Surrogate> and C<Private Use> code points, +and for the others without a name, +it will contain a description enclosed in angle brackets, like +C<E<lt>controlE<gt>>. + + +=item B<category> + +The short name of the general category of I<code>. +This will match one of the keys in the hash returned by L</general_categories()>. + +=item B<combining> + +the combining class number for I<code> used in the Canonical Ordering Algorithm. +For Unicode 5.1, this is described in Section 3.11 C<Canonical Ordering Behavior> +available at +L<http://www.unicode.org/versions/Unicode5.1.0/> + +=item B<bidi> + +bidirectional type of I<code>. +This will match one of the keys in the hash returned by L</bidi_types()>. + +=item B<decomposition> + +is empty if I<code> has no decomposition; or is one or more codes +(separated by spaces) that taken in order represent a decomposition for +I<code>. Each has at least four hexdigits. +The codes may be preceded by a word enclosed in angle brackets then a space, +like C<E<lt>compatE<gt> >, giving the type of decomposition + +=item B<decimal> + +if I<code> is a decimal digit this is its integer numeric value + +=item B<digit> + +if I<code> represents a whole number, this is its integer numeric value + +=item B<numeric> + +if I<code> represents a whole or rational number, this is its numeric value. +Rational values are expressed as a string like C<1/4>. + +=item B<mirrored> + +C<Y> or C<N> designating if I<code> is mirrored in bidirectional text + +=item B<unicode10> + +name of I<code> in the Unicode 1.0 standard if one +existed for this code point and is different from the current name + +=item B<comment> + +ISO 10646 comment field. +It appears in parentheses in the ISO 10646 names list, +or contains an asterisk to indicate there is +a note for this code point in Annex P of that standard. + +=item B<upper> + +is empty if there is no single code point uppercase mapping for I<code>; +otherwise it is that mapping expressed as at least four hexdigits. +(L</casespec()> should be used in addition to B<charinfo()> +for case mappings when the calling program can cope with multiple code point +mappings.) + +=item B<lower> + +is empty if there is no single code point lowercase mapping for I<code>; +otherwise it is that mapping expressed as at least four hexdigits. +(L</casespec()> should be used in addition to B<charinfo()> +for case mappings when the calling program can cope with multiple code point +mappings.) + +=item B<title> - key +is empty if there is no single code point titlecase mapping for I<code>; +otherwise it is that mapping expressed as at least four hexdigits. +(L</casespec()> should be used in addition to B<charinfo()> +for case mappings when the calling program can cope with multiple code point +mappings.) - code code point with at least four hexdigits - name name of the character IN UPPER CASE - category general category of the character - combining classes used in the Canonical Ordering Algorithm - bidi bidirectional type - decomposition character decomposition mapping - decimal if decimal digit this is the integer numeric value - digit if digit this is the numeric value - numeric if numeric is the integer or rational numeric value - mirrored if mirrored in bidirectional text - unicode10 Unicode 1.0 name if existed and different - comment ISO 10646 comment field - upper uppercase equivalent mapping - lower lowercase equivalent mapping - title titlecase equivalent mapping - - block block the character belongs to (used in \p{In...}) - script script the character belongs to - -If no match is found, a reference to an empty hash is returned. - -The C<block> property is the same as returned by charinfo(). It is -not defined in the Unicode Character Database proper (Chapter 4 of the -Unicode 3.0 Standard, aka TUS3) but instead in an auxiliary database -(Chapter 14 of TUS3). Similarly for the C<script> property. +=item B<block> + +block I<code> belongs to (used in \p{In...}). +See L</Blocks versus Scripts>. + + +=item B<script> + +script I<code> belongs to. +See L</Blocks versus Scripts>. + +=back Note that you cannot do (de)composition and casing based solely on the -above C<decomposition> and C<lower>, C<upper>, C<title>, properties, -you will need also the compexcl(), casefold(), and casespec() functions. +I<decomposition>, I<combining>, I<lower>, I<upper>, and I<title> fields; +you will need also the L</compexcl()>, and L</casespec()> functions. =cut < at >< at > -305,29 +406,30 < at >< at > _search($range, 0, $#$range, $code); } -=head2 charblock +=head2 B<charblock()> use Unicode::UCD 'charblock'; my $charblock = charblock(0x41); my $charblock = charblock(1234); - my $charblock = charblock("0x263a"); + my $charblock = charblock(0x263a); my $charblock = charblock("U+263a"); my $range = charblock('Armenian'); -With a B<code point argument> charblock() returns the I<block> the character -belongs to, e.g. C<Basic Latin>. Note that not all the character -positions within all blocks are defined. +With a L</code point argument> charblock() returns the I<block> the code point +belongs to, e.g. C<Basic Latin>. +If the code point is unassigned, this returns the block it would belong to if +it were assigned (which it may in future versions of the Unicode Standard). See also L</Blocks versus Scripts>. If supplied with an argument that can't be a code point, charblock() tries -to do the opposite and interpret the argument as a character block. The +to do the opposite and interpret the argument as a code point block. The return value is a I<range>: an anonymous list of lists that contain I<start-of-range>, I<end-of-range> code point pairs. You can test whether -a code point is in a range using the L</charinrange> function. If the -argument is not a known character block, C<undef> is returned. +a code point is in a range using the L</charinrange()> function. If the +argument is not a known code point block, B<undef> is returned. =cut < at >< at > -369,7 +471,7 < at >< at > } } -=head2 charscript +=head2 B<charscript()> use Unicode::UCD 'charscript'; < at >< at > -379,17 +481,18 < at >< at > my $range = charscript('Thai'); -With a B<code point argument> charscript() returns the I<script> the -character belongs to, e.g. C<Latin>, C<Greek>, C<Han>. - -See also L</Blocks versus Scripts>. +With a L</code point argument> charscript() returns the I<script> the +code point belongs to, e.g. C<Latin>, C<Greek>, C<Han>. +If the code point is unassigned, it returns B<undef> If supplied with an argument that can't be a code point, charscript() tries -to do the opposite and interpret the argument as a character script. The +to do the opposite and interpret the argument as a code point script. The return value is a I<range>: an anonymous list of lists that contain I<start-of-range>, I<end-of-range> code point pairs. You can test whether a -code point is in a range using the L</charinrange> function. If the -argument is not a known character script, C<undef> is returned. +code point is in a range using the L</charinrange()> function. If the +argument is not a known code point script, B<undef> is returned. + +See also L</Blocks versus Scripts>. =cut < at >< at > -434,14 +537,14 < at >< at > } } -=head2 charblocks +=head2 B<charblocks()> use Unicode::UCD 'charblocks'; my $charblocks = charblocks(); charblocks() returns a reference to a hash with the known block names -as the keys, and the code point ranges (see L</charblock>) as the values. +as the keys, and the code point ranges (see L</charblock()>) as the values. See also L</Blocks versus Scripts>. < at >< at > -452,14 +555,14 < at >< at > return dclone \%BLOCKS; } -=head2 charscripts +=head2 B<charscripts()> use Unicode::UCD 'charscripts'; my $charscripts = charscripts(); charscripts() returns a reference to a hash with the known script -names as the keys, and the code point ranges (see L</charscript>) as +names as the keys, and the code point ranges (see L</charscript()>) as the values. See also L</Blocks versus Scripts>. < at >< at > -471,48 +574,12 < at >< at > return dclone \%SCRIPTS; } -=head2 Blocks versus Scripts - -The difference between a block and a script is that scripts are closer -to the linguistic notion of a set of characters required to present -languages, while block is more of an artifact of the Unicode character -numbering and separation into blocks of (mostly) 256 characters. - -For example the Latin B<script> is spread over several B<blocks>, such -as C<Basic Latin>, C<Latin 1 Supplement>, C<Latin Extended-A>, and -C<Latin Extended-B>. On the other hand, the Latin script does not -contain all the characters of the C<Basic Latin> block (also known as -the ASCII): it includes only the letters, and not, for example, the digits -or the punctuation. - -For blocks see http://www.unicode.org/Public/UNIDATA/Blocks.txt - -For scripts see UTR #24: http://www.unicode.org/unicode/reports/tr24/ - -=head2 Matching Scripts and Blocks - -Scripts are matched with the regular-expression construct -C<\p{...}> (e.g. C<\p{Tibetan}> matches characters of the Tibetan script), -while C<\p{In...}> is used for blocks (e.g. C<\p{InTibetan}> matches -any of the 256 code points in the Tibetan block). - -=head2 Code Point Arguments - -A I<code point argument> is either a decimal or a hexadecimal scalar -designating a Unicode character, or C<U+> followed by hexadecimals -designating a Unicode character. In other words, if you want a code -point to be interpreted as a hexadecimal number, you must prefix it -with either C<0x> or C<U+>, because a string like e.g. C<123> will -be interpreted as a decimal code point. Also note that Unicode is -B<not> limited to 16 bits (the number of Unicode characters is -open-ended, in theory unlimited): you may have more than 4 hexdigits. - -=head2 charinrange +=head2 B<charinrange()> In addition to using the C<\p{In...}> and C<\P{In...}> constructs, you can also test whether a code point is in the I<range> as returned by -L</charblock> and L</charscript> or as the values of the hash returned -by L</charblocks> and L</charscripts> by using charinrange(): +L</charblock()> and L</charscript()> or as the values of the hash returned +by L</charblocks()> and L</charscripts()> by using charinrange(): use Unicode::UCD qw(charscript charinrange); < at >< at > -567,18 +634,19 < at >< at > return dclone \%GENERAL_CATEGORIES; } -=head2 general_categories +=head2 B<general_categories()> use Unicode::UCD 'general_categories'; my $categories = general_categories(); -The general_categories() returns a reference to a hash which has short +This returns a reference to a hash which has short general category names (such as C<Lu>, C<Nd>, C<Zs>, C<S>) as keys and long names (such as C<UppercaseLetter>, C<DecimalNumber>, C<SpaceSeparator>, C<Symbol>) as values. The hash is reversible in case you need to go from the long names to the short names. The general category is the -one returned from charinfo() under the C<category> key. +one returned from +L</charinfo()> under the C<category> key. =cut < at >< at > -605,40 +673,45 < at >< at > 'ON' => 'Other Neutrals', ); -sub bidi_types { - return dclone \%BIDI_TYPES; -} - -=head2 bidi_types +=head2 B<bidi_types()> use Unicode::UCD 'bidi_types'; my $categories = bidi_types(); -The bidi_types() returns a reference to a hash which has the short +This returns a reference to a hash which has the short bidi (bidirectional) type names (such as C<L>, C<R>) as keys and long names (such as C<Left-to-Right>, C<Right-to-Left>) as values. The hash is reversible in case you need to go from the long names to the -short names. The bidi type is the one returned from charinfo() +short names. The bidi type is the one returned from +L</charinfo()> under the C<bidi> key. For the exact meaning of the various bidi classes the Unicode TR9 is recommended reading: -http://www.unicode.org/reports/tr9/tr9-17.html +L<http://www.unicode.org/reports/tr9/> (as of Unicode 5.0.0) =cut -=head2 compexcl +sub bidi_types { + return dclone \%BIDI_TYPES; +} + +=head2 B<compexcl()> use Unicode::UCD 'compexcl'; - my $compexcl = compexcl("09dc"); + my $compexcl = compexcl(0x09dc); -The compexcl() returns the composition exclusion (that is, if the -character should not be produced during a precomposition) of the -character specified by a B<code point argument>. +This returns B<true> if the +L</code point argument> should not be produced by composition normalization, +B<AND> if that fact is not otherwise determinable from the Unicode data base. +It currently does not return B<true> if the code point has a decomposition +consisting of another single code point, nor if its decomposition starts +with a code point whose combining class is non-zero. Code points that meet +either of these conditions should also not be produced by composition +normalization. -If there is a composition exclusion for the character, true is -returned. Otherwise, false is returned. +It returns B<false> otherwise. =cut < at >< at > -670,46 +743,126 < at >< at > return exists $COMPEXCL{$code}; } -=head2 casefold +=head2 B<casefold()> use Unicode::UCD 'casefold'; - my $casefold = casefold("00DF"); + my $casefold = casefold(0xDF); + if (defined $casefold) { + my < at >full_fold_hex = split / /, $casefold->{'full'}; + my $full_fold_string = + join "", map {chr(hex($_))} < at >full_fold_hex; + my < at >turkic_fold_hex = + split / /, ($casefold->{'turkic'} ne "") + ? $casefold->{'turkic'} + : $casefold->{'full'}; + my $turkic_fold_string = + join "", map {chr(hex($_))} < at >turkic_fold_hex; + } + if (defined $casefold && $casefold->{'simple'} ne "") { + my $simple_fold_hex = $casefold->{'simple'}; + my $simple_fold_string = chr(hex($simple_fold_hex)); + } -The casefold() returns the locale-independent case folding of the -character specified by a B<code point argument>. +This returns the (almost) locale-independent case folding of the +character specified by the L</code point argument>. -If there is a case folding for that character, a reference to a hash +If there is no case folding for that code point, B<undef> is returned. + +If there is a case folding for that code point, a reference to a hash with the following fields is returned: - key +=over + +=item B<code> + +the input L</code point argument> expressed in hexadecimal, with leading zeros +added if necessary to make it contain at least four hexdigits + +=item B<full> + +one or more codes (separated by spaces) that taken in order give the +code points for the case folding for I<code>. +Each has at least four hexdigits. + +=item B<simple> + +is empty, or is exactly one code with at least four hexdigits which can be used +as an alternative case folding when the calling program cannot cope with the +fold being a sequence of multiple code points. If I<full> is just one code +point, then I<simple> equals I<full>. If there is no single code point folding +defined for I<code>, then I<simple> is the empty string. Otherwise, it is an +inferior, but still better-than-nothing alternative folding to I<full>. + +=item B<mapping> + +is the same as I<simple> if I<simple> is not empty, and it is the same as I<full> +otherwise. It can be considered to be the simplest possible folding for +I<code>. It is defined primarily for backwards compatibility. + +=item B<status> + +is C<C> (for C<common>) if the best possible fold is a single code point +(I<simple> equals I<full> equals I<mapping>). It is C<S> if there are distinct +folds, I<simple> and I<full> (I<mapping> equals I<simple>). And it is C<F> if +there only a I<full> fold (I<mapping> equals I<full>; I<simple> is empty). Note +that this +describes the contents of I<mapping>. It is defined primarily for backwards +compatibility. + +On versions 3.1 and earlier of Unicode, I<status> can also be +C<I> which is the same as C<C> but is a special case for dotted uppercase I and +dotless lowercase i: - code code point with at least four hexdigits - status "C", "F", "S", or "I" - mapping one or more codes separated by spaces - -The meaning of the I<status> is as follows: - - C common case folding, common mappings shared - by both simple and full mappings - F full case folding, mappings that cause strings - to grow in length. Multiple characters are separated - by spaces - S simple case folding, mappings to single characters - where different from F - I special case for dotted uppercase I and - dotless lowercase i - - If this mapping is included, the result is - case-insensitive, but dotless and dotted I's - are not distinguished - - If this mapping is excluded, the result is not - fully case-insensitive, but dotless and dotted - I's are distinguished +=over -If there is no case folding for that character, C<undef> is returned. +=item B<*> + +If you use this C<I> mapping, the result is case-insensitive, +but dotless and dotted I's are not distinguished + +=item B<*> + +If you exclude this C<I> mapping, the result is not fully case-insensitive, but +dotless and dotted I's are distinguished + +=back + +=item B<turkic> + +contains any special folding for Turkic languages. For versions of Unicode +starting with 3.2, this field is empty unless I<code> has a different folding +in Turkic languages, in which case it is one or more codes (separated by +spaces) that taken in order give the code points for the case folding for +I<code> in those languages. +Each code has at least four hexdigits. +Note that this folding does not maintain canonical equivalence without +additional processing. + +For versions of Unicode 3.1 and earlier, this field is empty unless there is a +special folding for Turkic languages, in which case I<status> is C<I>, and +I<mapping>, I<full>, I<simple>, and I<turkic> are all equal. + +=back + +Programs that want complete generality and the best folding results should use +the folding contained in the I<full> field. But note that the fold for some +code points will be a sequence of multiple code points. + +Programs that can't cope with the fold mapping being multiple code points can +use the folding contained in the I<simple> field, with the loss of some +generality. In Unicode 5.1, about 7% of the defined foldings have no single +code point folding. + +The I<mapping> and I<status> fields are provided for backwards compatibility for +existing programs. They contain the same values as in previous versions of +this function. + +Locale is not completely independent. The I<turkic> field contains results to +use when the locale is a Turkic language. For more information about case mappings see -http://www.unicode.org/unicode/reports/tr21/ +L<http://www.unicode.org/unicode/reports/tr21> =cut < at >< at > -720,11 +873,45 < at >< at > if (openunicode(\$CASEFOLDFH, "CaseFolding.txt")) { local $_; while (<$CASEFOLDFH>) { -if (/^([0-9A-F]+); ([CFSI]); ([0-9A-F]+(?: [0-9A-F]+)*);/) { +if (/^([0-9A-F]+); ([CFIST]); ([0-9A-F]+(?: [0-9A-F]+)*);/) { my $code = hex($1); - $CASEFOLD{$code} = { code => $1, - status => $2, - mapping => $3 }; + $CASEFOLD{$code}{'code'} = $1; + $CASEFOLD{$code}{'turkic'} = "" unless + defined $CASEFOLD{$code}{'turkic'}; + if ($2 eq 'C' || $2 eq 'I') {# 'I' is only on 3.1 and +# earlier Unicodes +# Both entries there (I +# only checked 3.1) are +# the same as C, and +# there are no other +# entries for those +# codepoints, so treat +# as if C, but override +# the turkic one for +# 'I'. +$CASEFOLD{$code}{'status'} = $2; +$CASEFOLD{$code}{'full'} = $CASEFOLD{$code}{'simple'} = +$CASEFOLD{$code}{'mapping'} = $3; +$CASEFOLD{$code}{'turkic'} = $3 if $2 eq 'I'; + } elsif ($2 eq 'F') { +$CASEFOLD{$code}{'full'} = $3; +unless (defined $CASEFOLD{$code}{'simple'}) { +$CASEFOLD{$code}{'simple'} = ""; +$CASEFOLD{$code}{'mapping'} = $3; +$CASEFOLD{$code}{'status'} = $2; +} + } elsif ($2 eq 'S') { + + +# There can't be a simple without a full, and simple +# overrides all but full + +$CASEFOLD{$code}{'simple'} = $3; +$CASEFOLD{$code}{'mapping'} = $3; +$CASEFOLD{$code}{'status'} = $2; + } elsif ($2 eq 'T') { +$CASEFOLD{$code}{'turkic'} = $3; + } # else can't happen because only [CIFST] are possible } } close($CASEFOLDFH); < at >< at > -743,54 +930,85 < at >< at > return $CASEFOLD{$code}; } -=head2 casespec +=head2 B<casespec()> use Unicode::UCD 'casespec'; - my $casespec = casespec("FB00"); + my $casespec = casespec(0xFB00); -The casespec() returns the potentially locale-dependent case mapping -of the character specified by a B<code point argument>. The mapping -may change the length of the string (which the basic Unicode case -mappings as returned by charinfo() never do). +This returns the potentially locale-dependent case mappings of the L</code point +argument>. The mappings may be longer than a single code point (which the basic +Unicode case mappings as returned by L</charinfo()> never are). -If there is a case folding for that character, a reference to a hash -with the following fields is returned: +If there are no case mappings for the L</code point argument>, or if all three +possible mappings (I<lower>, I<title> and I<upper>) result in single code +points and are locale independent and uncondtional, B<undef> is returned. - key +Otherwise, a reference to a hash giving the mappings (or a reference to a hash +of such hashes, explained below) is returned. - code code point with at least four hexdigits - lower lowercase - title titlecase - upper uppercase - condition condition list (may be undef) - -The C<condition> is optional. Where present, it consists of one or -more I<locales> or I<contexts>, separated by spaces (other than as -used to separate elements, spaces are to be ignored). A condition -list overrides the normal behavior if all of the listed conditions are -true. Case distinctions in the condition list are not significant. -Conditions preceded by "NON_" represent the negation of the condition. +The keys in the bottom layer hash with the meanings of their values are: -Note that when there are multiple case folding definitions for a -single code point because of different locales, the value returned by -casespec() is a hash reference which has the locales as the keys and -hash references as described above as the values. +=over -A I<locale> is defined as a 2-letter ISO 3166 country code, possibly -followed by a "_" and a 2-letter ISO language code (possibly followed -by a "_" and a variant code). You can find the lists of those codes, -see L<Locale::Country> and L<Locale::Language>. +=item B<code> + +the input L</code point argument> expressed in hexadecimal, with leading zeros +added if necessary to make it contain at least four hexdigits + +=item B<lower> + +one or more codes (separated by spaces) that taken in order give the +code points for the lower case of I<code>. +Each has at least four hexdigits. + +=item B<title> + +one or more codes (separated by spaces) that taken in order give the +code points for the title case of I<code>. +Each has at least four hexdigits. + +=item B<lower> -A I<context> is one of the following choices: +one or more codes (separated by spaces) that taken in order give the +code points for the upper case of I<code>. +Each has at least four hexdigits. - FINAL The letter is not followed by a letter of - general category L (e.g. Ll, Lt, Lu, Lm, or Lo) - MODERN The mapping is only used for modern text - AFTER_i The last base character was "i" (U+0069) +=item B<condition> + +the conditions for the mappings to be valid. +If B<undef>, the mappings are always valid. +When defined, this field is a list of conditions, +all of which must be true for the mappings to be valid. +The list consists of one or more +I<locales> (see below) +and/or I<contexts> (explained in the next paragraph), +separated by spaces. +(Other than as used to separate elements, spaces are to be ignored.) +Case distinctions in the condition list are not significant. +Conditions preceded by "NON_" represent the negation of the condition. + +A I<context> is one of those defined in the Unicode standard. +For Unicode 5.1, they are defined in Section 3.13 C<Default Case Operations> +available at +L<http://www.unicode.org/versions/Unicode5.1.0/> + +=back + +If the return value is to a hash of hashes, it is because there are multiple +case mapping definitions for a single code point +(because of different rules for different locales). +Each sub-hash is of the form above, and the keys of the outer hash are +the locales, which are +defined as 2-letter ISO 3166 country codes, possibly +followed by a "_" and a 2-letter ISO language code (possibly followed +by a "_" and a variant code). You can find the lists of all possible locales, +see L<Locale::Country> and L<Locale::Language>. +(In Unicode 5.1, the only locales returned by this function +are C<lt>, C<tr>, and C<az>.) For more information about case mappings see -http://www.unicode.org/unicode/reports/tr21/ +L<http://www.unicode.org/unicode/reports/tr21/> =cut < at >< at > -861,7 +1079,7 < at >< at > return ref $CASESPEC{$code} ? dclone $CASESPEC{$code} : $CASESPEC{$code}; } -=head2 namedseq() +=head2 B<namedseq()> use Unicode::UCD 'namedseq'; < at >< at > -870,15 +1088,16 < at >< at > my %namedseq = namedseq(); If used with a single argument in a scalar context, returns the string -consisting of the code points of the named sequence, or C<undef> if no +consisting of the code points of the named sequence, or B<undef> if no named sequence by that name exists. If used with a single argument in -a list context, returns list of the code points. If used with no +a list context, it returns the list of the code points. If used with no arguments in a list context, returns a hash with the names of the named sequences as the keys and the named sequences as strings as -the values. Otherwise, returns C<undef> or empty list depending +the values. Otherwise, it returns B<undef> or an empty list depending on the context. -(New from Unicode 4.1.0) +This function only operates on officially approved (not provisional) named +sequences. =cut < at >< at > -920,10 +1139,9 < at >< at > =head2 Unicode::UCD::UnicodeVersion -Unicode::UCD::UnicodeVersion() returns the version of the Unicode -Character Database, in other words, the version of the Unicode -standard the database implements. The version is a string -of numbers delimited by dots (C<'.'>). +This returns the version of the Unicode Character Database, in other words, the +version of the Unicode standard the database implements. The version is a +string of numbers delimited by dots (C<'.'>). =cut < at >< at > -940,6 +1158,32 < at >< at > return $UNICODEVERSION; } +=head2 B<Blocks versus Scripts> + +The difference between a block and a script is that scripts are closer +to the linguistic notion of a set of code points required to present +languages, while block is more of an artifact of the Unicode code point +numbering and separation into blocks of (mostly) 256 code points. + +For example the Latin B<script> is spread over several B<blocks>, such +as C<Basic Latin>, C<Latin 1 Supplement>, C<Latin Extended-A>, and +C<Latin Extended-B>. On the other hand, the Latin script does not +contain all the characters of the C<Basic Latin> block (also known as +ASCII): it includes only the letters, and not, for example, the digits +or the punctuation. + +For blocks see L<http://www.unicode.org/Public/UNIDATA/Blocks.txt> + +For scripts see UTR #24: L<http://www.unicode.org/unicode/reports/tr24/> + +=head2 B<Matching Scripts and Blocks> + +Scripts are matched with the regular-expression construct +C<\p{...}> (e.g. C<\p{Tibetan}> matches characters of the Tibetan script), +while C<\p{In...}> is used for blocks (e.g. C<\p{InTibetan}> matches +any of the 256 code points in the Tibetan block). + + =head2 Implementation Note The first use of charinfo() opens a read-only filehandle to the Unicode < at >< at > -951,6 +1195,8 < at >< at > Does not yet support EBCDIC platforms. +L</compexcl()> should give a complete list of excluded code points. + =head1 AUTHOR Jarkko Hietaniemi --- UCD.t.blead2008-09-19 15:04:14.000000000 -0600 +++ UCD.t2008-12-03 19:20:17.000000000 -0700 < at >< at > -1,6 +1,6 < at >< at > #!perl -w BEGIN { - if (ord("A") == 193) { + if (ord("A") != 65) { print "1..0 # Skip: EBCDIC\n"; exit 0; } < at >< at > -18,7 +18,7 < at >< at > use Unicode::UCD; use Test::More; -BEGIN { plan tests => 194 }; +BEGIN { plan tests => 239 }; use Unicode::UCD 'charinfo'; < at >< at > -172,6 +172,26 < at >< at > is($charinfo->{block}, 'Mathematical Alphanumeric Symbols'); is($charinfo->{script}, 'Common'); +$charinfo = charinfo(0x9FBA);#Bug 58428 + +is($charinfo->{code}, '9FBA', 'U+9FBA'); +is($charinfo->{name}, 'CJK UNIFIED IDEOGRAPH-9FBA'); +is($charinfo->{category}, 'Lo'); +is($charinfo->{combining}, '0'); +is($charinfo->{bidi}, 'L'); +is($charinfo->{decomposition}, ''); +is($charinfo->{decimal}, ''); +is($charinfo->{digit}, ''); +is($charinfo->{numeric}, ''); +is($charinfo->{mirrored}, 'N'); +is($charinfo->{unicode10}, ''); +is($charinfo->{comment}, ''); +is($charinfo->{upper}, ''); +is($charinfo->{lower}, ''); +is($charinfo->{title}, ''); +is($charinfo->{block}, 'CJK Unified Ideographs'); +is($charinfo->{script}, 'Han'); + use Unicode::UCD qw(charblock charscript); # 0x0590 is in the Hebrew block but unused. < at >< at > -254,6 +274,8 < at >< at > is($bt->{L}, 'Left-to-Right', 'L is Left-to-Right'); is($bt->{AL}, 'Right-to-Left Arabic', 'AL is Right-to-Left Arabic'); +# If this fails, then maybe one should look at the Unicode changes to see +# what else might need to be updated. is(Unicode::UCD::UnicodeVersion, '5.1.0', 'UnicodeVersion'); use Unicode::UCD qw(compexcl); < at >< at > -267,15 +289,70 < at >< at > $casefold = casefold(0x41); -ok($casefold->{code} eq '0041' && - $casefold->{status} eq 'C' && - $casefold->{mapping} eq '0061', 'casefold 0x41'); +is($casefold->{code}, '0041', 'casefold 0x41 code'); +is($casefold->{status}, 'C', 'casefold 0x41 status'); +is($casefold->{mapping}, '0061', 'casefold 0x41 mapping'); +is($casefold->{full}, '0061', 'casefold 0x41 full'); +is($casefold->{simple}, '0061', 'casefold 0x41 simple'); +is($casefold->{turkic}, "", 'casefold 0x41 turkic'); $casefold = casefold(0xdf); -ok($casefold->{code} eq '00DF' && - $casefold->{status} eq 'F' && - $casefold->{mapping} eq '0073 0073', 'casefold 0xDF'); +is($casefold->{code}, '00DF', 'casefold 0xDF code'); +is($casefold->{status}, 'F', 'casefold 0xDF status'); +is($casefold->{mapping}, '0073 0073', 'casefold 0xDF mapping'); +is($casefold->{full}, '0073 0073', 'casefold 0xDF full'); +is($casefold->{simple}, "", 'casefold 0xDF simple'); +is($casefold->{turkic}, "", 'casefold 0xDF turkic'); + +# Do different tests depending on if version <= 3.1, or not. +(my $version = Unicode::UCD::UnicodeVersion) =~ /^(\d+)\.(\d+)/; +if (defined $1 && ($1 <= 2 || $1 == 3 && defined $2 && $2 <= 1)) { +$casefold = casefold(0x130); + +is($casefold->{code}, '0130', 'casefold 0x130 code'); +is($casefold->{status}, 'I' , 'casefold 0x130 status'); +is($casefold->{mapping}, '0069', 'casefold 0x130 mapping'); +is($casefold->{full}, '0069', 'casefold 0x130 full'); +is($casefold->{simple}, "0069", 'casefold 0x130 simple'); +is($casefold->{turkic}, "0069", 'casefold 0x130 turkic'); + +$casefold = casefold(0x131); + +is($casefold->{code}, '0131', 'casefold 0x131 code'); +is($casefold->{status}, 'I' , 'casefold 0x131 status'); +is($casefold->{mapping}, '0069', 'casefold 0x131 mapping'); +is($casefold->{full}, '0069', 'casefold 0x131 full'); +is($casefold->{simple}, "0069", 'casefold 0x131 simple'); +is($casefold->{turkic}, "0069", 'casefold 0x131 turkic'); +} else { +$casefold = casefold(0x49); + +is($casefold->{code}, '0049', 'casefold 0x49 code'); +is($casefold->{status}, 'C' , 'casefold 0x49 status'); +is($casefold->{mapping}, '0069', 'casefold 0x49 mapping'); +is($casefold->{full}, '0069', 'casefold 0x49 full'); +is($casefold->{simple}, "0069", 'casefold 0x49 simple'); +is($casefold->{turkic}, "0131", 'casefold 0x49 turkic'); + +$casefold = casefold(0x130); + +is($casefold->{code}, '0130', 'casefold 0x130 code'); +is($casefold->{status}, 'F' , 'casefold 0x130 status'); +is($casefold->{mapping}, '0069 0307', 'casefold 0x130 mapping'); +is($casefold->{full}, '0069 0307', 'casefold 0x130 full'); +is($casefold->{simple}, "", 'casefold 0x130 simple'); +is($casefold->{turkic}, "0069", 'casefold 0x130 turkic'); +} + +$casefold = casefold(0x1F88); + +is($casefold->{code}, '1F88', 'casefold 0x1F88 code'); +is($casefold->{status}, 'S' , 'casefold 0x1F88 status'); +is($casefold->{mapping}, '1F80', 'casefold 0x1F88 mapping'); +is($casefold->{full}, '1F00 03B9', 'casefold 0x1F88 full'); +is($casefold->{simple}, '1F80', 'casefold 0x1F88 simple'); +is($casefold->{turkic}, "", 'casefold 0x1F88 turkic'); ok(!casefold(0x20)); karl williamson 2008-12-04T02:51:54 http://comments.gmane.org/gmane.comp.lang.perl.perl5.porters/64638 In trim_unixpath, the wrong free routine was being used resulting in data corruption. -John wb8tyw< at >qsl.net Personal Opinion Only --- /rsync_root/perl/vms/vms.cSun Nov 23 22:54:17 2008 +++ vms/vms.cWed Dec 3 19:05:18 2008 < at >< at > -9345,10 +9345,10 < at >< at > char def[NAM$C_MAXRSS+1], *st; if (getcwd(def, sizeof def,0) == NULL) { - Safefree(unixified); - Safefree(unixwild); - Safefree(lcres); - Safefree(tpl); + PerlMem_free(unixified); + PerlMem_free(unixwild); + PerlMem_free(lcres); + PerlMem_free(tpl); return 0; } if (!decc_efs_case_preserve) { John E. Malmberg 2008-12-04T01:38:04 http://comments.gmane.org/gmane.comp.lang.perl.perl5.porters/64637 Automated smoke report for 5.11.0 patch 34986 p5netbsd: AMD Duron (686-class) (i386/1 cpu) on netbsd - 4.0 using cc version 4.1.2 20061021 prerelease (NetBSD nb3 20061125) smoketime 17 hours 20 minutes (average 2 hours 10 minutes) Summary: FAIL(F) O = OK F = Failure(s), extended report at the bottom X = Failure(s) under TEST but not under harness ? = still running or test results not (yet) available Build failures during: - = unknown or N/A c = Configure, m = make, M = make (after miniperl), t = make test-prep 34986 Configuration (common) none ----------- --------------------------------------------------------- O O O O O O O O -Duse64bitint O O O O -Duseithreads O O F O -Duseithreads -Duse64bitint | | | +----- PERLIO = perlio -DDEBUGGING | | +------- PERLIO = stdio -DDEBUGGING | +--------- PERLIO = perlio +----------- PERLIO = stdio Locally applied patches: DEVEL SMOKE34986 Failures: (common-args) none [stdio] -DDEBUGGING -Duseithreads -Duse64bitint ../ext/threads/shared/t/waithires.t.........................FAILED 12 Compiler messages(gcc): perlio.c: In function 'PerlIOStdio_set_ptrcnt': perlio.c:3451: warning: pointer targets in assignment differ in signedness <command line>:1:1: warning: "TIME_HIRES_STAT" redefined <command line>:1:1: warning: this is the location of the previous definition /usr/include/sys/cdefs_elf.h:67:20: error: missing binary operator before token "(" Steven Schubiger 2008-12-04T01:30:02 http://comments.gmane.org/gmane.comp.lang.perl.perl5.porters/64622 The 'userelocatableinc' option works incorrectly on Solaris 10 (and earlier, presumably). The problem is that the path to the executable cannot be obtained like on Linux ('/proc/self/exe') or on BSD ('/proc/curproc/file'). But, as suggested by 'almut' on perlmonks (http://www.perlmonks.org/?node_id=686876). it can be obtained with '/proc/self/path/a.out'. So the solution (tested and working) is to have in Configure (currently, around line 15563) something like the following "if ... fi" snippet added, for Solaris 10: procselfexe='' val="$undef" case "$d_readlink" in "$define") ... if $issymlink /proc/self/path/a.out ; then $ls -l /proc/self/path/a.out > reflect if $contains /`basename $ls` reflect >/dev/null 2>&1; then echo "You have Solaris-like /proc/self/path/a.out." procselfexe='"/proc/self/path/a.out"' val="$define" fi fi ... I think this also makes $^X return a correct path instead of just 'perl' (I'm not at the office right now, and I forgot to test that). The technique does not work on Solaris 8, because apparently it does not support the '/proc/self/path/a.out' mechanism (according to 'almut'). I don't know about other versions. Thanks. Luc St-Louis 2008-12-03T01:07:11 http://comments.gmane.org/gmane.comp.lang.perl.perl5.porters/64621 Blead Change 32681 (make miniperl -Wwrite-strings clean) resulted in some build warnings being generated by cygwin.c. In response, I submitted blead Change 32689 (const'ing in cygwin.c) to correct these. Change 33119 to 5.10.x integrates blead Change 32689. However, since blead Change 32681 cannot be integrated into 5.10.x, cygwin.c is now producing the following build warnings: cygwin.c: In function `do_spawn': cygwin.c:125: warning: assignment from incompatible pointer type cygwin.c:127: warning: assignment from incompatible pointer type To correct this, the portion of 5.10.x Change 33119 related to blead Change 32689 needs to be reverted. The attached patch does this. (This is a repost from my original submission back in October.) --- perl/cygwin/cygwin.c +++ perl/cygwin/cygwin.c < at >< at > -83,8 +83,7 < at >< at > do_spawn (char *cmd) { dTHX; - char const **a; - char *s,*metachars = "$&*(){}[]'\";\\?>|<~`\n"; + char **a,*s,*metachars = "$&*(){}[]'\";\\?>|<~`\n"; const char *command[4]; while (*cmd && isSPACE(*cmd)) < at >< at > -122,7 +121,7 < at >< at > return do_spawnvp("sh",command); } - Newx (PL_Argv,(s-cmd)/2+2,const char*); + Newx (PL_Argv,(s-cmd)/2+2,char*); PL_Cmd=savepvn (cmd,s-cmd); a=PL_Argv; for (s=PL_Cmd; *s;) { Jerry D. Hedden 2008-12-03T16:47:51 http://comments.gmane.org/gmane.comp.lang.perl.perl5.porters/64609 This patch should be enough to enable us using __attribute__((deprecated)) portably (for eaxmple for functions in mathoms.c). Rafael Garcia-Suarez 2008-12-03T11:51:36 http://comments.gmane.org/gmane.comp.lang.perl.perl5.porters/64598 Hello, right now it looks like Perl 5.8.9 RC1 (and 5.10.x / bleed) does not compiler with gcc on AIX. I already have submitted a patch for bleed (34983). With this patch applied to 5.8.9 RC1 you can compile: Perl 5.8.9 RC1 with gcc 3.3.2 Perl 5.8.9 RC1 with gcc 4.2.4 Perl 5.8.9 RC1 with IBM C/C++ V7 Perl 5.8.9 RC1 with IBM C/C++ V8 Perl 5.8.9 RC1 with IBM C/C++ V9 Perl 5.8.9 RC1 with IBM C/C++ V10 I have tested this on AIX 5.1 / 5.2 / 5.3 / 6.1 (not with all compiler combinations :-) ). Settings: -Duseshrplib (I think this is mandatory) -Dusethreads (Optional) So if there are no objections in the next couple of day I vote to include this patch in 5.8.9. If you think that the change to Makefile.SH is to sensitive for 5.8.9 then we have to change the README.aix and remove gcc from the supported compiler list. A other problem is suidperl: To make this work on AIX we need a other patch to makefile.SH: This patch adds the libperl_nonshr.a in front of libperl.a for AIX (libperl.a is only used for the Dynloader). Without the patch suidperl simply wont compile/work on AIX and with the patch suidperl is linked statically with the exception of the Dynloader. Should this be fixed for 5.8.9 or should we fix it for 5.10.x / bleed ?? Bye Rainer Rainer Tammer 2008-12-03T08:01:12 http://comments.gmane.org/gmane.comp.lang.perl.perl5.porters/64597 With the following patches, Module::Build is now passing the tests on VMS in blead. Invalid index and missing .packlist: http://rt.cpan.org/Ticket/Display.html?id=41389 _detildify on VMS has unexpected trailing '/': http://rt.cpan.org/Ticket/Display.html?id=41364 compat.t doing case sensitive filename compare on VMS: http://rt.cpan.org/Ticket/Display.html?id=41332 VMS/MMS realclean unlink line created wrong: http://rt.cpan.org/Ticket/Display.html?id=41331 Not addressed at this time is the issue where the test is expecting that the DCL command "PERL" exists and will know to run the correct perl needed for the test, and the extra output on some of the tests that causes the test harness to report failures. http://rt.cpan.org/Ticket/Display.html?id=41391 -John wb8tyw< at >qsl.net Personal Opinion Only John E. Malmberg 2008-12-03T07:00:12 http://comments.gmane.org/gmane.comp.lang.perl.perl5.porters/64596 After a 'distclean' I see these files: ext/IPC/SysV/Makefile.old ext/threads/shared/Makefile.old Anybody want to clean that up, perchance? Chip Salzenberg 2008-12-03T04:39:35 http://comments.gmane.org/gmane.comp.lang.perl.perl5.porters/64594 Automated smoke report for 5.11.0 patch 34986 maldoror.bath.planit.group: Intel(R) Core(TM)2 CPU 6700 < at > 2.66GHz(~2660 MHz) (x86/2 cpu) on MSWin32 - WinXP/.Net SP3 using cl version 12.00.8804 smoketime 4 hours 21 minutes (average 13 minutes 5 seconds) Summary: FAIL(Ft) O = OK F = Failure(s), extended report at the bottom X = Failure(s) under TEST but not under harness ? = still running or test results not (yet) available Build failures during: - = unknown or N/A c = Configure, m = make, M = make (after miniperl), t = make test-prep 34986 Configuration (common) -DINST_TOP=$(INST_DRV)\Smoke\doesntexist ----------- --------------------------------------------------------- O O O O -Dusemymalloc O O -Duseithreads -Uuseimpsys O O -Duseithreads -Uuseimpsys -Dusemymalloc O O -Duseithreads F t -Accflags='-DPERL_OLD_COPY_ON_WRITE' F t -Accflags='-DPERL_OLD_COPY_ON_WRITE' -Dusemymalloc F t -Accflags='-DPERL_OLD_COPY_ON_WRITE' -Duseithreads -Uuseimpsys F t -Accflags='-DPERL_OLD_COPY_ON_WRITE' -Duseithreads -Uuseimpsys -Dusemymalloc F t -Accflags='-DPERL_OLD_COPY_ON_WRITE' -Duseithreads | +--------- -DDEBUGGING +----------- no debugging Locally applied patches: DEVEL SMOKE34986 Failures: (common-args) -DINST_TOP=$(INST_DRV)\Smoke\doesntexist [default] -Accflags='-DPERL_OLD_COPY_ON_WRITE' [default] -Accflags='-DPERL_OLD_COPY_ON_WRITE' -Dusemymalloc [default] -Accflags='-DPERL_OLD_COPY_ON_WRITE' -Duseithreads -Uuseimpsys [default] -Accflags='-DPERL_OLD_COPY_ON_WRITE' -Duseithreads -Uuseimpsys -Dusemymalloc [default] -Accflags='-DPERL_OLD_COPY_ON_WRITE' -Duseithreads ../ext/Compress/Raw/Zlib/t/07bufsize.t......................FAILED Bad plan. You planned 288 tests but ran 41. ../ext/PerlIO/t/ioleaks.t...................................FAILED ../lib/Attribute/Handlers/t/linerep.t.......................FAILED Compiler messages(MSWin32): Cwd.xs(77) : warning C4101: 'symlink' : unreferenced local variable Steve Hay 2008-12-03T03:12:00 http://comments.gmane.org/gmane.comp.lang.perl.perl5.porters/64590 This damn smoker again. t/11-prepend.......ok t/12-preprocess....ok t/13-taint......... Failed 6/21 subtests t/14-broken........ok HTH, good night, Andreas J. Koenig 2008-12-02T22:24:12 http://comments.gmane.org/gmane.comp.lang.perl.perl5.porters/64574 Change 34974 to scope.c produces the following build warning: scope.c: In function `Perl_leave_scope': scope.c:623: warning: ISO C90 forbids mixed declarations and code The attached patch fixes this. --- perl-5.8.x/scope.c +++ perl-5.8.x/scope.c < at >< at > -618,9 +618,10 < at >< at > if (base < -1) Perl_croak(aTHX_ "panic: corrupt saved stack index"); while (PL_savestack_ix > base) { +const int type = SSPOPINT; + TAINT_NOT; -const int type = SSPOPINT; switch (type) { case SAVEt_ITEM:/* normal string */ value = (SV*)SSPOPPTR; Jerry D. Hedden 2008-12-02T13:51:08 http://comments.gmane.org/gmane.comp.lang.perl.perl5.porters/64570 Hello, I have encountered a little problem with suidperl. As soon as I specify -Dd_dosuid to build suidperl on AIX I get this error: LIBPATH=/daten/source/perl-5.8.9-RC1_32:/usr/local/081119/lib cc_r -q32 -o suidperl -brtl -bdynamic -b32 -bmaxdata:0x80000000 -bE:perl.exp perlmain.o sperl.o -L /usr/opt/perl5.8.9_32/lib/5.8.9/aix-thread-multi/CORE -L /daten/source/perl-5.8.9-RC1_32 -lperl `cat ext.libs` -lbind -lnsl -ldl -lld -lm -lcrypt -lpthreads -lc -lbsd ld: 0711-317 ERROR: Undefined symbol: .Perl_pp_entereval ld: 0711-317 ERROR: Undefined symbol: .Perl_pp_entersub ld: 0711-317 ERROR: Undefined symbol: .Perl_pad_new ld: 0711-317 ERROR: Undefined symbol: .Perl_boot_core_PerlIO ld: 0711-317 ERROR: Undefined symbol: .Perl_boot_core_UNIVERSAL ld: 0711-317 ERROR: Undefined symbol: .Perl_boot_core_xsutils ld: 0711-317 ERROR: Undefined symbol: .Perl_lex_start ld: 0711-317 ERROR: Undefined symbol: .Perl_yyparse ld: 0711-317 ERROR: Undefined symbol: .Perl_av_create_and_push ld: 0711-317 ERROR: Undefined symbol: .Perl_cando ld: 0711-317 ERROR: Undefined symbol: .Perl_rsignal_save ld: 0711-317 ERROR: Undefined symbol: .Perl_rsignal_restore ld: 0711-317 ERROR: Undefined symbol: .Perl_find_script ld: 0711-317 ERROR: Undefined symbol: Perl_peep ld: 0711-317 ERROR: Undefined symbol: .Perl_save_op ld: 0711-317 ERROR: Undefined symbol: .Perl_push_return ld: 0711-317 ERROR: Undefined symbol: .Perl_create_eval_scope ld: 0711-317 ERROR: Undefined symbol: .Perl_delete_eval_scope ld: 0711-317 ERROR: Undefined symbol: .Perl_parse_unicode_opts ld: 0711-317 ERROR: Undefined symbol: .Perl_get_hash_seed ld: 0711-317 ERROR: Undefined symbol: .PerlIO_destruct ld: 0711-317 ERROR: Undefined symbol: .Perl_sv_clean_all ld: 0711-317 ERROR: Undefined symbol: .PerlIO_cleanup ld: 0711-317 ERROR: Undefined symbol: .Perl_free_tied_hv_pool ld: 0711-317 ERROR: Undefined symbol: .Perl_sv_free_arenas ld: 0711-317 ERROR: Undefined symbol: .Perl_sv_clean_objs ld: 0711-317 ERROR: Undefined symbol: Perl_sighandler ld: 0711-345 Use the -bloadmap or -bnoquiet option to obtain more information. make: 1254-004 The error code from the last command is 8. The rest builds without a problem. I can solve this problem with the inclusion of -lperl_nonshr after sperl.o. I am not sure why this is necessary. In my current developement environment I have achieved this with the following patch against Makefile.SH: 1. add aix_fixup='' right after ldlibpth='' 2. add aix_fixup="-lperl_nonshr" in the [case "$useshrplib" in] case 3. use LLIBPERL_SUIDPERL= $aix_fixup $linklibperl instead of LLIBPER= $linklibperl for suidperl later This is only a quick hack not a permanent solution. So my question: 1. Is suidperl supposed to build shared ? 2. Why does perl build without a problem - what am I missing ? Bye Rainer Rainer Tammer 2008-12-02T12:24:15 http://comments.gmane.org/gmane.comp.lang.perl.perl5.porters/64553 G'day p5p, and particularly Rafael and Dave, Back in July, Rafael said that putting autodie[1] in the core was a good idea[2]. Since then I've sent through a big (3,500 line) patch, and then promptly got smacked by a massive work schedule that had me go back to lurking on p5p[3]. Since then autodie has changed a little (mainly extra polish), so I'd like to provide a new patch. However I want to make sure that when I do so, it's done in a way that makes everyone's lives as easy as possible. In the interests of having that happen, I've got a few questions: * Are we still happy with autodie going in core for 5.10.1? * Am I correct that a big patch against the current blead is the best thing to provide? * Is there a deadline I need to meet? Many thanks, Paul [1] http://search.cpan.org/perldoc?autodie [2] http://markmail.org/message/uvc5q35uqjs75teu [3] I'm still in the massive work schedule, I don't even get to go home for another three weeks! Paul Fenwick 2008-12-02T02:26:30 http://comments.gmane.org/gmane.comp.lang.perl.perl5.porters/64541 Change 34940 made *_setenv_getix static. However, when built under Cygwin, the following build warning is produced: util.c:1779: warning: 'S_setenv_getix' defined but not used Since it's only used in one place, the easiest way to fix the above is to eliminate it. That attached patch does that. --- perl-current/embed.fnc +++ perl-current/embed.fnc < at >< at > -951,9 +951,6 < at >< at > p|OP*|scope|NULLOK OP* o Ap|char*|screaminstr|NN SV *bigstr|NN SV *littlestr|I32 start_shift \ |I32 end_shift|NN I32 *old_posp|I32 last -#if !defined(VMS) && defined(PERL_IN_UTIL_C) -s|I32|setenv_getix|NN const char* nam -#endif Apd|void|setdefout|NULLOK GV* gv Ap|HEK*|share_hek|NN const char* str|I32 len|U32 hash #if defined(HAS_SIGACTION) && defined(SA_SIGINFO) --- perl-current/embed.h +++ perl-current/embed.h < at >< at > -839,11 +839,6 < at >< at > #define scopePerl_scope #endif #define screaminstrPerl_screaminstr -#if !defined(VMS) && defined(PERL_IN_UTIL_C) -#ifdef PERL_CORE -#define setenv_getixS_setenv_getix -#endif -#endif #define setdefoutPerl_setdefout #define share_hekPerl_share_hek #if defined(HAS_SIGACTION) && defined(SA_SIGINFO) < at >< at > -3195,11 +3190,6 < at >< at > #define scope(a)Perl_scope(aTHX_ a) #endif #define screaminstr(a,b,c,d,e,f)Perl_screaminstr(aTHX_ a,b,c,d,e,f) -#if !defined(VMS) && defined(PERL_IN_UTIL_C) -#ifdef PERL_CORE -#define setenv_getix(a)S_setenv_getix(aTHX_ a) -#endif -#endif #define setdefout(a)Perl_setdefout(aTHX_ a) #define share_hek(a,b,c)Perl_share_hek(aTHX_ a,b,c) #if defined(HAS_SIGACTION) && defined(SA_SIGINFO) --- perl-current/proto.h +++ perl-current/proto.h < at >< at > -2962,13 +2962,6 < at >< at > #define PERL_ARGS_ASSERT_SCREAMINSTR\ assert(bigstr); assert(littlestr); assert(old_posp) -#if !defined(VMS) && defined(PERL_IN_UTIL_C) -STATIC I32S_setenv_getix(pTHX_ const char* nam) -__attribute__nonnull__(pTHX_1); -#define PERL_ARGS_ASSERT_SETENV_GETIX\ -assert(nam) - -#endif PERL_CALLCONV voidPerl_setdefout(pTHX_ GV* gv); PERL_CALLCONV HEK*Perl_share_hek(pTHX_ const char* str, I32 len, U32 hash) __attribute__nonnull__(pTHX_1); --- perl-current/util.c +++ perl-current/util.c < at >< at > -1667,9 +1667,16 < at >< at > #ifndef PERL_USE_SAFE_PUTENV if (!PL_use_safe_putenv) { /* most putenv()s leak, so we manipulate environ directly */ - register I32 i=setenv_getix(nam); /* where does it go? */ + register I32 i; + register const I32 len = strlen(nam); int nlen, vlen; + /* where does it go? */ + for (i = 0; environ[i]; i++) { + if (strnEQ(environ[i],nam,len) && environ[i][len] == '=') + break; + } + if (environ == PL_origenviron) { /* need we copy environment? */ I32 j; I32 max; < at >< at > -1773,30 +1780,6 < at >< at > #endif /* WIN32 || NETWARE */ -#ifndef PERL_MICRO -static I32 -S_setenv_getix(pTHX_ const char *nam) -{ - register I32 i; - register const I32 len = strlen(nam); - - PERL_ARGS_ASSERT_SETENV_GETIX; - PERL_UNUSED_CONTEXT; - - for (i = 0; environ[i]; i++) { -if ( -#ifdef WIN32 - strnicmp(environ[i],nam,len) == 0 -#else - strnEQ(environ[i],nam,len) -#endif - && environ[i][len] == '=') - break;/* strnEQ must come first to avoid */ - }/* potential SEGV's */ - return i; -} -#endif /* !PERL_MICRO */ - #endif /* !VMS && !EPOC*/ #ifdef UNLINK_ALL_VERSIONS Jerry D. Hedden 2008-12-01T17:47:35 http://comments.gmane.org/gmane.comp.lang.perl.perl5.porters/64537 Perl5 Bug Summary http://rt.perl.org/rt3/NoAuth/perl5/Overview.html Generated at Mon Dec 1 14:15:02 2008 GMT ------------------------------------------------------------------------------- * Numbers * New Issues * Overview of Open Issues * Ticket Status By Version * Requestors with most open tickets ------------------------------------------------------------------------------- Numbers Ticket Counts: 281 new + 1019 open = 1300 Created this week: 11 Closed this week: 17 ------------------------------------------------------------------------------- New Issues New issues that have not been responded to yet 1 - 2 weeks old 60724 Segmentation fault in Perl_csighandler when receiving SIGCHLD during thread creation 60614 Error during compiling Perl 2 - 3 weeks old 60464 Invalid RE match in 5.10.0 (regression from 5.8.8) 3 - 4 weeks old 60326 [Bug in maint-perl-latest] utf8+locale substitution cause the Perl interpreter to hang. 4 - 5 weeks old 60318 Inconsistent math with large numbers 60294 threads::shared resets %hash iterators 5 - 6 weeks old 60136 op/groups.t fails when real group name contains blanks 6 - 7 weeks old 59916 tainted values in ternary conditional 59902 \N{} gives segmentation fault, other weirdness 7 - 8 weeks old 59792 Cannot recurse inside (?|) 59750 File::Find behavior with files among < at >DIRS 59746 Documentation issues with 5.8.8/Math/BigInt.pm 59734 Segfault when using (?|) in regexp. 59662 Cwd::realpath fails on unsearchable directory (AIX) 8 - 9 weeks old 59616 FOLDCHAR regop not produced for \x, \0, \N{U+....} 59610 Error - intalling a Perl 5 8 8 59550 readline returns EBADF at eof in 5.10.0 59498 Segfault on weird but plain Perl in eval on 5.10.0 on Windows 9 - 10 weeks old 59384 DProf reports wrong elapsed times 59378 Get "Malformed UTF-8 character" message 10 - 11 weeks old 11 - 12 weeks old 58848 Not OK: perl 5.11.0 +DEVEL +patchaperlup: on i686-linux-64int 2.6.22-1-k7 (UNINSTALLED) 58802 make test problem, perl 5.10.0 on AIX 6.1 12 - 13 weeks old 58530 Bus error with constant + overload + stash manipulation + bless 13 - 14 weeks old 58446 perl -d:DProf handles shift of < at >_ with & function wrong 14 - 15 weeks old 15 - 16 weeks old 16 - 17 weeks old 57688 PerlIO::via suggest pre-CLOSE method 17 - 18 weeks old 57518 incorrect lddlflags settings in hints/darwin.sh (perl 5.8.8) 57512 Implicit close()s are silently unchecked for error 18 - 19 weeks old 57288 PerlIO::via::QuotedPrint not flushing 57258 :perlio layer extra FLUSHes 57176 Including XSUB.h before perl.h gives nasty error 19 - 20 weeks old 20 - 21 weeks old 56842 Taint bug with \G and pos() on hash entries 56834 No test coverage for the DO_UTF8() branch of case FF_CHECKCHOP in pp_formline ------------------------------------------------------------------------------- Overview of Open Issues Operating System Severity Type Perl Version aix 25 fatal 2 Bug 1 1.0 14 All 17 High 147 core 618 5.004 1 bsdos 1 low 671 CoreDump 7 5.004_00 1 cygwin 26 medium 318 docs 22 5.004_01 1 darwin 57 none 9 HasTest 5 5.004_02 1 dec_osf 8 Normal 2 install 33 5.004_03 1 dos 1 Wishlist 45 library 158 5.004_04 1 freebsd 52 NeedsTest 8 5.004_05 1 generic 17 notabug 30 5.005 2 HPUX 19 notok 1 5.005_01 2 irix 6 Patch 1 5.005_02 2 Linux 514 regex 14 5.005_03 26 machten 1 unknown 296 5.005_04 4 mswin32 71 utilities 18 5.10.0 94 netbsd 4 5.10.1 2 openbsd 5 5.11.0 24 os2 2 5.6.0 83 powerux 1 5.6.1 103 sco 2 5.6.2 12 Solaris 72 5.7.0 14 sunos 2 5.7.1 9 svr4 2 5.7.2 18 vms 2 5.8.0 141 VOS 1 5.8.1 33 Win32 29 5.8.2 34 5.8.3 46 5.8.4 61 5.8.5 36 5.8.6 38 5.8.7 50 5.8.8 155 5.8.9 5 5.9.0 21 5.9.1 13 5.9.2 15 5.9.3 21 5.9.4 14 5.9.5 16 ------------------------------------------------------------------------------- Ticket Status By Version New or Open Resolved 1.0 14 10 5.000 0 2 5.002 0 4 5.003 0 5 5.004 1 6 5.004_00 1 2 5.004_01 1 4 5.004_02 1 2 5.004_03 1 2 5.004_04 1 45 5.004_05 1 6 5.005 2 25 5.005_01 2 5 5.005_02 2 81 5.005_03 26 344 5.005_04 4 3 5.6.0 83 1115 5.6.1 103 563 5.6.2 12 8 5.7.0 14 1473 5.7.1 9 47 5.7.2 18 91 5.8.0 141 560 5.8.1 33 95 5.8.2 34 66 5.8.3 46 89 5.8.4 61 113 5.8.5 36 57 5.8.6 38 59 5.8.7 50 85 5.8.8 155 202 5.8.9 5 8 5.9.0 21 44 5.9.1 13 13 5.9.2 15 20 5.9.3 21 27 5.9.4 14 20 5.9.5 16 27 5.10.0 94 97 5.10.1 2 0 5.11.0 24 0 ------------------------------------------------------------------------------- Requestors with most open tickets Nicholas Clark 43 perl-5.8.0< at >ton.iguana.be 25 Mark-Jason Dominus 23 abigail< at >foad.org 13 Stas Bekman 13 "Ed Avis" 13 Michael G Schwern 11 Zefram 11 Father Chrysostomos 10 Yitzchak Scott-Thoennes 9 ------------------------------------------------------------------------------- * Numbers * New Issues * Overview of Open Issues * Ticket Status By Version * Requestors with most open tickets ------------------------------------------------------------------------------- This page is CPU intensive to create, it will be updated only once every 30 minutes Perl5 Bug Summary 2008-12-01T14:15:26 http://comments.gmane.org/gmane.comp.lang.perl.perl5.porters/64534 Automated smoke report for 5.11.0 patch 34956 maldoror.bath.planit.group: Intel(R) Core(TM)2 CPU 6700 < at > 2.66GHz(~2660 MHz) (x86/2 cpu) on MSWin32 - WinXP/.Net SP3 using gcc version 3.4.2 smoketime 5 hours 54 minutes (average 17 minutes 43 seconds) Summary: FAIL(F) O = OK F = Failure(s), extended report at the bottom X = Failure(s) under TEST but not under harness ? = still running or test results not (yet) available Build failures during: - = unknown or N/A c = Configure, m = make, M = make (after miniperl), t = make test-prep 34956 Configuration (common) -DINST_TOP=$(INST_DRV)\Smoke\doesntexist ----------- --------------------------------------------------------- O O O O -Dusemymalloc O O -Duselargefiles O O -Duselargefiles -Dusemymalloc O O -Duseithreads -Uuseimpsys O O -Duseithreads -Uuseimpsys -Dusemymalloc O O -Duseithreads -Uuseimpsys -Duselargefiles O O -Duseithreads -Uuseimpsys -Duselargefiles -Dusemymalloc O O -Duseithreads O F -Duseithreads -Duselargefiles | +--------- -DDEBUGGING +----------- no debugging Locally applied patches: DEVEL SMOKE34956 Failures: (common-args) -DINST_TOP=$(INST_DRV)\Smoke\doesntexist [default] -DDEBUGGING -Duseithreads -Duselargefiles ../ext/PerlIO/t/ioleaks.t...................................FAILED ../lib/Attribute/Handlers/t/linerep.t.......................FAILED ../lib/ExtUtils/t/Embed.t...................................FAILED 1, 9 Compiler messages(gcc): perlhost.h: In function `CPerlHost* IPerlMem2Host(IPerlMem*)': perlhost.h:247: warning: invalid access to non-static data member `CPerlHost::m_hostperlMem' of NULL object perlhost.h:247: warning: (perhaps the `offsetof' macro was used incorrectly) perlhost.h: In function `CPerlHost* IPerlMemShared2Host(IPerlMem*)': perlhost.h:252: warning: invalid access to non-static data member `CPerlHost::m_hostperlMemShared' of NULL object perlhost.h:252: warning: (perhaps the `offsetof' macro was used incorrectly) perlhost.h: In function `CPerlHost* IPerlMemParse2Host(IPerlMem*)': perlhost.h:257: warning: invalid access to non-static data member `CPerlHost::m_hostperlMemParse' of NULL object perlhost.h:257: warning: (perhaps the `offsetof' macro was used incorrectly) perlhost.h: In function `CPerlHost* IPerlEnv2Host(IPerlEnv*)': perlhost.h:262: warning: invalid access to non-static data member `CPerlHost::m_hostperlEnv' of NULL object perlhost.h:262: warning: (perhaps the `offsetof' macro was used incorrectly) perlhost.h: In function `CPerlHost* IPerlStdIO2Host(IPerlStdIO*)': perlhost.h:267: warning: invalid access to non-static data member `CPerlHost::m_hostperlStdIO' of NULL object perlhost.h:267: warning: (perhaps the `offsetof' macro was used incorrectly) perlhost.h: In function `CPerlHost* IPerlLIO2Host(IPerlLIO*)': perlhost.h:272: warning: invalid access to non-static data member `CPerlHost::m_hostperlLIO' of NULL object perlhost.h:272: warning: (perhaps the `offsetof' macro was used incorrectly) perlhost.h: In function `CPerlHost* IPerlDir2Host(IPerlDir*)': perlhost.h:277: warning: invalid access to non-static data member `CPerlHost::m_hostperlDir' of NULL object perlhost.h:277: warning: (perhaps the `offsetof' macro was used incorrectly) perlhost.h: In function `CPerlHost* IPerlSock2Host(IPerlSock*)': perlhost.h:282: warning: invalid access to non-static data member `CPerlHost::m_hostperlSock' of NULL object perlhost.h:282: warning: (perhaps the `offsetof' macro was used incorrectly) perlhost.h: In function `CPerlHost* IPerlProc2Host(IPerlProc*)': perlhost.h:287: warning: invalid access to non-static data member `CPerlHost::m_hostperlProc' of NULL object perlhost.h:287: warning: (perhaps the `offsetof' macro was used incorrectly) Steve Hay 2008-12-01T05:05:00 http://comments.gmane.org/gmane.comp.lang.perl.perl5.porters/64531 Test 04_Resolved_Issues was failing on VMS because it was translating ".." to "__". Use vmspath() instead so that dots are escaped if needed. Also filed as: http://rt.cpan.org/Public/Bug/Display.html?id=41329 -John wb8tyw< at >qsl.net Personal Opinion Only --- /rsync_root/perl/lib/Archive/Tar.pmWed Oct 15 08:50:32 2008 +++ lib/Archive/Tar.pmSun Nov 30 17:33:31 2008 < at >< at > -690,9 +690,9 < at >< at > } - ### '.' is the directory delimiter, of which the first one has to - ### be escaped/changed. - map tr/\./_/, < at >dirs if ON_VMS; + ### '.' is the directory delimiter on VMS, of which the first one + ### has to be escaped/changed by vmspath + map $_ = VMS::Filespec::vmspath($_), < at >dirs if ON_VMS; my ($cwd_vol,$cwd_dir,$cwd_file) = File::Spec->splitpath( $cwd ); John E. Malmberg 2008-12-01T00:04:54 http://comments.gmane.org/gmane.comp.lang.perl.perl5.porters/64521 Automated smoke report for 5.11.0 patch 34953 maldoror.bath.planit.group: Intel(R) Core(TM)2 CPU 6700 < at > 2.66GHz(~2660 MHz) (x86/2 cpu) on MSWin32 - WinXP/.Net SP3 using bcc32 version 5.5.1 smoketime 5 hours 33 minutes (average 16 minutes 41 seconds) Summary: FAIL(F) O = OK F = Failure(s), extended report at the bottom X = Failure(s) under TEST but not under harness ? = still running or test results not (yet) available Build failures during: - = unknown or N/A c = Configure, m = make, M = make (after miniperl), t = make test-prep 34953 Configuration (common) -DCCTYPE=BORLAND -DINST_TOP=$(INST_DRV)\Smoke\doesntexist ----------- --------------------------------------------------------- O O O O -Dusemymalloc O O -Duselargefiles O O -Duselargefiles -Dusemymalloc O O -Duseithreads -Uuseimpsys O O -Duseithreads -Uuseimpsys -Dusemymalloc O O -Duseithreads -Uuseimpsys -Duselargefiles O O -Duseithreads -Uuseimpsys -Duselargefiles -Dusemymalloc O O -Duseithreads F F -Duseithreads -Duselargefiles | +--------- -DDEBUGGING +----------- no debugging Locally applied patches: DEVEL SMOKE34953 Failures: (common-args) -DCCTYPE=BORLAND -DINST_TOP=$(INST_DRV)\Smoke\doesntexist [default] -Duseithreads -Duselargefiles ../ext/IO/t/io_sock.t.......................................FAILED ../ext/PerlIO/t/ioleaks.t...................................FAILED ../lib/Attribute/Handlers/t/linerep.t.......................FAILED [default] -DDEBUGGING -Duseithreads -Duselargefiles op/taint.t..................................................FAILED Bad plan. You planned 271 tests but ran 0. ../ext/PerlIO/t/ioleaks.t...................................FAILED ../lib/Attribute/Handlers/t/linerep.t.......................FAILED Compiler messages(bcc32): Warning W8008 crc32.c 232: Condition is always true in function crc32 Warning W8066 crc32.c 242: Unreachable code in function crc32 Warning W8004 deflate.c 351: 'hash_head' is assigned a value that is never used in function deflateSetDictionary Warning W8008 deflate.c 1278: Condition is always false in function fill_window Warning W8066 deflate.c 1279: Unreachable code in function fill_window Warning W8004 deflate.c 1669: 'bflush' is assigned a value that is never used in function deflate_slow Steve Hay 2008-11-30T04:19:00 http://comments.gmane.org/gmane.comp.lang.perl.perl5.porters/64520 Automated smoke report for 5.8.9 patch 34928 maldoror.bath.planit.group: Intel(R) Core(TM)2 CPU 6700 < at > 2.66GHz(~2660 MHz) (x86/2 cpu) on MSWin32 - WinXP/.Net SP3 using bcc32 version 5.5.1 smoketime 3 hours 41 minutes (average 11 minutes 4 seconds) Summary: FAIL(F) O = OK F = Failure(s), extended report at the bottom X = Failure(s) under TEST but not under harness ? = still running or test results not (yet) available Build failures during: - = unknown or N/A c = Configure, m = make, M = make (after miniperl), t = make test-prep 34928 Configuration (common) -DCCTYPE=BORLAND -DINST_TOP=$(INST_DRV)\Smoke\doesntexist ----------- --------------------------------------------------------- O O O O -Dusemymalloc O O -Duselargefiles O O -Duselargefiles -Dusemymalloc O O -Duseithreads -Uuseimpsys O O -Duseithreads -Uuseimpsys -Dusemymalloc O O -Duseithreads -Uuseimpsys -Duselargefiles O O -Duseithreads -Uuseimpsys -Duselargefiles -Dusemymalloc O O -Duseithreads O F -Duseithreads -Duselargefiles | +--------- -DDEBUGGING +----------- no debugging Locally applied patches: MAINT34912 SMOKE34928 Failures: (common-args) -DCCTYPE=BORLAND -DINST_TOP=$(INST_DRV)\Smoke\doesntexist [default] -DDEBUGGING -Duseithreads -Duselargefiles op/taint.t..............................FAILED 1-263 Steve Hay 2008-11-29T22:43:00 Search the mailing list at Gmane query http://search.gmane.org/?group=$group=gmane.comp.lang.perl.perl5.porters