gmane.comp.jakarta.log4j.user

Configuring a RewriteAppender using XML

Mark Grand — 2013-06-17T20:25:28

I am looking for an example of how to configure a RewriteAppender in an XML file using log4j version 1.2.17.  The examples I have seen do not work.

This is what I am currently doing

    <appender name="raw_travel" class="org.apache.log4j.DailyRollingFileAppender">
        <param name="File" value="${catalina.home}/logs/b2r_travel.log"/>
        <param name="Append" value="true"/>
        <param name="DatePattern" value="'.'yyyy-MM-dd"/>
        <layout class="org.apache.log4j.PatternLayout">
            <param name="ConversionPattern" value="[%d{MM/dd/yy HH:mm:ss:SSS}] %X{hostname} %X{tranxId} %X{user} %t %-5p %m (%C{1}.%M)%n"/>
        </layout>
    </appender>

    <appender name="b2r_travel" class="org.apache.log4j.rewrite.RewriteAppender">
        <appender-ref ref="raw_travel"/>
        <rewritePolicy class="com.b2s.logManagment.CreditCardNumberRewritePolicy"/>
    </appender>

I get message about unknown element rewritePolicy

Mark Grand
Solution Architect

[cid:image001.png< at >01CE6B76.E55F8B00]
[cid:image003.jpg< at >01CE6B76.E55F8B00]
Bridge2 Solutions, Inc.
5900 Windward Pkwy, Suite 450
Alpharetta, Georgia 30005
Email: mgrand< at >bridge2solutions.com<mailto:mcornelius< at >bridge2solutions.com>

http://www.bridge2solutions.com<http://www.bridge2solutions.com/>



---------------------------------------------------------------------
To unsubscribe, e-mail: log4j-user-unsubscribe< at >logging.apache.org
For additional commands, e-mail: log4j-user-help< at >logging.apache.org

Substitute webapp display-name in XMLConfiguration

Heck, Timo — 2013-06-14T13:36:27

Hi there,

we are currently looking for a logging solution for our tomcat6 environment.
We are running multiple webapps on one server.

The idea is to use a generic configuration to deploy with all applications.
Our current problem is that we would like to deploy a webapp and
have the log file be named after the webapps display name.

I learned that I am able to configure a separate LoggerContext for
every webapp by declaring Log4jContextListener in web.xml.
While documentation states that the LoggerContext is named after
the webapp display-name I assumed I would be able to reference this value in log4j2.xml
with ${contextName}.

Well, I figured I was wrong about the value of contextName.
Still I think this would be a good idea. Or the display-name
could be added to propertiesMap.

Is it possible to achieve this somehow?



***Lesen. Hören. Wissen. Deutsche Nationalbibliothek***
--
Timo Heck 
Deutsche Nationalbibliothek 
Informationstechnik 
Adickesallee 1 
D-60322 Frankfurt am Main 
Tel.: +49-69-1525-1792 
Fax: +49-69-1525-1799 
mailto:t.heck< at >dnb.de 
http://www.dnb.de

SMTPAppender with server using SSL and MD5 challenge-response authentication

Jens Ivar Jørdre — 2013-06-14T13:13:14

Hi

I'm trying out Log4j 2 (2.0-beta7) in a project. I.e. in my code I use SLF4J, include Log4j 2 jars at runtime and assure by the use of Log4j 2 ConsoleAppender that my logging events indeed reach Log4j.

Now I would like to extend my logging output by adding an SMTPAppender that will forward to an SMTP server that uses SSL and MD5 challenge-response authentication. So far I have included javamail 1.4.7 jar into classpath at runtime. By this there is no error during execution of my application. Thus I use these as possible values of property smtpPort below. I have also added the SMTP appender to my root logger 

I have scanned the ports on the server and checked that both 465 and 587 are open. (Also I successfully send email via this server using the same credentials in Mac OS X Mail client.)

Key parts of my configuration XML (in strict flavor) goes like this:

<appender type="SMTP" name="Mail" suppressExceptions="false"
subject="Error log" to="${toAddress}" from="${fromAddress}"
smtpHost="${smtpHost}" smtpPort="${smtpPort}" smtpProtocol="smtps"
smtpUsername="${smtpUsername}" smtpPassword="${smtpPassword}"
smtpDebug="true" bufferSize="1">
…
<loggers>
<root level="info">
<appender-ref ref="Console" />
<appender-ref ref="Mail" />
</root>
</loggers>

However, as you probably guess by the nature of this email, I receive no email. Anyone with a few hints up there sleves? Any other dependency or version conflict to be aware of? Missing config options?

--
Sincerely,
Jens Ivar Jørdre
about.me/jijordre

better way to handle objects in messages?

Ray Kiddy — 2013-06-09T21:36:22

I have done something and can see where it might be generalized to help other users of log4j. Has this issue already been discussed or dealt with in some other way?

I found a bunch of these in a large legacy application:

log.debug("the object "+obj+" is something something blah blah blah");

The problem, of course, is that regardless of whether the Level will lead to the statement being logged out, the obj's toString() method gets called. This can lead, at times, to quite a bit of work. And that works gets thrown away almost all of the time. So I have written a class that I send all of my log statements through. That class has methods:

static void info(Logger log, Object… objs);
static void debug(Logger log, Object… objs);
static void error(Logger log, Object… objs);

In the info() method, the Level is checked. If it is going to print, then the obis are iterated through. And for some kinds of objects we call toString but some objects are handled in a smarter manner.

It seems to me that the methods in the LoggingEvent class could have the "Object message" parameter changed to "Object… messageObjects".

Am I the only one who has seen the mistake shown above? I suspect not. If the LoggerEvent class did the right thing with the messageObjects array, such as only writing out hashes of certain objects, it seems to me that this would help a lot of people and, if anyone wanted to customize the behavior, it would be clear how to do so.

Yes? No? Any other suggestions or ideas?

cheers - ray

Convenient way to append Class Name in Syslog Appender

Jason B — 2013-06-03T16:57:23

Is there a convenient way to retrieve the class name in the Syslog
appender?  If not, I could engineer my own solution - I was unsure if this
was already captured in another bug report or feature request.

~Jason

problem about log4j config when a program is reading this log

2013-06-03T02:30:47

Hi
I configure log4j so that  when log size is beyong some value, the log will generate a new one. 
config file like this, it works well when no other program reading this log. 

but when a program is reading this log, it seems log can't generate a new one even it reach the max size. 
this reading program is scanning the error keywords from log , like a monitor .

<appender name="DAILY_ALARM" class="org.apache.log4j.RollingFileAppender">
   <param name="MaxFileSize" value="5KB" />
<param name="MaxBackupIndex" value="2" />
   <param name="File" value="./logs/alarm.log" />
   <layout class="org.apache.log4j.PatternLayout">
    <param name="ConversionPattern"
     value="[%-d{yyyyMMdd HH:mm:ss.SSS}] [%-5p]%m%n"/>
   </layout>
   <filter class="org.apache.log4j.varia.LevelRangeFilter">
    <param name="LevelMin" value="WARN" />
    <param name="LevelMax" value="FATAL" />
   </filter>
</appender>

Is there some way to avoid this condition?

spool file filled

Navindian — 2013-06-02T15:47:34

Hi

the spool file is getting filled very quickly. I have increased the size by
10 times, but still it is filling the file.

any idea of what is going wrong?

please comment.

Log4j properties in log path

Thomas Andraschko — 2013-05-27T09:18:31

Hi,

AFAICS properties in the filename of a RollingFile Appender are not
supported anymore.

Currently i manually load the xml, replace the name of the property and
initialize the config via ConfigurationSource but that's not a nice
solution.

How can this be done without such hacks in log4j2?

Thanks.

Thomas

how to configure log4j (1.2) in JBoss 6?

Piers Uso Walter — 2013-05-20T13:45:30

Hi,

I am migrating an application from JBoss 4 to JBoss 6 and stumble over the fact that log4j does not seem to be supported by JBoss 6 out of the box any more.

I've researched this quite extensively on the web, but have only found questions from other people, no answers. I hope someone in the log4j community has successfully used log4j (1.2) with JBoss 6 and might be able to help.


Our previous setup with a log4j.xml configuration file in server/default/conf/ no longer works. That configuration files does not seem to be detected and used by JBoss 6.
Basic logging (as configured in server/default/deploy/jboss-logging.xml) works, but I have not been successful in configuring log4j appenders in that file. From what I understand, this file does not really configure log4j, as JBoss 6 uses a new logging mechanism.
 
For example, I've modified jboss-logging.xml to use a log4j console appender and a log4j file appender instead of the standard appenders (see attached file). This did not work. The log file ${jboss.server.log.dir}/log4j.log is not created, the console log stays at level INFO (instead of DEBUG).
 
What would I have to do in order to get JBoss 6 to use log4j for my applications?
One requirement we have is to store the log4j configuration in a central file and not within the application packages (because for debugging purposes we ask our customers to modify the configuration).

I'm using JBoss 6.1 final, in case that makes a difference.
 
Thanks a lot
Piers

Programmatically setting log4j2 log level

Eric Scheie — 2013-05-17T04:44:40

I'm developing a web application and would like to be able to dynamically
change log levels from within my application instead of editing the log4j2
configuration file.   I'm using log4j 2.0 beta5.

I'm currently setting the log level after a form submit using:

((org.apache.logging.log4j.core.Logger) LogManager.getLogger(LogManager.
ROOT_LOGGER_NAME)).setLevel(Level.XXXXX);


And when I call:


((org.apache.logging.log4j.core.Logger) LogManager.getLogger(LogManager.
ROOT_LOGGER_NAME)).getLevel()


I get the level that I previously set as expected but I don't see the level
reflected in the logs.  For example, when changing the level to DEBUG on
the root logger I do not see debug messages written to the console.  If I
change the level of the root logger in my log4j2.xml configuration file I
do see the debug messages written to the console.


Here is my log4j2.xml file.


<?xml version="1.0" encoding="UTF-8"?>

<configuration status="DEBUG" monitorInterval="10">


    <appenders>

        <Console name="Console" target="SYSTEM_OUT">

            <PatternLayout pattern="%d %-5p [%t] %X %C{2}.%M(%L) - %m%n"/>

        </Console>

    </appenders>


    <loggers>

        <root level="INFO">

            <appender-ref ref="Console"/>

        </root>

    </loggers>

</configuration>


Any ideas I how I can change the root logger level after startup
programmtically?  I've been searching the web but the only things that come
up are related to log4j 1.2, I haven't found anything applicable to log4j
2.0.


Thanks,

-Eric

Burst Filter - Use to limit messages sent over a specific period?

Jason B — 2013-05-14T19:47:26

I'm attempting to leverage a burst filter in my application.  I wish to log
errors and send e-mails any time we log an error.  The main thing is, I
don't want to send more than a few e-mails in a given time period (say, one
per event per fifteen minutes), to avoid overwhelming my inbox with these
error events.

Burst Filter seems appropriate for this role, but the documentation is
lacking.  For instance:

 - If I want a filter to accept only those events that happen after the
threshold, but "rest" for that fifteen minute period of time, how would I
accomplish this?  The configuration is less than intuitive here.

 - What is the role of <TimeBasedTriggeringPolicy />? It's not mentioned
anywhere on the site, and only by digging in the source could I actually
determine what it's supposed to be doing.  It's also listed in every
example for filters on the site.

Thanks for clearing up any confusion.

- Jason Black

Need help: Steps in your INSTALL doc failing

Mary Laude — 2013-05-14T00:46:07

Hello -

I can write, compile, and successfully run a Java program
to look at a .jar file and list the classes defined therein, but
I can't for the life of me get your "Using log4j" java code shown
in 1-2.17's INSTALL doc to work.

Perhaps there's some other magic that needs to happen to get
this code snippet you wrote to yield output?
----------------------------------------------------------------------------------------
 You can now test your installation by first compiling the following
   simple program.

    import org.apache.log4j.Logger;
    import org.apache.log4j.BasicConfigurator;

    public class Hello {

      private static final Logger logger = Logger.getLogger(Hello.class);

      public
      static
      void main(String argv[]) {
        BasicConfigurator.configure();
        logger.debug("Hello world.");
        logger.info("What a beatiful day.");
      }
    }
-----------------------------------------------------------------------------------------
I understand how CLASSPATH works, etc.  I can get it to compile but
even if I again (with option -cp) specify exactly where the .class file is
that it just created from the compile, it still can't find what it needs.

Depending on where I've put things and what I tell it, I get one of these
failing results when I try to run the executable:

(1)
java.lang.NoClassDefFoundError: org/apache/log4j/Logger
        at Hello.<clinit>(Hello.java:6)
Caused by: java.lang.ClassNotFoundException: org.apache.log4j.Logger
        at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:423)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:356)
        ... 1 more
Exception in thread "main"

or (2)
Error: Could not find or load main class Hello


Please, I am an old UNIX geek but this is really really frustrating me.
I have looked literally EVERYWHERE to find out what the problem is
but of course I am apparently the first and only person to ever have this
problem.  Ha!

Custom Syslog Format: Appending Exceptions?

Jason B — 2013-05-13T18:38:13

Looking around at the Syslog support, and I noticed that exceptions aren't
being sent across the wire.  I understand that there may be some limit to
how much data we're sending across with Syslog via TCP, but I was curious
if there was any custom support for formatters with exceptions.

I came across this old JIRA for that support:

https://issues.apache.org/jira/browse/LOG4J2-136

... and looking into RFC5424Layout, I see that it could be added, but I'm
not sure if our setup is configured properly to make use of it.

- Jason Black

Convient way to specify Log4J2 configuration outside of webapp?

Jason B — 2013-05-13T16:32:22

Hello,

I'm wondering if there is a convenient way to configure Log4J2 logging
without having it inside of our resources directory.  I don't want to use
symbolic links, as that has the potential of introducing security holes
into our platform.

We're looking into other options such as specifying file locations, but the
documentation is incomplete or does not apply to our unique solution.

Could some light be shed on this?

Thanks,

Jason Black

[ANNOUNCEMENT] Welcome Nick Williams

Christian Grobmeier — 2013-05-11T04:53:18

Hi,

it is my pleasure to announce to the community
that Nick Williams has joined our ranks.

He made remarkable contributions to log4j 2
and we all believe he is a valuable member
of Apache Logging Services now and in future.

Kind regards,
Christian

Two problems with SMTPAppender

Matej Vitásek — 2013-05-09T12:32:03

Hi all,

I'd like to report 2 problems I am encountering using the SMTPAppender. I
am using it* to send me mails whenever an ERROR is logged in a web
application.

1) Buffer size is ignored. Excerpt from my log4j2.xml:
<SMTP name="Mail" suppressExceptions="false" subject="Error Log"
to="..." from="..." smtpHost="smtp.gmail.com"
 smtpPort="465" *bufferSize="10"* smtpProtocol="smtps" smtpUsername="..."
smtpPassword="...">
 </SMTP>

You will notice that the buffer size is 10. I'd expect to be getting
e-mails with 10 errors aggregated, but every e-mail always contains only
one error.

Looking into SMTPAppender.append() I see a call to manager.sendEvents()
which does not aggregate the message - it just sends it. To me it seems
that append() should write into SMTPManager.buffer and send only if it's
full...

2) Sending the e-mail blocks the thread that logged the error. I don't know
how to "prove" this empirically, it's just a really clear subjective
feeling: whenever an error gets logged, the whole application just lags for
the time it takes to send the mail.

Can I provide you some help in pinpointing this problem?


Overall: just ask if you need more information,


Thanks!


Matej

Chainsaw support for java.util.logging file format

Scott Deboy — 2013-05-03T07:04:23

For those who may be interested, Chainsaw has been updated to include
support for multi-line log file formats, including the default
java.util.logging file format.

If you want to try it out, the developer snapshot of Chainsaw, in Mac dmg
or zip file format, is available at
http://people.apache.org/~sdeboy

If you want to try out Chainsaw's ability to parse and tail a
java.util.logging-formatted file, follow these steps:

 - start Chainsaw
 - Select the 'File, Load Chainsaw configuration' menu
 - Select 'process a log file'
 - Select the log file you want to parse by pressing the 'Open File' button
and browsing to the file
 - Log file format: TIMESTAMP LOGGER THREAD(LF)LEVEL: MESSAGE
 - Log file timestamp format: MMM dd, yyyy HH:mm:ss a

You may want to check the box at the bottom to tell Chainsaw to always run
with this configuration, or save it off for later use.

Feedback always welcome!

Scott Deboy

Custom Converter plugin won't load.

John Smith — 2013-05-01T20:41:13

Using log4j2-beta5

I'm writing a custom PatternConverter to mask logs for such things as
Credit Card and Card Security Code and some additional elements.

My converter looks like so....

package com.xxx.log4j.converters;

import java.util.List;
import java.util.regex.Pattern;

import org.apache.logging.log4j.core.LogEvent;
import org.apache.logging.log4j.core.config.Configuration;
import org.apache.logging.log4j.core.config.plugins.Plugin;
import org.apache.logging.log4j.core.layout.PatternLayout;
import org.apache.logging.log4j.core.pattern.ConverterKeys;
import org.apache.logging.log4j.core.pattern.LogEventPatternConverter;
import org.apache.logging.log4j.core.pattern.PatternFormatter;
import org.apache.logging.log4j.core.pattern.PatternParser;

< at >Plugin(name = "MaskConverter", type = "Converter")
< at >ConverterKeys({"ma", "mask" })
public class MaskConverter extends LogEventPatternConverter  {

private final List<PatternFormatter> formatters;
private final Pattern ccPattern;
private final Pattern cvnPattern;

public static final String CARD_PATTERN =
"(AcctNumber|AcctNumber2)([=\\^])([0-9]+)([0-9]{4})";
public static final String CARD_MASK = "$1$2********$4";
public static final String CVN_PATTERN = "(Cvn)([=\\^])([0-9]{3,4})";
public static final String CVN_MASK = "$1$2****";

    private MaskConverter(final List<PatternFormatter> formatters, final
Pattern ccPattern, final Pattern cvnPattern) {
        super("ma", "mask");

        System.out.println("Here...");

        this.formatters = formatters;
        this.ccPattern = ccPattern;
        this.cvnPattern = cvnPattern;
    }

    public static MaskConverter newInstance(final Configuration config,
final String[] options) {

        System.out.println("There...");

    if (options.length != 1) {
            LOGGER.error("Incorrect number of options on mask. Expected 1
received " + options.length);
            return null;
        }

        final Pattern ccPattern = Pattern.compile(CARD_PATTERN,
Pattern.CASE_INSENSITIVE);
        final Pattern cvnPattern = Pattern.compile(CVN_PATTERN,
Pattern.CASE_INSENSITIVE);

        final PatternParser parser =
PatternLayout.createPatternParser(config);
        final List<PatternFormatter> formatters = parser.parse(options[0]);
        return new MaskConverter(formatters, ccPattern, cvnPattern);
    }

< at >Override
public void format(final LogEvent event, final StringBuilder toAppendTo) {

        System.out.println("Where..." + event.getMessage());
 final StringBuilder buf = new StringBuilder();

for (final PatternFormatter formatter : formatters) {
            formatter.format(event, buf);
        }


toAppendTo.append(ccPattern.matcher(cvnPattern.matcher(buf.toString()).replaceAll(CVN_MASK)).replaceAll(CARD_MASK));
}
}

And my log4j2.xml looks like...


<?xml version="1.0" encoding="UTF-8"?>
<configuration status="TRACE" monitorInterval="5"
packages="com.xxx.log4j.converters,">
<appenders>
<FastFile name="FILE" fileName="C:/Temp/XXXJava/logs/vertx.log"
immediateFlush="false" append="false">
<PatternLayout pattern="%d{HH:mm:ss.SSS} [%t] %-5level %logger{36} -
%mask{%msg}%n"/>
</FastFile>
<Console name="Console" target="SYSTEM_OUT">
<PatternLayout pattern="%d{HH:mm:ss.SSS} [%t] %-5level %logger{36} -
%mask{%msg}%n"/>
</Console>
</appenders>
<loggers>
<root level="DEBUG">
<appender-ref ref="Console"/>
<appender-ref ref="FILE"/>
</root>
</loggers>
</configuration>

But it doesn't seem to load the plugin I don't see any of my print
statements in the console and all I see is the word ask appended to my log
messages.

Have I missed something

AUTO: Anurag Srivastava5 is out of the office (returning 05/06/2013)

Anurag Srivastava5 — 2013-04-29T04:32:09

I am out of the office until 05/06/2013.

Please contact my manager Abhijit Deshmukh (Abhi Deshmukh/India/IBM) for
any urgent issues.


Note: This is an automated response to your message  "Re: How to use
FastFile" sent on 29/04/2013 4:20:05.

This is the only notification you will receive while this person is away.

Lilith 0.9.43 has been released!

Jörn Huxhorn — 2013-04-28T23:54:39

This mainly fixes an incompatibility with Logback 1.0.12 and adds support for log4j2.

See http://lilithapp.com/releases/0.9.43.xhtml for detailed information.

Cheers,
Joern.

How to use FastFile

Steven Yang — 2013-04-27T09:36:17

I am using log4j beta5 and want to try async file appender FastFile.
However I could not get it to work.
I have built the disruptor jar using project from
https://github.com/LMAX-Exchange/disruptor so my disruptor is 3.0.1 not
3.0.0, dont know if it matters.

I simply follow the sample setup from
http://logging.apache.org/log4j/2.x/manual/async.html#Performance.

But I could not see anything log into my log file, I can see the log file
created but nothing inside.
If I simply change from FastFile to File, I can see all the logs that
suppose to appear.
I have the following jars in my project
log4j-api-2.0-beta5.jar
log4j-core-2.0-beta5.jar
log4j-jcl-2.0-beta5.jar
log4j-slf4j-impl-2.0-beta5.jar

In my project I mainly use slf4j but even if I try to use log4j api direct,
it still doesnt work.

here is my log4j2.xml

<configuration status="DEBUG">
    <appenders>
    <FastFile name="FastFile"
fileName="D:/Projects/TestingProject/logs/log4jtest.log"
immediateFlush="false" append="false" suppressExceptions="false">
      <PatternLayout>
        <pattern>%d %p %c{1.} [%t] %m %ex%n</pattern>
      </PatternLayout>
    </FastFile>
  </appenders>
  <loggers>
    <root level="debug" includeLocation="true">
      <appender-ref ref="FastFile"/>
    </root>
  </loggers>
</configuration>

What am I doing wrong? or do I need to check for any dependency for
disruptor?

Thanks