gmane.linux.oprofile

Re: [PATCH 2/2] Add the event list for Intel IvyBridge

Maynard Johnson — 2012-05-25T15:21:05

Patch applied. Removed some whitespace at end of lines in the events and unit mask files.

-Maynard


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/

Re: [PATCH 2/2] Add the event list for Intel IvyBridge

Maynard Johnson — 2012-05-25T13:48:32

The patch looks fine.  Does it pass 'make distcheck'?

-Maynard


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/

Re: [PATCH 1/2] Implement the ANY Intel extra bit

Maynard Johnson — 2012-05-25T13:47:48

Patch applied.

-Maynard


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/

[PATCH] Fix up anonymous mapping support in operf to include vdso,stack, and heap

Maynard Johnson — 2012-05-25T14:00:32

[PATCH] Fix up anonymous mapping support in operf to include vdso, stack, and heap


Signed-off-by: Maynard Johnson <maynardj< at >us.ibm.com>

This patch has been pushed to the perf-events branch, but review comments are
welcome.

---
 libperf_events/operf_mangling.cpp |    2 +-
 libperf_events/operf_utils.cpp    |   17 +++++++++++------
 2 files changed, 12 insertions(+), 7 deletions(-)

diff --git a/libperf_events/operf_mangling.cpp b/libperf_events/operf_mangling.cpp
index 5b31e29..5165807 100644
--- a/libperf_events/operf_mangling.cpp
+++ b/libperf_events/operf_mangling.cpp
< at >< at > -63,7 +63,7 < at >< at > mangle_filename(struct operf_sfile * last, struct operf_sfile const * sf, int co
 } else if (sf->is_anon) {
 values.flags |= MANGLE_ANON;
 values.image_name = mangle_anon(sf);
-values.anon_name = "anon";
+values.anon_name = sf->image_name;
 } else {
 values.image_name = sf->image_name;
 }
diff --git a/libperf_events/operf_utils.cpp b/libperf_events/operf_utils.cpp
index 42eecce..9ee9b80 100644
--- a/libperf_

Re: [PATCH 2/2] Add the event list for Intel IvyBridge

Andi Kleen — 2012-05-25T13:51:50

Yes.

-Andi

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/

[ oprofile-Bugs-3529111 ] opjitconv failed to parse JIT dump header

SourceForge.net — 2012-05-23T15:05:08

Bugs item #3529111, was opened at 2012-05-23 08:05
Message generated for change (Tracker Item Submitted) made by 
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=116191&aid=3529111&group_id=16191

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: https://www.google.com/accounts ()
Assigned to: Nobody/Anonymous (nobody)
Summary: opjitconv failed to parse JIT dump header

Initial Comment:
The bug occurs on x86_64 Linux (Fedora 15) with oprofile installed from oprofile-0.9.6-21.fc15.x86_64.rpm while trying to profile JIT code produced by 32-bit application.

The debug output of opjitconv shows:

header: bfd-arch=9, bfd-mach=1, bfd_target_name=2-i386

Note that target name must be "elf32-i386"

I assume that the "u64 timestamp" field of "jitheader" structure is 8-byte aligned

[PATCH 1/2] Implement the ANY Intel extra bit

Andi Kleen — 2012-05-23T00:48:42

From: Andi Kleen <ak< at >linux.intel.com>

Implement the ANY (any thread) extra bit for Intel CPUs. Needed
for some of the new events.

Signed-off-by: Andi Kleen <ak< at >linux.intel.com>
---
 libop/op_events.c |    3 +++
 libop/op_events.h |    1 +
 2 files changed, 4 insertions(+), 0 deletions(-)

diff --git a/libop/op_events.c b/libop/op_events.c
index bbb0130..49b9563 100644
--- a/libop/op_events.c
+++ b/libop/op_events.c
< at >< at > -127,6 +127,9 < at >< at > unsigned parse_extra(const char *s)
 } else if (sscanf(s, "cmask=%x%n", &w, &o) >= 1) {
 v |= (w & EXTRA_CMASK_MASK) << EXTRA_CMASK_SHIFT;
 s += o;
+} else if (strisprefix(s, "any")) {
+v |= EXTRA_ANY;
+s += 3;
 } else {
 parse_error("Illegal extra field modifier");
 }
diff --git a/libop/op_events.h b/libop/op_events.h
index 8cbb622..1a65a7a 100644
--- a/libop/op_events.h
+++ b/libop/op_events.h
< at >< at > -21,6 +21,7 < at >< at > extern "C" {
 #include "op_list.h"
 
 #define EXTRA_EDGE (1U << 18)
+#define EXTRA_ANY  (1U << 21)
 #define EXTRA_INV  (1U << 23)
 #define EXT

[PATCH 2/2] Add the event list for Intel IvyBridge

Andi Kleen — 2012-05-23T00:48:43

From: Andi Kleen <ak< at >linux.intel.com>

This adds the event list for Intel IvyBridge and the model number
for the current IvyBridge systems

Signed-off-by: Andi Kleen <ak< at >linux.intel.com>
---
 events/Makefile.am               |    1 +
 events/i386/ivybridge/events     |   57 ++++++++
 events/i386/ivybridge/unit_masks |  269 ++++++++++++++++++++++++++++++++++++++
 libop/op_cpu_type.c              |    2 +
 libop/op_cpu_type.h              |    1 +
 libop/op_events.c                |    1 +
 libop/op_hw_specific.h           |    2 +
 utils/ophelp.c                   |    1 +
 8 files changed, 334 insertions(+), 0 deletions(-)
 create mode 100644 events/i386/ivybridge/events
 create mode 100644 events/i386/ivybridge/unit_masks

diff --git a/events/Makefile.am b/events/Makefile.am
index 1f7e662..df5215c 100644
--- a/events/Makefile.am
+++ b/events/Makefile.am
< at >< at > -19,6 +19,7 < at >< at > event_files = \
 i386/nehalem/events i386/nehalem/unit_masks \
 i386/westmere/events i386/westmere/unit_masks \
 i386/sandybridge/event

[PATCH] Change operf to create oprofile sample files during profilinginstead of afterwards

Maynard Johnson — 2012-05-22T22:05:40

[PATCH] Change operf to create oprofile sample files during profiling instead of afterwards

Previously, the 'operf-record' process read the perf_events sample data from the kernel
and wrote it to a temporary output file (operf.data).  Then, once the profiling session
was completed, a conversion was performed on that data to put it into oprofile format,
stored in the usual sample files in <session-dir>/samples/current.  I noticed that when
operf was run in system-wide mode, the temporary operf.data file was very large, and the
conversion step was taking inordinately long (from several seconds on a laptop to over
a minute on a large, busy server system.

I've had a TODO comment in the operf.cpp code to investigate performing the conversion
step in-flight (while profiling) versus waiting for the profiling to end.  So I changed
the operf-record process from writing the perf_events sample data to a file to writing
to a pipe.  Then I created a new operf-read process to read from the other end of that
pipe and per

[PATCH] Remove reset option from operf and replace with append option

Maynard Johnson — 2012-05-22T14:15:32

[PATCH] Remove reset option from operf and replace with append option.

By default, operf will now move old profile data from <session_dir>/samples/current
to <session_dir>/samples/previous.  If a 'previous' profile already existed,
it will be replaced.  If the --append option is passed, old profile data is left
in place and new profile data will be added to it, and the 'previous' profile
(if one existed) will remain untouched.

operf man page updates:
Aside from replacing the --reset option with the --append option, several unrelated
fixes were made, including adding the missing --vmlinux option.

This patch has been pushed up to the perf-events branch, but review comments are
as always, welcome.

Signed-off-by: Maynard Johnson <maynardj< at >us.ibm.com>
---
 doc/operf.1.in         |   36 ++++++++++++----
 pe_profiling/operf.cpp |  109 +++++++++++++++++++++++++++--------------------
 2 files changed, 90 insertions(+), 55 deletions(-)

diff --git a/doc/operf.1.in b/doc/operf.1.in
index 00b6b2c..00fb5f3 100644
---

Re: Getting Data from Oprofile within JVM

Xin Tong — 2012-05-21T17:22:49

i want to be able to obtain the data in real time. i.e. i would like to use
that data for optimizations in the JVM.

Thanks

X

On Mon, May 21, 2012 at 9:00 AM, Maynard Johnson <maynardj< at >us.ibm.com>wrote:

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/_______________________________________________
oprofile-list mailing list
oprofile-list< at >lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/oprofile-list

Re: Getting Data from Oprofile within JVM

Maynard Johnson — 2012-05-21T13:00:05

OProfile has no official API for retrieving sample data.  What are you trying to do that can't be done with existing oprofile functionality?

-Maynard



------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/

Re: BR_INST_RETIRED on Intel microarchitecture

Maynard Johnson — 2012-05-21T12:58:44

At the top of ophelp output, you'll see a reference to Intel documentation:
   http://download.intel.com/products/processor/manual/325462.pdf
Chapter 19 of Vol 3 lists events for different types of Intel processors, so you should be able to find the information there.

No.  A quick google search turned up something called "hw-branch-tracer" (ftrace-based tool).  I believe kprobes can also do branch tracing.  I have no experience with either one, though.

-Maynard


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/

Re: Should operf clear old profile data by default?

Maynard Johnson — 2012-05-21T12:04:38

Yeah, I think that would be good, too.  Will post a patch to make it so.

-Maynard


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/

[ oprofile-Bugs-3528383 ] oprofied failed to open device on mpc8572linux version 2.6.

SourceForge.net — 2012-05-21T12:00:35

Bugs item #3528383, was opened at 2012-05-20 04:43
Message generated for change (Comment added) made by maynardj
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=116191&aid=3528383&group_id=16191

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Priority: 5
Private: No
Submitted By: tombkeeper (tombkeeper)
Assigned to: Nobody/Anonymous (nobody)
Summary: oprofied failed to open device on mpc8572 linux version 2.6.

Initial Comment:
Linux version: 2.6.31
CPU: mpc8572, e500 core
oprofile version: 0.9.7

1>oprofile --init is ok

2>oprofile --start failed, error output:
Using 2.6+ OProfile kernel interface.
Failed to open device. Possibly you have passed incorrect
parameters. Check /var/log/messages.Couldn't start oprofiled.
Check the log file "/var/lib/oprofile/samples/oprofiled.log" and kernel syslog

3>check /var/log/message, nothing there.

Re: Build error: oprofile with CONFIG_CPUMASK_OFFSTACK=y && SMP

Will Deacon — 2012-05-21T10:44:47

Hi Russell,

On Sat, May 19, 2012 at 08:32:11AM +0100, Russell King - ARM Linux wrote:

I suspect we can just use NR_CPUS directly here although we could allocate
the array dynamically if somebody is using this on a machine that would
benefit.

Anybody object to this?

diff --git a/drivers/oprofile/oprofile_perf.c b/drivers/oprofile/oprofile_perf.c
index da14432..efc4b7f 100644
--- a/drivers/oprofile/oprofile_perf.c
+++ b/drivers/oprofile/oprofile_perf.c
< at >< at > -25,7 +25,7 < at >< at > static int oprofile_perf_enabled;
 static DEFINE_MUTEX(oprofile_perf_mutex);
 
 static struct op_counter_config *counter_config;
-static struct perf_event **perf_events[nr_cpumask_bits];
+static struct perf_event **perf_events[NR_CPUS];
 static int num_counters;
 
 /*

Will

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include end

Getting Data from Oprofile within JVM

Xin Tong — 2012-05-21T04:16:15

What would be a good place to start to be able to get data from oprofile
within JVM. i.e. i want to have JVM spawn a thread running the task of
oprofiled. The data is then passed to and processed by the thread.

Thanks

Xin
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/_______________________________________________
oprofile-list mailing list
oprofile-list< at >lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/oprofile-list

BR_INST_RETIRED on Intel microarchitecture

Xin Tong — 2012-05-20T17:28:28

I am using oprofile in a JVM environment. I have 2 questions

1. I am not very familiar with intel microarchitecrure, BR_INST_RETIRED
means the branch decision is correct and the branch instruction is
committed ?
2. Can one obtain the address branched to in the PMU registers ? Oprofile
does not seem to provide it.

Thanks

Xin
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/_______________________________________________
oprofile-list mailing list
oprofile-list< at >lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/oprofile-list

[ oprofile-Bugs-3528383 ] oprofied failed to open device on mpc8572linux version 2.6.

SourceForge.net — 2012-05-20T11:43:24

Bugs item #3528383, was opened at 2012-05-20 04:43
Message generated for change (Tracker Item Submitted) made by tombkeeper
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=116191&aid=3528383&group_id=16191

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: tombkeeper (tombkeeper)
Assigned to: Nobody/Anonymous (nobody)
Summary: oprofied failed to open device on mpc8572 linux version 2.6.

Initial Comment:
Linux version: 2.6.31
CPU: mpc8572, e500 core
oprofile version: 0.9.7

1>oprofile --init is ok

2>oprofile --start failed, error output:
Using 2.6+ OProfile kernel interface.
Failed to open device. Possibly you have passed incorrect
parameters. Check /var/log/messages.Couldn't start oprofiled.
Check the log file "/var/lib/oprofile/samples/oprofiled.log" and kernel syslog

Re: Should operf clear old profile data by default?

Andi Kleen — 2012-05-19T15:32:43


I think the new semantics are good, but I would default to keeping a
backup of the old data. So rename it to something else, then create a
new session.

-Andi

Build error: oprofile with CONFIG_CPUMASK_OFFSTACK=y && SMP

Russell King - ARM Linux — 2012-05-19T07:32:11

My OMAP randconfig build found this build error last night:

arch/arm/oprofile/../../../drivers/oprofile/oprofile_perf.c:28: error: variably modified 'perf_events' at file scope

This is caused because nr_cpumask_bits is a variable when we're building
for a SMP system and CONFIG_CPUMASK_OFFSTACK is set.

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/