gmane.comp.db.rrdtool.devel

Re: drill down charts using rrdtools

Valter Silva — 2013-05-15T12:19:35

Hi Mudran,
as Tobias recommend you, you could do that with some front end code.
It's not directly related to your question, but recently I posted at
stackoverflow a
question<http://stackoverflow.com/questions/15616873/how-do-i-change-rrdtool-graphs>,
wondering how to customize the rrdtool graph.
I hope this help you some way.

Good luck!

--
Atenciosamente,
[image: movile logo] <http://www.movile.com/>Valter Silva
Analista de Infraestrutura
Tel: +55 19. 9122-1822
Skype: valter.silva.movile
valter.silva< at >movile.com
[image: Movile Facebook] <http://facebook.com/movile>[image: Movile
Twitter]<http://www.twitter.com/movile>[image:
Movile LinkedIn] <http://www.linkedin.com/company/movile>[image: Movile
Pinterest] <http://www.pinterest.com/movile>[image: Movile Great Place to
Work 2012]
[image: Enviroment responsibility]


2013/5/15 mudradimohan <mudradi.mohan< at >gmail.com>

_______________________________________________
rrd-developers mailing list
rrd-developers< at >lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/list

Re: drill down charts using rrdtools

mudradimohan — 2013-05-15T06:21:53

Thanks a lot... In fact I was thinking of that option to send the parameters
(start and end) through front end code



--
View this message in context: http://rrd-mailinglists.937164.n2.nabble.com/drill-down-charts-using-rrdtools-tp7581010p7581012.html
Sent from the RRDtool Developers Mailinglist mailing list archive at Nabble.com.

Re: drill down charts using rrdtools

Tobias Oetiker — 2013-05-15T06:18:00

Hi Mohan,

Yesterday mudradimohan wrote:


since rrdtool draws static images, the selection process must be
handled by some frontend code, but rrd will gladly draw additional
images if you call it with appropriate parameters.

cheers
tobi

drill down charts using rrdtools

mudradimohan — 2013-05-15T06:09:25

My name is Mohan and this is my first entry to this forum. As of now I am
familiar with creating a chart using rrdtool. I just wanted to know whether
there is any option in rrdtool to draw a drill down chart, i.e., if I select
some region between 2 hour values, then the selected region should zoom and
show the chart dividing the selected region into minutes, further if I
select 2 minute values then it should show the graph divided into seconds
between the 2 minutes. Is this possible to achieve this in rrdtool? If so
can you please give me some idea?

Thanks and regards,
Mohan Rao Mudradi



--
View this message in context: http://rrd-mailinglists.937164.n2.nabble.com/drill-down-charts-using-rrdtools-tp7581010.html
Sent from the RRDtool Developers Mailinglist mailing list archive at Nabble.com.

Re: cassandra support

Ryan Kubica — 2013-05-12T21:11:51


Hi Nirmoy,

Yes; cassandra support is something I've been thinking about as well.

I'm curious:

How well has this worked for you?

Could you provide a sample syntax for how rrdtool is being called?

What features are supported or not supported?  Does it provide normalization syntax like the libdbi support does?

ps: libdbi was not interesting due to the low scalability of it compared to rrdtools datafile format.


thanks
-Ryan 


________________________________
 From: nirmoy <nirmoy.aiemd< at >gmail.com>
To: rrd-developers< at >lists.oetiker.ch 
Sent: Tuesday, January 8, 2013 4:27 AM
Subject: [rrd-developers] cassandra support
 

Hey friends,

I have added cassandra support to rrd like lidbi. Is there anyone interested
?Please suggest  me to add some more features. i just added basic cassandra
data model support one columnfamily one row support , so this modification
can support millions of data point to be stored. 



--
View this message in context: http://rrd-mailinglists.937164.n2.nabble.com/cassandra-suppo

vnames

Alex van den Bogaerdt — 2013-02-21T21:30:08

A user got bitten by using a vname which could not be used in RPN.

The manual pages warn for this, but apparently nobody noticed the problem 
when the user asked for help.  I admit that I did not immediately spot it 
and needed to do some debugging before being able to solve the problem.
(see the rrd-users mailing list)

Maybe rrdtool should refuse to use, or at least warn about, vnames which are 
also existing operators in RPN?

cheers,
Alex
P.S.
No, I cannot send a patch due to circumstances.

Re: rrdtool + libdbi / mysql speed test

Olivier Doucet — 2013-01-09T14:58:50

Hello,


2013/1/8 Tobias Oetiker <tobi< at >oetiker.ch>:

I've created a pull request to explicit this performance issue on
documentation :
https://github.com/oetiker/rrdtool-1.x/pull/363

FYI, Libdbi has been patched on CVS and the fix is working correctly
(waiting for an official release now).
I've also updated my blog post to show what are the performances now:
http://www.olivierdoucet.info/blog/2012/12/31/rrdtool-mysql/
(SQL backend is still slower than rrd file, but the overhead is acceptable).

Olivier

Re: rrdtool + libdbi / mysql speed test

Tobias Oetiker — 2013-01-08T13:09:52

Hi Olivier,

Today Olivier Doucet wrote:


if you could send a pull request on github.com/oetiker/rrdtool-1.x
for any doc updates you see fit, I will be glad to integrate it ...

cheers
tobi

Re: cassandra support

Tobias Oetiker — 2013-01-08T13:08:29

Hi Nirmoy,

Today nirmoy wrote:


if you submit a pull request for master on
github.com/oetiker/rrdtool-1.x I will be glad to look at it ...

cheers
tobi

cassandra support

nirmoy — 2013-01-08T12:27:48

Hey friends,

I have added cassandra support to rrd like lidbi. Is there anyone interested
?Please suggest  me to add some more features. i just added basic cassandra
data model support one columnfamily one row support , so this modification
can support millions of data point to be stored. 



--
View this message in context: http://rrd-mailinglists.937164.n2.nabble.com/cassandra-support-tp7580708.html
Sent from the RRDtool Developers Mailinglist mailing list archive at Nabble.com.

Re: rrdtool + libdbi / mysql speed test

Olivier Doucet — 2013-01-08T11:38:32

Hello,

Just a follow up on this :
Problem is definitely in libdbi and the implementation of
dbi_result_next_row(). This function is using mysql_data_seek() all
the time to move from one row to another, which is very unefficient
for mySQL. PostgreSQL backend does not have this problem.
Unfortunately, we cannot fix this outside libdbi (we would need to
call libmysql directly ...).

A fix will be applied on libdbi in the next few days. I'll let you
know when this is done. Then, I think a note in documentation about
this will be very helpful for people who want to use MySQL backend
(they should be aware of the speed issue, and how to solve it).

The topic on libdbi mailing list can be seen here :
http://sourceforge.net/mailarchive/message.php?msg_id=30320894

Olivier

rrdtool + libdbi / mysql speed test

Olivier Doucet — 2013-01-07T16:52:13

Hello everyone,

Happy new year 2013 !

I spent the last few weeks testing libdbi support in rrdtool. Some
people already reported that using libdbi is not very efficient, but I
couldn't find any numbers on this (just "it's slow").

I've done some investigation, to track where performance was hit and
on which criteria. This is of course when you want rrdtool graph, as
data creation / updates are handled outside rrdtool.
When using rrdtool file for storing data, it took the same time to
graph 1 hour of data or 200 hours. Retrieving data from 1 DS or 5 DS
(inside the very same rrd file) took approximately the same time.
When using libdbi (with mysql backend), time needed to render the
graph is skyrocketing, based on how many hours of data you want, and
how many DS you have.
The following chart is very straightforward :
http://www.olivierdoucet.info/blog/wp-content/uploads/2012/12/graph.png

What is interesting here is that time is not spent on the query itself
(took less than a second, even for 1 year of data)

Re: rrdcached: path sanitizer

Tobias Oetiker — 2012-12-06T05:39:54


for the rrdtool future, make sure to check out and provide your
input on

https://github.com/oetiker/rrdtool-2.x

cheers
tobi

Re: rrdcached: path sanitizer

Kiss Gabor (Bitman — 2012-12-06T05:31:47


You are absolutely right. Originally I wanted a simple character
copy function but suddenly I found realpath() and I was too happy
to think over what happens to symlinks. Sorry for the noise.

Gabor

Re: rrdcached: path sanitizer

Stanislav Sinyagin — 2012-12-05T22:37:04

Kevin, you would need such lookups only once when the file path is encountered for the first time. Then it can be stored in a hash table inside rrdcached.





rrd-developers mailing list
rrd-developers< at >lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-developers

Re: rrdcached: path sanitizer

kevin brintnall — 2012-12-05T22:18:54


This is going to cause a LOT of stat() calls: O(commands * average dir
depth)

I see your point, but it's probably better to do trivial string
manipulations that don't hit the filesystem.
The whole point of rrdcached is to defer and collate I/O.

If you feel strongly about it, I encourage you to benchmark it with a
non-trivial number of files (500,000) and command rate (1k/sec).

Re: rrdcached: path sanitizer

Kiss Gabor (Bitman — 2012-12-05T16:58:23

In theory you are right.
But I'm afraid this is not too efficient.
It requires a lot of searches and/or rewriting database code heavily.

I'd just replace an existing (but ineffective) string manipulation
function with an other one.


Here you are :-)

realpath(3)

DESCRIPTION
       realpath() expands all symbolic links and resolves references  to  /./,
       /../  and  extra  '/' characters in the null-terminated string named by
       path to produce a canonicalized absolute pathname.  The resulting path-
       name is stored as a null-terminated string, up to a maximum of PATH_MAX
       bytes, in the buffer pointed to by resolved_path.  The  resulting  path
       will have no symbolic link, /./ or /../ components.


Cheers

Gabor

Re: rrdcached: path sanitizer

Tobias Oetiker — 2012-12-05T16:37:48

Hi Gabor,

Friday Kiss Gabor (Bitman) wrote:


or read the inode and the filesystem associated with the file, that
should also help to figure out what is the same ...

contributions welcome ...

cheers
tobi

rrdcached: path sanitizer

Kiss Gabor (Bitman — 2012-11-30T12:33:16

I've just installed rrdcached and I'm checking its performance.

I found that daemon does not sanitize file paths.
Two different cliens may want to refer the same unix file
with different names but rrdcached does not recognizes this
but uses given filenames literally.

E.g. Unix system calls "know" that the following files are the same
/var/lib/cricket/subdir/foo.rrd and /var/lib/cricket//subdir/foo.rrd,
/var/lib/cricket/subdir/bar.rrd and /var/lib/cricket/./subdir/bar.rrd 
etc.
Meanwhile rrdcache thinks they are different.
This may be problem when one program updates RRD file and an other
one tries to flush cache before graphing.

Checking the source code I found that severeal request handlers
call get_abs_path(&file, file_tmp), but then no one uses
the content of file_tmp.
Maybe this function could be replaced with an other that
canonifies file paths. I.e. multiple slashes should be replaced
with single one and "./" should be omitted.

Regards

Gabor

[contrib] python binding rrdtool 1.4.7 Python 2.7win32

Ana Oprea — 2012-11-05T20:09:59

Hello

First of all, thank you for developing such a useful tool.

I recently needed a Python binding for rrdtool on Windows and I was 
surprised not to find something new. When trying to compile it myself, I 
have hit a few small problems that were a bit time consuming.

I have uploaded at [1] the binary files and the sources I used to obtain 
them from. Feel free to add the archives to the download page of rrdtool 
and let me know if I could help with modifying something else.

[1] http://swarm.cs.pub.ro/~anao/rrdtool_python_binding_win32/

Kind regards,

Re: Internal error while talking to rrdcached

Juha Mustonen — 2012-11-05T06:14:11

Thanks for the responses! In fact, the issue was resolved already on Friday
(response was posted in the Zenoss community thread
http://community.zenoss.org/thread/18663, but could not update this thread
until now):
The problem was indeed with the permissions: server had connections limited
by hosts file and following change was required in /etc/hosts.allow:

rrdcached: localhost


Now the data is collected correctly. Of course, one could try improving
rrdcache's error message in the future, albeit it seems all logical now.


Br,

Juha


On Mon, Nov 5, 2012 at 6:45 AM, Steve Shipway <s.shipway< at >auckland.ac.nz>wrote: