gmane.text.clearsilver.general

little bug on hdf_remove_tree()

马亮 — 2013-04-03T08:31:18

hi,
    It seems that hdf->last_hs, hdf->last_hp should set to NULL, if hdf_remove_tree() dealloced them.

    following code can run normally, but valgrind detected one "Invalid read of size", so, please take a look:
    (also viewable on https://gist.github.com/bigml/5299443)


int main(int argc, char **argv, char **envp)
{
    HDF *node, *cnode;
    hdf_init(&node);


    hdf_set_value(node, "foo.0.pic", "xxx.jpg");
    hdf_set_value(node, "bar.0.pic", "yyy.jpg");


    cnode = hdf_get_child(node, "foo");
    hdf_copy(node, "gifts.0", cnode);


    cnode = hdf_get_child(node, "bar");
    hdf_copy(node, "gifts.1", cnode);


    hdf_remove_tree(node, "bar");


    hdf_set_value(node, "zzzz", "4");


    hdf_destroy(&node);


    return 0;
}




this is the valgrind output:


[root< at >mdev demo]# valgrind --leak-check=full ./hdfremove
==16521== Memcheck, a memory error detector.
==16521== Copyright (C) 2002-2006, and GNU GPL'd, by Julian Seward et al.
==16521== Using LibVEX rev 1658, a library for dynamic binar

Re: VC++

paragshravagi — 2013-02-05T11:55:19

I tried to download this patch from the mentioned link. But the site cannot be reached.
Can someone share the patch again?

Best Regards,
ParagS

--- In ClearSilver< at >yahoogroups.com, "Szolnoki Tibor"  wrote:

high-speed hdf-json-bson converter

马亮 — 2012-11-10T13:55:13

hi, cs


I have an application need high-spped json, hdf, bson converter. I can't find it on internet, so, I coded them, put them on https://github.com/bigml/cmoon/blob/master/lib/mnl/mbson.h  mbson.c mjson.h mjson.c


It's performance can't satisfy my need. A 5-node object convert need almost 10 usecond. I want it done in 1 usecond (1,000,000 conversion per second).


So, Is there anybody intrest on this? Let's improve it together.




the test program gist on    https://gist.github.com/4051150

Re: At what point does CS acquire its data from the HDF backend data

David Jeske — 2012-08-15T16:29:13



Yes, the result of hdf_write_file should be readable by hdf_read_file.

I doubt hdf_write_file is smart about escaping the contents of HDF keys
though. This is something that could be fixed, but generally we expect HDF
keys to be "symbol like" not arbitrary text. Anything messy and arbitrary
should be in an HDF value not a key.






Is it possible there are newlines in your HDF keys? This above HDF should
have been written as:

Summary {

Re: At what point does CS acquire its data from the HDF backend data

Rod Nussbaumer — 2012-08-15T15:00:30

Thanks for clarifying that. I just wanted to make sure what I'm trying 
to do is actually within the intended purpose of ClearSilver. Armed with 
that information, it looks like I've narrowed the problem down to 
sharing data between threads in libmicrohttpd. While the documentation 
says 'threads', it looks like it actually implements processes for the 
HTTP server, so I'm going to have to work a bit to get the data to the 
callback functions.

I do have one other question, however. If I use hdf_write_file(), is the 
resulting file intended to be readable with hdf_read_file()? I think 
some of my string data has characters that may need to be escaped or 
otherwise transformed, as I get a peculiar looking 'here-document' like 
format in the file written by hdf_write_file(), and it doesn't seem to 
be readable with hdf_read_file().

Here's a result:


The data file contains this:


If I'm right about the problem, what sort of treatment do I need to 
apply to the string(s)?

    ---  rod.

Re: At what point does CS acquire its data from the HDF backend database?

David Jeske — 2012-08-14T20:00:59

What you're doing is fine. You can call cs_render multiple times, changing
the HDF dataset in-between. There are, however, some subtleties of
var/evar/lvar <http://www.clearsilver.net/docs/man_templates.hdf#var> you
should read up on. If you are putting clearsilver macros inside HDF, and
you want this to work, you'll probably need to stick to LVAR only.

I recommend making a standalone C-program with a small HDF and small
template to demonstrate the problem you are seeing. If that isn't enough to
help you figure out what's going wrong, you can post that mini program here
and we can explain how to fix it.

At what point does CS acquire its data from the HDF backend database?

Rod — 2012-08-14T17:44:30

I have an application that I'm developing, and hoping to use CS for part of it. It also uses the GNU libmicrohttpd for providing built-in HTTP server support.
Its basic functionality is that the tool runs for extended periods, all the while acquiring data in quasi-realtime from a proprietary fieldbus in a control system. The HTTP interface is to provide runtime updates to the end user, and to alter configuration of the tool.

In the (C-language) code, I first instantiate the HDF with hdf_init(), then instantiate a parser with cs_init(), associating the parser with the HDF. I then read the template file by calling cs_parse_file(). 
Finally, I launch the HTTP daemon thread, and spin around grabbing data from the wire, populating and updating the HDF database. 
In a callback function launched by the HTTP library, I call cs_render(), which generates a page according to the template, except that the template macros are never replaced by the HDF data. I know that the HDF data is being correctly recorded, since whe

Re: ClearSilver shared object libraries?

Rod — 2012-07-30T17:14:16

Patch included. This also tries to fix the problem of cross-compiles that try to run tests on the build hosts, using components created for the non-native target. There is still a problem with the perl tests for cross-development, but I didn't try to fix that. There is an improvement on making distclean, which removes the '.err' files left by running tests.

This is the first time I've submitted a patch to any public project. If I've botched it somehow, please be gentle in your chastisement.
   ---   rod.


#--------------------< start of cs_solibs.patch >------------------
Only in clearsilver-0.10.5: bin
diff -ur clearsilver-0.10.5-ORG/cgi/Makefile clearsilver-0.10.5/cgi/Makefile
--- clearsilver-0.10.5-ORG/cgi/Makefile 2006-11-09 14:35:37.000000000 -0800
+++ clearsilver-0.10.5/cgi/Makefile     2012-07-30 08:51:02.000000000 -0700
< at >< at > -6,6 +6,7 < at >< at >
 
 include $(NEOTONIC_ROOT)/rules.mk
 
+CGI_SOLIB = $(LIB_DIR)libneo_cgi.so
 CGI_LIB = $(LIB_DIR)libneo_cgi.a
 CGI_SRC = cgiwrap.c cgi.c html.c date.c rfc2388.c
 CG

Re: ClearSilver shared object libraries?

David Jeske — 2012-07-14T00:10:57

AFAIK, there isn't any particular reason that dynamic libs are not built
(on UNIX).. probably that nobody that needed them submitted patches.

My Windows/C# patches build a DLL for DllImport / PInvoke (though I'm not
sure whether they are rolled into a real release yet).

As for why nobody has needed a UNIX .so -- it's most common to use
Clearsilver from dynamic languages, such as Python, Java, Ruby, etc. In
that case, the clearsilver library gets statically included into the
dynamic language runtime module for simplicity sake. Also, since the
included code is small, I doubt the direct C-users have ever cared. Linking
statically avoids installation dependencies.

If you specifically need a .so and need help, I'm sure someone can tweak
the build. If you do it, feel free to submit patches.


On Fri, Jul 13, 2012 at 1:25 PM, Rod <bomr< at >shaw.ca> wrote:

ClearSilver shared object libraries?

Rod — 2012-07-13T20:25:05

Just started using ClearSilver, and wondering why there aren't any shared object libraries being built. Is there some technical reason that I don't grok, or have I erred somewhere?

   ---   rod.

Crashes with the python plugin

camio — 2012-06-27T00:39:21

Hello,

I've been trying to make a new egg of the python module for version 0.10.5. Unfortunately, I'm getting crash behavior particularly in the cs_destroy function in my tests. The second uListDestroy and dealloc_function calls both cause a crash in cs_destroy. When I comment those out, I don't get a problem.

Any ideas?

David

Re: Filter at runtime

Brandon Long — 2012-04-24T04:45:21

I'm not sure I understand.  You want to intercept every hdf_set_value
call to change what is set?

There isn't a way to do this in C.  In Java/Python where there's an
object wrapper to HDF, you can sub-class the object to implement
something like this.

In C, you'd have to have your own set of functions to call instead,
which would call the underlying HDF functions.

Brandon

On Mon, Apr 23, 2012 at 12:51 AM, bxxx <vincebouix< at >yahoo.fr> wrote:

Filter at runtime

bxxx — 2012-04-23T07:51:23

Hello Brandon, hello everybody,

I want to filter every dataset into clearsilver hdf at runtime.
OR is it possible to (override | add hook) "var" hdf function ?

thanks
VB

clearsilver bug in cgi-parse, form posting with explicit chartset...

David Jeske — 2012-04-07T21:57:40

I just ran into a bug in clearsilver that I'm surprised has existed for so
long.

The problem occured because Firefox is specifying a character set in the
content type of form posts, ala...

   application/x-www-form-urlencoded; charset=UTF-8

Clearsilver cgi_parse was expecting an exact match for
"application/x-www-form-urlencoded"..

I fixed this by having clearsilver check only the prefix of content type,
as you can see in my patch below. There is probably a better way to fix
this, by having clearsilver properly parse the content type for it's parts
according to the spec. Though perhaps this fix is enough...




root< at >w5:/home/hassan# diff -c clearsilver-0.10.5-orig/cgi/cgi.c
clearsilver-0.10.5/cgi/cgi.c
*** clearsilver-0.10.5-orig/cgi/cgi.c   2007-07-11 19:38:03.000000000 -0700
--- clearsilver-0.10.5/cgi/cgi.c        2012-04-07 14:52:12.742725038 -0700
***************
*** 640,646 ****

    if (!strcmp(method, "POST"))
    {
!     if (type && !strcmp(type, "application/x-www-form-urlencoded"))
      {

Re: Best solution for output file directly

Brandon Long — 2012-03-20T17:54:28

If you want to use the wrappers in CS, you can do something like:

cgiwrap_writef("Content-Type: foo/bar\r\n");
cgiwrap_writef("Content-Length: %d\r\n\r\n", content_length);
cgiwrap_write(buf, length);

In a standard CGI API, this is equivalent to using fprintf and fwrite to
stdout.

Brandon

On Tue, Mar 20, 2012 at 10:02 AM, David Jeske <davidj< at >gmail.com> wrote:

Re: Best solution for output file directly

David Jeske — 2012-03-20T17:02:13


Clearsilver is for producing templated-output, such as HTML. If you want to
just send a file directly to the user, you just output the bytes directly
through your CGI API -- going right around clearsilver.

What C-CGI API are you using?

Best solution for output file directly

bxxx — 2012-03-20T16:52:31

What is the best solution with clearsilver (C API of course) to send a file directly to the browser?

thx

Re: is there any syntax template for cs file?

David Jeske — 2012-03-15T07:14:45


Did you try it?

BTW - since the introduce of C#, we've kind of informally moved to .cst to
avoid the extension duplication.

Support Ticket System - Knowledge base software

Michael Moody — 2012-02-20T10:18:39

Dynamically route and assign help desk tickets to any specific 
technician or group of technicians using your organization's business 
logic; based on ticket categories, technician skill set, location, 
department, technician availability and work load balance.

knowledge base software
<http://www.knowledgebaseforce.com/about-knowledge-base-force.aspx>   |
knowledgebase software <http://www.knowledgebaseforce.com/benefits.aspx>

is there any syntax template for cs file?

Matthew — 2012-03-15T05:55:15

http://www.vim.org/scripts/script.php?script_id=1100
I fount this, but I think it doesn't work, so who can tell me is there a file for this?

Re: spell bug in cgi.c

Brandon Long — 2012-03-08T18:23:59

Not sure that quite qualifies as a spell bug, but its a real bug.  Thanks,
fixed in the repo.

Brandon

2012/2/27 马亮 <bigmaliang< at >163.com>