processing large amount of log-like data (text & binary) in telecom production system
  Home FAQ Contact Sign in
comp.lang.functional only
 
Advanced search
POPULAR GROUPS

more...

comp.lang.functional Profile…
 Up
processing large amount of log-like data (text & binary) in telecom production system         


Author: forth
Date: May 29, 2008 21:09

I think about using some functional language (erlang or maybe ocaml)
for processing large amount of log-like data (text & binary) in
telecom production system.

I think that Erlang can be effectively used for my tasks thus it
already used in telecom by Ericsson , but I need
platform for fast processing large text & binary data flows (up to 5-7
Gb per day). Maybe OCaml can be more effective for that task ?

I never use any functional langages before, and need some help like
free e-book like Broudie's Staring FORTH for Erlang or OCaml for first
start, something like school-level beginners course. Anybody can give
some links ?
3 Comments
Re: processing large amount of log-like data (text & binary) in telecom production system         


Author: Ulf Wiger
Date: May 30, 2008 01:56

forth@km.ru skrev:
> I think about using some functional language (erlang or maybe ocaml)
> for processing large amount of log-like data (text & binary) in
> telecom production system.
>
> I think that Erlang can be effectively used for my tasks thus it
> already used in telecom by Ericsson , but I need
> platform for fast processing large text & binary data flows (up to 5-7
> Gb per day). Maybe OCaml can be more effective for that task ?
>
> I never use any functional langages before, and need some help like
> free e-book like Broudie's Staring FORTH for Erlang or OCaml for first
> start, something like school-level beginners course. Anybody can give
> some links ?

Perhaps you could check out Hancock?

http://www.research.att.com/~kfisher/hancock/

It's only available for non-commercial use, though.
Show full article (2.25Kb)
no comments
Re: processing large amount of log-like data (text & binary) in telecom production system         


Date: May 30, 2008 02:16

forth@km.ru writes:
> I think that Erlang can be effectively used for my tasks thus it
> already used in telecom by Ericsson , but I need
> platform for fast processing large text & binary data flows (up to 5-7
> Gb per day). Maybe OCaml can be more effective for that task ?

That's peanuts on a reasonably fast PC these days, even in a fairly
slow interpreted language. I munch that much data through Python
programs in an hour or so all the time.
no comments
Re: processing large amount of log-like data (text & binary) in telecom production system         


Author: Jon Harrop
Date: May 30, 2008 02:54

forth@km.ru wrote:
> I think about using some functional language (erlang or maybe ocaml)
> for processing large amount of log-like data (text & binary) in
> telecom production system.
>
> I think that Erlang can be effectively used for my tasks thus it
> already used in telecom by Ericsson , but I need
> platform for fast processing large text & binary data flows (up to 5-7
> Gb per day). Maybe OCaml can be more effective for that task ?
>
> I never use any functional langages before, and need some help like
> free e-book like Broudie's Staring FORTH for Erlang or OCaml for first
> start, something like school-level beginners course. Anybody can give
> some links ?

You might like my book OCaml for Scientists:

http://www.ffconsultancy.com/products/ocaml_for_scientists/chapter1.html

In particular, the IO chapter covers high-performance parsing of text using
lex and yacc.

Here are some reviews:
Show full article (1.16Kb)
no comments