[ILUG] Breaking up an input stream

[Adrian Flynn]

For the record, there is a version of split which uses regular expressions
as the basis of the split. it is called csplit:

NAME
       csplit  - split a file into sections determined by context
       lines

SYNOPSIS
       csplit [OPTION]... FILE PATTERN...

DESCRIPTION
       Output pieces of FILE separated  by  PATTERN(s)  to  files
       `xx01',  `xx02', ..., and output byte counts of each piece
       to standard output.


Adrian
-----Original Message-----
From: ilug-admin at linux.ie [mailto:ilug-admin at linux.ie]On Behalf Of
Adrian Flynn
Sent: 10 January 2002 14:06
To: 'Kenn Humborg'; ilug at linux.ie
Subject: RE: [ILUG] Breaking up an input stream


Kenn

Thanks for the reply.

Unfortunately, I made a typo in my original message. The Records are
delimited by FF characters, not LF (a case of habit taking over my typing!)
yet each record can contain text lines delimited by LF or CR/LF. Is there a
version of split which allows you to specify the line delimiter? That would
be perfect.

Rgds

Adrian

-----Original Message-----
From: Kenn Humborg [mailto:kenn at bluetree.ie]
Sent: 10 January 2002 12:51
To: adrian.flynn at worldtravel.ie; ilug at linux.ie
Subject: RE: [ILUG] Breaking up an input stream


> Hi All
>
> Does anyone have any sugestions about how to split an input stream: ie..
>
> There is a continuous data stream coming in the serial port.
> There is a LF character at the end of each record.
> Ideally, each record should be stored in a separate file for further
> processing (these records are rather large)
> The question is how to recognise the End-Of-Record character and store all
> data from that record in a (uniquely named) file.
> There is unique data within each record which could form the basis for the
> filename.
>
> Any ideas (sed/awk etc)

Have you tried using split --lines 1 to chop up the input
stream?  Then use another script that reads the xaa, xab
etc files dropped by split and renames then according to
the data inside them?

Later,
Kenn


---
Incoming mail is certified Virus Free.
Checked by AVG anti-virus system (http://www.grisoft.com).
Version: 6.0.309 / Virus Database: 170 - Release Date: 17/12/2001

---
Outgoing mail is certified Virus Free.
Checked by AVG anti-virus system (http://www.grisoft.com).
Version: 6.0.309 / Virus Database: 170 - Release Date: 17/12/2001



--
Irish Linux Users' Group: ilug at linux.ie
http://www.linux.ie/mailman/listinfo/ilug for (un)subscription information.
List maintainer: listmaster at linux.ie

---
Incoming mail is certified Virus Free.
Checked by AVG anti-virus system (http://www.grisoft.com).
Version: 6.0.309 / Virus Database: 170 - Release Date: 17/12/2001

---
Outgoing mail is certified Virus Free.
Checked by AVG anti-virus system (http://www.grisoft.com).
Version: 6.0.309 / Virus Database: 170 - Release Date: 17/12/2001