tokenize EXSLT str tokenize 1 Jeni Tennison mail@jenitennison.com http://www.jenitennison.com/ 2001-06-03 The str:tokenize function splits a string at the occurrences of given characters. 1.1 Jeni Tennison mail@jenitennison.com http://www.jenitennison.com/ 2001-06-21 Added Javascript and MSXML implementations. 1.2 Jeni Tennison mail@jenitennison.com http://www.jenitennison.com/ 2001-11-18 Indicated behaviour when second argument is an empty string; str:tokenize() should return a list of tokens, each containing a single character. 1.3 Craig Stewart 2002-08-21 Added 4XSLT and libxslt implementation to the list. 1.4 Craig Stewart 2002-11-12 Updated 4XSLT version to 0.12.0a3. The str:tokenize function splits up a string and returns a node set of token elements, each containing one token from the string. The first argument is the string to be tokenized. The second argument is a string consisting of a number of characters. Each character in this string is taken as a delimiting character. The string given by the first argument is split at any occurrence of any of these characters. For example: str:tokenize('2001-06-03T11:40:23', '-T:') Gives the node set consisting of: <token>2001</token> <token>06</token> <token>03</token> <token>11</token> <token>40</token> <token>23</token> If the second argument is omitted, the default is the string '&#x9;&#xA;&#xD;&#x20;' (i.e. whitespace characters). Thus: str:tokenize('date math str') Gives the node set consisting of: <token>date</token> <token>math</token> <token>str</token> If the second argument is an empty string, the function returns a set of token elements, each of which holds a single character. Thus: str:tokenize('foo', '') Gives the node set consisting of: <token>f</token> <token>o</token> <token>o</token> The template version of this function returns a result tree fragment consisting of a number of token elements. This implementation relies on the exsl:node-set() function. EXSLT str tokenize Javascript 1 Chris Bayes chris@bayes.co.uk http://www.bayes.co.uk 2001-06-21 2 Chris Bayes chris@bayes.co.uk http://www.bayes.co.uk 2001-06-26 Now creates token elements rather than text nodes. EXSLT str tokenize MSXML 1 Chris Bayes chris@bayes.co.uk http://www.bayes.co.uk 2001-06-21 2 Chris Bayes chris@bayes.co.uk http://www.bayes.co.uk 2001-06-26 Now creates token elements rather than text nodes. EXSLT str tokenize example Chris Bayes chris@bayes.co.uk http://www.bayes.co.uk 2001-06-26