Java.io.StreamTokenizer.eolIsSignificant() Method

Advertisements


Description

The java.io.StreamTokenizer.eolIsSignificant(boolean flag) method determines whether or not ends of line are treated as tokens. If the flag argument is true, this tokenizer treats end of lines as tokens; the nextToken method returns TT_EOL and also sets the ttype field to this value when an end of line is read. A line is a sequence of characters ending with either a carriage-return character ('\r') or a newline character ('\n'). In addition, a carriage-return character followed immediately by a newline character is treated as a single end-of-line token. If the flag is false, end-of-line characters are treated as white space and serve only to separate tokens.

Declaration

Following is the declaration for java.io.StreamTokenizer.eolIsSignificant() method

public void eolIsSignificant(boolean flag)

Parameters

  • flag -- true indicates that end-of-line characters are separate tokens; false indicates that end-of-line characters are white space.

Return Value

This method does not return a value.

Exception

  • NA

Example

The following example shows the usage of java.io.StreamTokenizer.eolIsSignificant() method.

package com.tutorialspoint;

import java.io.*;

public class StreamTokenizerDemo {
   
   public static void main(String[] args) {
      
      String text = "Hello. This is a text \n that will be split "
              + "into tokens. 1+1=2";
      try {
         // create a new file with an ObjectOutputStream
         FileOutputStream out = new FileOutputStream("test.txt");
         ObjectOutputStream oout = new ObjectOutputStream(out);

         // write something in the file
         oout.writeUTF(text);
         oout.flush();

         // create an ObjectInputStream for the file we created before
         ObjectInputStream ois =
                 new ObjectInputStream(new FileInputStream("test.txt"));

         // create a new tokenizer
         Reader r = new BufferedReader(new InputStreamReader(ois));
         StreamTokenizer st = new StreamTokenizer(r);

         // set that end of line is significant
         st.eolIsSignificant(true);

         // print the stream tokens
         boolean eof = false;
         do {
            int token = st.nextToken();
            switch (token) {
               case StreamTokenizer.TT_EOF:
                  System.out.println("End of File encountered.");
                  eof = true;
                  break;
               case StreamTokenizer.TT_EOL:
                  System.out.println("End of Line encountered.");
                  break;
               case StreamTokenizer.TT_WORD:
                  System.out.println("Word: " + st.sval);
                  break;
               case StreamTokenizer.TT_NUMBER:
                  System.out.println("Number: " + st.nval);
                  break;
               default:
                  System.out.println((char) token + " encountered.");
                  if (token == '!') {
                     eof = true;
                  }
            }
         } while (!eof);
         
         
      } catch (Exception ex) {
         ex.printStackTrace();
      }
   }
}

Let us compile and run the above program, this will produce the following result:

Word: Hello.
Word: This
Word: is
Word: a
Word: text
End of Line encountered.
Word: that
Word: will
Word: be
Word: split
Word: into
Word: tokens.
Number: 1.0
+ encountered.
Number: 1.0
= encountered.
Number: 2.0
End of File encountered.



Advertisements
Advertisements