Tokenization using the Scanner class

Tokenization using the Scanner class - while...

Info iconThis preview shows pages 1–2. Sign up to view the full content.

View Full Document Right Arrow Icon
Tokenization using the Scanner class We can extract substrings of a string using the Scanner class as well. useDelimiter method can specify the string pattern (including one character -- delimiter). See the following example: import java.util.Scanner; public class Scanner1 { public static void main(String[] args) { //First Example to tokenize the string "www/asu/edu" String line = "www/asu/edu"; Scanner scan = new Scanner(line).useDelimiter("/"); while (scan.hasNext()) { String word = scan.next(); System.out.println(word + " with length " + word.length()); } System.out.println(); //Second Example with "www/asu/" line = "www/asu/"; scan = new Scanner(line).useDelimiter("/"); while (scan.hasNext()) { String word = scan.next(); System.out.println(word + " with length " + word.length()); } System.out.println(); //Third example with "www//edu" line = "www//edu"; scan = new Scanner(line).useDelimiter("/");
Background image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Background image of page 2
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: while (scan.hasNext()) { String word = scan.next(); System.out.println(word + " with length " + word.length()); } System.out.println(); //Forth example with "/asu/edu" line = "/asu/edu"; scan = new Scanner(line).useDelimiter("/"); while (scan.hasNext()) { String word = scan.next(); System.out.println(word + " with length " + word.length()); } } } The output of the program is as follows: www with length 3 asu with length 3 edu with length 3 www with length 3 asu with length 3 www with length 3 with length 0 edu with length 3 asu with length 3 edu with length 3 Therefore, if there is no string after the last delimiter, it will ignore it. But if there is no string between two delimiters, it returns a string of length 0. If the first string before the first delimiter is missing, it will skip it too....
View Full Document

This note was uploaded on 09/25/2010 for the course CSE 71682 taught by Professor Nakamura during the Spring '10 term at ASU.

Page1 / 2

Tokenization using the Scanner class - while...

This preview shows document pages 1 - 2. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online