org.jruby.lexer.yacc

Class InputStreamLexerSource

java.lang.Object

org.jruby.lexer.yacc.LexerSource

org.jruby.lexer.yacc.InputStreamLexerSource

public class InputStreamLexerSource
extends LexerSource

Field Summary

Fields

Modifier and Type	Field and Description
private char[]	buf
private int	bufLength
static int	DATA_READ_BUFFER_SIZE
(package private) static org.jruby.util.ByteList	EOF_LABEL
private java.io.InputStream	in
private static int	INITIAL_PUSHBACK_SIZE
private int	oneAgo
private int	twoAgo

Fields inherited from class org.jruby.lexer.yacc.LexerSource

line, lineOffset, offset

Constructor Summary

Constructors

Constructor and Description
InputStreamLexerSource(java.lang.String sourceName, java.io.InputStream in, java.util.List<java.lang.String> list, int line, boolean extraPositionInformation) Create our food-source for the lexer

Method Summary

Modifier and Type	Method and Description
private void	advance(int c)
private int	carriageReturn(int c)
private boolean	finishMarker(boolean checkNewline, org.jruby.util.ByteList buffer)
java.io.InputStream	getRemainingAsStream()
private void	growBuf()
private void	indentLoop(org.jruby.util.ByteList buffer)
boolean	lastWasBeginOfLine()
private boolean	matches(org.jruby.util.ByteList match, org.jruby.util.ByteList buffer, int length)
boolean	matchMarker(org.jruby.util.ByteList match, boolean indent, boolean checkNewline) Match marker against input consumering lexer source as it goes...Unless it does not match then it reverts lexer source back to point when this method was invoked.
boolean	peek(int to) Is the next character equal to 'to'
int	read() Read next character from this source
org.jruby.util.ByteList	readLineBytes()
org.jruby.util.ByteList	readUntil(char marker)
private void	retreat()
int	skipUntil(int marker)
java.lang.String	toString()
void	unread(int c) Pushes char back onto this source.
void	unreadMany(java.lang.CharSequence buffer)
boolean	wasBeginOfLine() Was the last character read from the stream the first character on a line
private int	wrappedRead() Convenience method to hide exception.

Methods inherited from class org.jruby.lexer.yacc.LexerSource

captureFeature, getCurrentLine, getFilename, getLine, getOffset, getPosition, getPosition, getSource, getSource, getVirtualLine, makePointer, readCodepoint, uncaptureFeature

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

INITIAL_PUSHBACK_SIZE

private static final int INITIAL_PUSHBACK_SIZE

See Also:

Constant Field Values

DATA_READ_BUFFER_SIZE

public static final int DATA_READ_BUFFER_SIZE

See Also:

Constant Field Values

in

private final java.io.InputStream in

buf

private char[] buf

bufLength

private int bufLength

oneAgo

private int oneAgo

twoAgo

private int twoAgo

EOF_LABEL

static final org.jruby.util.ByteList EOF_LABEL

Constructor Detail

InputStreamLexerSource

public InputStreamLexerSource(java.lang.String sourceName,
                              java.io.InputStream in,
                              java.util.List<java.lang.String> list,
                              int line,
                              boolean extraPositionInformation)

Create our food-source for the lexer

Parameters:

sourceName - is the file we are reading

reader - is what represents the contents of file sourceName

line - starting line number for source (used by eval)

extraPositionInformation - will gives us extra information that an IDE may want

Method Detail

read

public int read()
         throws java.io.IOException

Read next character from this source

Specified by:

read in class LexerSource

Returns:

next character to viewed by the source

Throws:

java.io.IOException

unread

public void unread(int c)

Pushes char back onto this source. Note, this also allows us to push whatever is passes back into the source.

Specified by:

unread in class LexerSource

Parameters:

to - be put back onto the source

peek

public boolean peek(int to)
             throws java.io.IOException

Is the next character equal to 'to'

Specified by:

peek in class LexerSource

Parameters:

to - character to compare against

Returns:

true if the same

Throws:

java.io.IOException

advance

private void advance(int c)

carriageReturn

private int carriageReturn(int c)
                    throws java.io.IOException

Throws:

java.io.IOException

growBuf

private void growBuf()

retreat

private void retreat()

wrappedRead

private int wrappedRead()
                 throws java.io.IOException

Convenience method to hide exception. If we do hit an exception we will pretend we EOF'd.

Returns:

the current char or EOF (at EOF or on error)

Throws:

java.io.IOException

readLineBytes

public org.jruby.util.ByteList readLineBytes()
                                      throws java.io.IOException

Specified by:

readLineBytes in class LexerSource

Throws:

java.io.IOException

skipUntil

public int skipUntil(int marker)
              throws java.io.IOException

Specified by:

skipUntil in class LexerSource

Throws:

java.io.IOException

unreadMany

public void unreadMany(java.lang.CharSequence buffer)

Specified by:

unreadMany in class LexerSource

matchMarker

public boolean matchMarker(org.jruby.util.ByteList match,
                           boolean indent,
                           boolean checkNewline)
                    throws java.io.IOException

Description copied from class: LexerSource

Match marker against input consumering lexer source as it goes...Unless it does not match then it reverts lexer source back to point when this method was invoked.

Specified by:

matchMarker in class LexerSource

Parameters:

match - to match against

indent - eat any leading whitespace

checkNewline - includes a check that marker is followed by newline or EOF

Returns:

true if marker matches...false otherwise

Throws:

java.io.IOException - if an error occurred reading from underlying IO source

indentLoop

private void indentLoop(org.jruby.util.ByteList buffer)
                 throws java.io.IOException

Throws:

java.io.IOException

matches

private boolean matches(org.jruby.util.ByteList match,
                        org.jruby.util.ByteList buffer,
                        int length)
                 throws java.io.IOException

Throws:

java.io.IOException

finishMarker

private boolean finishMarker(boolean checkNewline,
                             org.jruby.util.ByteList buffer)
                      throws java.io.IOException

Throws:

java.io.IOException

wasBeginOfLine

public boolean wasBeginOfLine()

Was the last character read from the stream the first character on a line

Specified by:

wasBeginOfLine in class LexerSource

Returns:

true if so

lastWasBeginOfLine

public boolean lastWasBeginOfLine()

Specified by:

lastWasBeginOfLine in class LexerSource

toString

public java.lang.String toString()

Overrides:

toString in class java.lang.Object

readUntil

public org.jruby.util.ByteList readUntil(char marker)
                                  throws java.io.IOException

Specified by:

readUntil in class LexerSource

Throws:

java.io.IOException

getRemainingAsStream

public java.io.InputStream getRemainingAsStream()
                                         throws java.io.IOException

Specified by:

getRemainingAsStream in class LexerSource

Throws:

java.io.IOException