package core:bufio
Source

⌘K
Ctrl+K
or
/

    Types

    Lookahead_Reader ¶
    Source

    Lookahead_Reader :: struct {
	r:   io.Stream,
	buf: []u8,
	n:   int,
}
     

    Lookahead_Reader provides io lookahead. This is useful for tokenizers/parsers. Lookahead_Reader is similar to bufio.Reader, but unlike bufio.Reader, Lookahead_Reader's buffer size will EXACTLY match the specified size, whereas bufio.Reader's buffer size may differ from the specified size. This makes sure that the buffer will not be accidentally read beyond the expected size.

    Related Procedures With Parameters

    Read_Writer ¶
    Source

    Read_Writer :: struct {
	r: ^Reader,
	w: ^Writer,
}
     

    Read_Writer stores pointers to a Reader and a Writer

    Related Procedures With Parameters

    Reader ¶
    Source

    Reader :: struct {
	buf:                         []u8,
	buf_allocator:               runtime.Allocator,
	rd:                          io.Stream,
	// reader
	r:                           int,
	w:                           int,
	// read and write positions for buf
	err:                         io.Error,
	last_byte:                   int,
	// last byte read, invalid is -1
	last_rune_size:              int,
	// size of last rune read, invalid is -1
	max_consecutive_empty_reads: int,
}
     

    Reader is a buffered wrapper for an io.Reader

    Related Procedures With Parameters

    Scanner ¶
    Source

    Scanner :: struct {
	r:                            io.Stream,
	split:                        Split_Proc,
	buf:                          [dynamic]u8,
	max_token_size:               int,
	start:                        int,
	end:                          int,
	token:                        []u8,
	_err:                         Scanner_Error,
	max_consecutive_empty_reads:  int,
	successive_empty_token_count: int,
	scan_called:                  bool,
	done:                         bool,
}
    Related Procedures With Parameters

    Scanner_Error ¶
    Source

    Scanner_Error :: union {
	io.Error, 
	Scanner_Extra_Error, 
}
    Related Procedures With Returns

    Scanner_Extra_Error ¶
    Source

    Scanner_Extra_Error :: enum i32 {
	None, 
	Negative_Advance, 
	Advanced_Too_Far, 
	Bad_Read_Count, 
	Too_Long, 
	Too_Short, 
}
     

    Extra errors returns by scanning procedures

    Split_Proc ¶
    Source

    Split_Proc :: proc(data: []u8, at_eof: bool) -> (advance: int, token: []u8, err: Scanner_Error, final_token: bool)
     

    Split_Proc is the signature of the split procedure used to tokenize the input.

    Writer ¶
    Source

    Writer :: struct {
	buf:                          []u8,
	buf_allocator:                runtime.Allocator,
	wr:                           io.Stream,
	n:                            int,
	err:                          io.Error,
	max_consecutive_empty_writes: int,
}
     

    Writer is a buffered wrapper for an io.Writer

    Related Procedures With Parameters

    Constants

    DEFAULT_BUF_SIZE ¶
    Source

    DEFAULT_BUF_SIZE :: 4096

    DEFAULT_MAX_SCAN_TOKEN_SIZE ¶
    Source

    DEFAULT_MAX_SCAN_TOKEN_SIZE :: 1 << 16

    Variables

    This section is empty.

    Procedures

    lookahead_reader_buffer ¶
    Source

    lookahead_reader_buffer :: proc(lr: ^Lookahead_Reader) -> []u8 {…}

    lookahead_reader_consume ¶
    Source

    lookahead_reader_consume :: proc(lr: ^Lookahead_Reader, n: int) -> io.Error {…}
     

    lookahead_reader_consume drops the first n populated bytes from the Lookahead_Reader.

    lookahead_reader_consume_all ¶
    Source

    lookahead_reader_consume_all :: proc(lr: ^Lookahead_Reader) -> io.Error {…}

    lookahead_reader_init ¶
    Source

    lookahead_reader_init :: proc(lr: ^Lookahead_Reader, r: io.Stream, buf: []u8) -> ^Lookahead_Reader {…}

    lookahead_reader_peek ¶
    Source

    lookahead_reader_peek :: proc(lr: ^Lookahead_Reader, n: int) -> ([]u8, io.Error) {…}
     

    lookahead_reader_peek returns a slice of the Lookahead_Reader which holds n bytes If the Lookahead_Reader cannot hold enough bytes, it will read from the underlying reader to populate the rest. NOTE: The returned buffer is not a copy of the underlying buffer

    lookahead_reader_peek_all ¶
    Source

    lookahead_reader_peek_all :: proc(lr: ^Lookahead_Reader) -> ([]u8, io.Error) {…}
     

    lookahead_reader_peek_all returns a slice of the Lookahead_Reader populating the full buffer If the Lookahead_Reader cannot hold enough bytes, it will read from the underlying reader to populate the rest. NOTE: The returned buffer is not a copy of the underlying buffer

    read_writer_init ¶
    Source

    read_writer_init :: proc(rw: ^Read_Writer, r: ^Reader, w: ^Writer) {…}

    read_writer_to_stream ¶
    Source

    read_writer_to_stream :: proc(rw: ^Read_Writer) -> (s: io.Stream) {…}

    reader_buffered ¶
    Source

    reader_buffered :: proc(b: ^Reader) -> int {…}
     

    reader_buffered returns the number of bytes that can be read from the current buffer

    reader_destroy ¶
    Source

    reader_destroy :: proc(b: ^Reader) {…}
     

    reader_destroy destroys the underlying buffer with its associated allocator IFF that allocator has been set

    reader_discard ¶
    Source

    reader_discard :: proc(b: ^Reader, n: int) -> (discarded: int, err: io.Error) {…}
     

    reader_discard skips the next n bytes, and returns the number of bytes that were discarded

    reader_init ¶
    Source

    reader_init :: proc(b: ^Reader, rd: io.Stream, size: int = DEFAULT_BUF_SIZE, allocator := context.allocator, loc := #caller_location) {…}

    reader_init_with_buf ¶
    Source

    reader_init_with_buf :: proc(b: ^Reader, rd: io.Stream, buf: []u8) {…}

    reader_peek ¶
    Source

    reader_peek :: proc(b: ^Reader, n: int) -> (data: []u8, err: io.Error) {…}
     

    reader_peek returns the next n bytes without advancing the reader The bytes stop being valid on the next read call If reader_peek returns fewer than n bytes, it also return an error explaining why the read is short The error will be .Buffer_Full if n is larger than the internal buffer size

    reader_read ¶
    Source

    reader_read :: proc(b: ^Reader, p: []u8) -> (n: int, err: io.Error) {…}
     

    reader_read reads data into p The bytes are taken from at most one read on the underlying Reader, which means n may be less than len(p)

    reader_read_byte ¶
    Source

    reader_read_byte :: proc(b: ^Reader) -> (c: u8, err: io.Error) {…}
     

    reader_read_byte reads and returns a single byte If no byte is available, it return an error

    reader_read_bytes ¶
    Source

    reader_read_bytes :: proc(b: ^Reader, delim: u8, allocator := context.allocator) -> (buf: []u8, err: io.Error) {…}
     

    reader_read_bytes reads until the first occurrence of delim from the Reader It returns an allocated slice containing the data up to and including the delimiter

    reader_read_rune ¶
    Source

    reader_read_rune :: proc(b: ^Reader) -> (r: rune, size: int, err: io.Error) {…}
     

    reader_read_rune reads a single UTF-8 encoded unicode character and returns the rune and its size in bytes If the encoded rune is invalid, it consumes one byte and returns utf8.RUNE_ERROR (U+FFFD) with a size of 1

    reader_read_slice ¶
    Source

    reader_read_slice :: proc(b: ^Reader, delim: u8) -> (line: []u8, err: io.Error) {…}
     

    reader_read_slice reads until the first occurrence of delim from the reader It returns a slice pointing at the bytes in the buffer The bytes stop being valid at the next read If reader_read_slice encounters an error before finding a delimiter reader_read_slice fails with error .Buffer_Full if the buffer fills without a delim Because the data returned from reader_read_slice will be overwritten on the next IO operation, reader_read_bytes or reader_read_string is usually preferred

    reader_read_slice returns err != nil if and only if line does not end in delim

    reader_read_string ¶
    Source

    reader_read_string :: proc(b: ^Reader, delim: u8, allocator := context.allocator) -> (string, io.Error) {…}
     

    reader_read_string reads until the first occurrence of delim from the Reader It returns an allocated string containing the data up to and including the delimiter

    reader_reset ¶
    Source

    reader_reset :: proc(b: ^Reader, r: io.Stream) {…}

    reader_size ¶
    Source

    reader_size :: proc(b: ^Reader) -> int {…}

    reader_to_stream ¶
    Source

    reader_to_stream :: proc(b: ^Reader) -> (s: io.Stream) {…}
     

    reader_to_stream converts a Reader into an io.Stream

    reader_unread_byte ¶
    Source

    reader_unread_byte :: proc(b: ^Reader) -> io.Error {…}
     

    reader_unread_byte unreads the last byte. Only the most recently read byte can be unread

    reader_unread_rune ¶
    Source

    reader_unread_rune :: proc(b: ^Reader) -> io.Error {…}
     

    reader_unread_rune unreads the last rune. Only the most recently read rune can be unread

    reader_write_to ¶
    Source

    reader_write_to :: proc(b: ^Reader, w: io.Stream) -> (n: i64, err: io.Error) {…}

    scan_bytes ¶
    Source

    scan_bytes :: proc(data: []u8, at_eof: bool) -> (advance: int, token: []u8, err: Scanner_Error, final_token: bool) {…}

    scan_lines ¶
    Source

    scan_lines :: proc(data: []u8, at_eof: bool) -> (advance: int, token: []u8, err: Scanner_Error, final_token: bool) {…}

    scan_runes ¶
    Source

    scan_runes :: proc(data: []u8, at_eof: bool) -> (advance: int, token: []u8, err: Scanner_Error, final_token: bool) {…}

    scan_words ¶
    Source

    scan_words :: proc(data: []u8, at_eof: bool) -> (advance: int, token: []u8, err: Scanner_Error, final_token: bool) {…}

    scanner_bytes ¶
    Source

    scanner_bytes :: proc(s: ^Scanner) -> []u8 {…}
     

    Returns the most recent token created by scanner_scan. The underlying array may point to data that may be overwritten by another call to scanner_scan. Treat the returned value as if it is immutable.

    scanner_destroy ¶
    Source

    scanner_destroy :: proc(s: ^Scanner) {…}

    scanner_error ¶
    Source

    scanner_error :: proc(s: ^Scanner) -> Scanner_Error {…}
     

    Returns the first non-EOF error that was encountered by the scanner

    scanner_init ¶
    Source

    scanner_init :: proc(s: ^Scanner, r: io.Stream, buf_allocator := context.allocator) -> ^Scanner {…}

    scanner_init_with_buffer ¶
    Source

    scanner_init_with_buffer :: proc(s: ^Scanner, r: io.Stream, buf: []u8) -> ^Scanner {…}

    scanner_scan ¶
    Source

    scanner_scan :: proc(s: ^Scanner) -> bool {…}
     

    scanner_scan advances the scanner

    scanner_text ¶
    Source

    scanner_text :: proc(s: ^Scanner) -> string {…}
     

    Returns the most recent token created by scanner_scan. The underlying array may point to data that may be overwritten by another call to scanner_scan. Treat the returned value as if it is immutable.

    writer_available ¶
    Source

    writer_available :: proc(b: ^Writer) -> int {…}
     

    writer_available returns how many bytes are unused in the buffer

    writer_buffered ¶
    Source

    writer_buffered :: proc(b: ^Writer) -> int {…}
     

    writer_buffered returns the number of bytes that have been writted into the current buffer

    writer_destroy ¶
    Source

    writer_destroy :: proc(b: ^Writer) {…}
     

    writer_destroy destroys the underlying buffer with its associated allocator IFF that allocator has been set

    writer_flush ¶
    Source

    writer_flush :: proc(b: ^Writer) -> io.Error {…}
     

    writer_flush writes any buffered data into the underlying io.Writer

    writer_init ¶
    Source

    writer_init :: proc(b: ^Writer, wr: io.Stream, size: int = DEFAULT_BUF_SIZE, allocator := context.allocator) {…}

    writer_init_with_buf ¶
    Source

    writer_init_with_buf :: proc(b: ^Writer, wr: io.Stream, buf: []u8) {…}

    writer_read_from ¶
    Source

    writer_read_from :: proc(b: ^Writer, r: io.Stream) -> (n: i64, err: io.Error) {…}
     

    writer_read_from is to support io.Reader_From types If the underlying writer supports the io,read_from, and b has no buffered data yet, this procedure calls the underlying read_from implementation without buffering

    writer_reset ¶
    Source

    writer_reset :: proc(b: ^Writer, w: io.Stream) {…}

    writer_size ¶
    Source

    writer_size :: proc(b: ^Writer) -> int {…}
     

    writer_size returns the size of underlying buffer in bytes

    writer_to_stream ¶
    Source

    writer_to_stream :: proc(b: ^Writer) -> (s: io.Stream) {…}
     

    writer_to_stream converts a Writer into an io.Stream

    writer_to_writer ¶
    Source

    writer_to_writer :: proc(b: ^Writer) -> (s: io.Stream) {…}
     

    writer_to_stream converts a Writer into an io.Stream

    writer_write ¶
    Source

    writer_write :: proc(b: ^Writer, p: []u8) -> (n: int, err: io.Error) {…}
     

    writer_write writes the contents of p into the buffer It returns the number of bytes written If n < len(p), it will return an error explaining why the write is short

    writer_write_byte ¶
    Source

    writer_write_byte :: proc(b: ^Writer, c: u8) -> io.Error {…}
     

    writer_write_byte writes a single byte

    writer_write_rune ¶
    Source

    writer_write_rune :: proc(b: ^Writer, r: rune) -> (size: int, err: io.Error) {…}
     

    writer_write_rune writes a single unicode code point, and returns the number of bytes written with any error

    writer_write_string ¶
    Source

    writer_write_string :: proc(b: ^Writer, s: string) -> (int, io.Error) {…}
     

    writer_write_string writes a string into the buffer It returns the number of bytes written If n < len(p), it will return an error explaining why the write is short

    Procedure Groups

    This section is empty.

    Source Files

    Generation Information

    Generated with odin version dev-2024-12 (vendor "odin") Windows_amd64 @ 2024-12-17 21:11:00.876188700 +0000 UTC