Language - Compiler compilers or (lexer|parser) generators

1 - About

Compiler-compilers splits the work into a lexer and a parser:

Compiler-compilers generates the lexer and parser from a language description file called a grammar

Parsers and lexical analysers are long and complex components. A software engineer writing an efficient lexical analyser or parser directly has to carefully consider the interactions between the rules.

3 - Application

4 - Build process

As Compiler-compilers need to generates the lexer and parser, it makes the build process a little bit more complicated:

  • First, the compiler-compiler must generate the lexer and parser from the grammar file
  • then, you can use them to compile the code

5 - Error handling

The lexical analyser and parser also are responsible for generating error messages, if the input does not conform to the lexical or syntactic rules of the language.

6 - Tools

Antlr, javacc, sablecc, lex are not a parser or a lexical anaylzer but a generator. This means that it outputs lexical analyzers and parser according to a specification that it reads in from a file (the grammar)

6.1 - REx Parser Generator

6.2 - Lex / Yacc


Installtion - cygwin includes lex and yacc

6.3 - ANTLR


6.4 - JavaCC

JavaCC is a tool used in many applications, which is much like antlr, with few features different here and there. However, it just generates Java code.

Used by: BeanShell

6.5 - Janino

6.6 - SableCC

SableCC is a compiler-compiler tool for the Java environment. It handles LALR(1) grammars (for those who remember their grammar categories). In other words it's a bottom up parser (unlike JavaCC and Antlr which are top-down).

SableCC is a bottom up parser, which takes an unconventional and interesting approach of using object oriented methodology for constructing parsers. This results in easy to maintain code for generated parser. However, there are some performance issues at this point of time. It generates output in both C++ and Java

6.7 - Unified

unified is an interface for processing text using syntax trees. It’s what powers remark, retext, and rehype, but it also allows for processing between multiple syntaxes.

unified enabled new exciting projects like Gatsby to pull in markdown, MDX to embed JSX, and Prettier to format it. It’s used to check code for Storybook, debugger.html (Mozilla), and (GitHub).

7 - Documentation / Reference

Data Science
Data Analysis
Data Science
Linear Algebra Mathematics

Powered by ComboStrap