In , we learned the basics of compiler theory, and the role of ANTLR in computerized language recognition. Now, we will move onto using ANTLR to build an AST in code. Part 1 If you do not have ANTLR installed already, follow the instructions on the official . Getting Started Page If you don’t know how to write or read ANTLR 4 grammars, then you can learn via the very detailed ANTLR 4 documentation. This, believe it or not, is not a tutorial on ANTLR syntax itself. Regardless, you will be able to get through reading this guide without really knowing ANTLR at all. Now that we have ANTLR available on our system, we can design our language and write our grammar. We will follow the example from Part 1 and write a grammar that runs code of this type: set sky to "blue"set roses to 3 say "The sky is colored ${sky}."say "I have ${roses} roses." Our grammar file might look like this: grammar Foo; compilationUnit: stmt*;stmt:assignStmt| invocationStmt;assignStmt: SET ID TO expr;invocationStmt: name=ID ((expr COMMA)* expr)?; expr: ID | INT | STRING; COMMA: ',';SAY: 'say';SET: 'set';TO: 'to'; INT: [0-9]+;STRING: '"' (~('\n' | '"'))* '"';ID: [a-zA-Z_] [a-zA-Z0-9_]*; And then we can simply invoke ANTLR from the command line to generate the lexer and parser. At its most basic, we just have to supply the name of the input grammar, and to indicate to ANTLR that we want Javascript output. “-Dlanguage=JavaScript” antlr4 -Dlanguage=JavaScript Foo.g4 This will leave you with about 5 files, including , and . FooLexer.js FooParser.js FooListener.js Using this in code is remarkably easy. The following function takes input text and returns the generated . AST var antlr4 = require('antlr4');var FooLexer = require('./FooLexer').FooLexer;var FooParser = require('./FooParser').FooParser; (inputText) { chars = antlr4.InputStream(inputText); lexer = FooLexer(chars); tokens = antlr4.CommonTokenStream(lexer); parser = FooParser(tokens);parser.buildParseTrees = ; function buildAst var new var new var new var new true **return** parser.compilationUnit(); } module.exports = buildAst; With ANTLR, it takes a matter of milliseconds to create both a lexer a parser. Imagine writing these by hand! and In , we will wrap everything up by spitting out from our compiler. Stay tuned! Part 3 Javascript is how hackers start their afternoons. We’re a part of the family. We are now and happy to opportunities. Hacker Noon @AMI accepting submissions discuss advertising &sponsorship To learn more, , , or simply, read our about page like/message us on Facebook tweet/DM @HackerNoon. If you enjoyed this story, we recommend reading our and . Until next time, don’t take the realities of the world for granted! latest tech stories trending tech stories

Facebook

Lexer

Too Long; Didn't Read

In your car, at home, or at work — Bosch technology shapes many areas of life.

Creating a Scripting Language with ANTLR — Part 2

Too Long; Didn't Read

Companies Mentioned

Tobe O

About Author

TOPICS

THIS ARTICLE WAS FEATURED IN...

Creating a Scripting Language with ANTLR — Part 2

Too Long; Didn't Read

Companies Mentioned

Tobe O

About Author

TOPICS

THIS ARTICLE WAS FEATURED IN...

RELATED STORIES