Serverless NestJS Automation on AWS Lambda

Configure Automation for Serverless Deployment Serverless deployments are a powerful way to manage and scale your applications without worrying about server provisioning and maintenance. In this article, I will guide you through the process of setting up and automating a serverless deployment on using the Serverless Framework. An article will cover everything from defining your serverless configuration to setting up an API Gateway and handling CORS, as well as optimizing an AWS Lambda function by Webpack build. AWS Lambda Provide a serverless.yml Configuration File The first step in automating a serverless deployment is to create configuration file. This file defines various aspects of a serverless service, such as the service name, provider details, plugins, and more. Below is an example of a file: serverless.yml serverless.yml service: api-service-name provider: name: aws region: eu-central-1 stage: prod runtime: nodejs18.x memorySize: 1024 ecr: images: api-image-name: path: ./ environment: NODE_ENV: production plugins: - serverless-offline custom: serverless-offline: useChildProcesses: true configValidationMode: error package: excludeDevDependencies: true individually: true exclude: - __tests__/** - .gitignore - package-lock.json - .git/** # ... (other exclusions) functions: main: image: name: api-image-name command: - dist/handler.handler entryPoint: - /lambda-entrypoint.sh timeout: 25 memorySize: 512 events: - http: method: ANY path: /{any+} cors: true This configuration file defines various settings for a service, such as the AWS region, runtime, memory size, and more. Initialise a Docker File for ECR Repository To deploy a serverless function, a Docker image should be created for it. Let's use the following as a starting point: Dockerfile FROM --platform=linux/x86_64 public.ecr.aws/lambda/nodejs:18 COPY . . RUN npm install RUN npm run build CMD ["dist/handler.handler"] This is tailored for AWS Lambda and ensures that your function is correctly packaged. includes the several scripts that will be considered below. Dockerfile package.json { "name": "application-name", "version": "0.0.1", "description": "API description", "author": "John Doe, john@email.com", "private": true, "license": "UNLICENSED", "scripts": { "build": "NODE_ENV=production nest build --webpack", }, } Add Permissions for Lambda Function Role To ensure that a Lambda function has the necessary permissions, an IAM role with the required permissions should be defined. Here's an example of an IAM policy that allows Lambda to interact with networking resources: { "Effect": "Allow", "Action": [ "ec2:CreateNetworkInterface", "ec2:DescribeNetworkInterfaces", "ec2:DeleteNetworkInterface" ], "Resource": "*" } This policy grants permissions for network interface operations, which may be necessary for a Lambda function. 4. Automate Schema Processes with Resources in serverless.yml To automate schema deployment and definition, use the section in a : resources serverless.yml resources: Resources: RequestModel: Type: 'AWS::ApiGateway::Model' Properties: Name: RequestModel RestApiId: Ref: ApiGatewayRestApi ContentType: application/json Description: 'Request Model' Schema: ${file(models/RequestSchema.json)} ResponseModel: Type: 'AWS::ApiGateway::Model' Properties: Name: ResponseModel RestApiId: Ref: ApiGatewayRestApi ContentType: application/json Description: 'Response Model' Schema: ${file(models/ResponseSchema.json)} This code automatically creates models for your API Gateway based on JSON schemas. Request Schema The Request Schema defines the structure and constraints that a client's request must adhere to when interacting with your API. It helps in validating and ensuring that the incoming data is in the expected format. Below is the Request Schema described in JSON format: { "type": "object", "required": ["request"], "properties": { "request": { "type": "string" } }, "title": "Request Schema" } Key Components of the Request Schema: : This specifies that the top-level data structure is an object. type : It lists the properties that must be included in the request. In this case, the "request" property is required. required : This section defines the structure of the request. It contains the "request" property, which is of type "string." properties : The "title" field provides a human-readable name for the schema, which can be helpful for documentation and error reporting. title Response Schema The Response Schema defines the structure and constraints that the API will adhere to when sending responses to clients. It ensures that the API's responses are consistent and in the expected format. Here is the Response Schema in JSON format: { "type": "object", "required": ["response"], "properties": { "response": { "type": "string" } }, "title": "Response Schema" } Key Components of the Response Schema: : Similar to the Request Schema, it specifies that the top-level data structure is an object. type : It lists the properties that must be included in the response. In this case, the "response" property is required. required : This section defines the structure of the response. It contains the "response" property, which is also of type "string." properties : As in the Request Schema, the "title" field provides a human-readable name for the schema, aiding in documentation and clarity. title Schema Usage These schemas can be associated with specific API Gateway endpoints to validate incoming requests and outgoing responses. When a request is made to an endpoint, the API Gateway will use the Request Schema to validate the request payload. If the request doesn't conform to the schema, the API Gateway can reject it, ensuring data integrity. Similarly, when the sends a response, it uses the Response Schema to structure the response payload. This consistency in response format simplifies client-side code, as clients can expect a standardized response structure. API Gateway The Request and Response Schemas are essential tools in API development. They ensure that data is exchanged in a consistent and secure manner, making it easier to manage and maintain your serverless API. Set the serverless.yml Function Options Ensure that configuration specifies the necessary function options, including the image, timeout, memory size, and CORS settings: serverless.yml provider: ecr: images: api-image-name: path: ./ functions: main: image: name: api-image-name command: - dist/handler.handler entryPoint: - /lambda-entrypoint.sh timeout: 25 memorySize: 512 events: - http: method: ANY path: /{any+} cors: true These settings are crucial for the proper functioning of your Lambda function and API Gateway integration as an initial Lambda’s timeout is critical to run, and memory is valuable on application objectives. Deploy the Serverless Application To deploy a serverless application, use the following command: sls deploy This command will package and deploy a service, making it accessible on AWS Lambda. Open Lambda Function and Configure API Gateway After deployment, a Lambda function will be accessible through an API Gateway. Ensure that API Gateway has been modified for an API Gateway to handle the base path and methods an application requires for a Lambda interaction. Additionally, define request and response schemas based on the JSON models you've deployed with a configuration. serverless.yml Set CORS Headers and Activate Credentials Checkbox Configure the API Gateway to allow Cross-Origin Resource Sharing (CORS) by setting appropriate headers. Common CORS headers to include are Accept, Content-Type, and others, depending on an application's requirements. Don't forget to activate the credentials checkbox if needed. An example of the required CORS headers: Accept,Content-Type,X-Amz-Date,X-Amz-Security-Token,Authorization,X-Api-Key,X-Requested-With,Accept,Access-Control-Allow-Credentials,Access-Control-Expose-Headers,Access-Control-Max-Age,Access-Control-Allow-Methods,Access-Control-Allow-Origin,Access-Control-Allow-Headers,Referer,User-Agent Integrating NestJS into a Serverless Deployment In this continuation of an article on configuring automation for serverless deployment, let’s delve into integrating a into the deployment pipeline. NestJS is a powerful framework for building scalable and maintainable serverless applications. Let’s provide detailed explanations of the key code parts, including the NestJS index file ( ) and the application module ( ). NestJS application main.ts app.module.ts NestJS Index File (main.ts) Thus, to begin understanding the workings of the NestJS application, one should first delve into the file This file is the entry point for a NestJS application and includes important configurations for serverless deployment. main.ts import { NestFactory } from '@nestjs/core'; import serverlessExpress from '@vendia/serverless-express'; import { Callback, Context, Handler } from 'aws-lambda'; import { ValidationPipe, VersioningType } from '@nestjs/common'; import { AppModule } from './app.module'; import { config as appConfig } from './config'; let server: Handler; async function bootstrap(): Promise { const app = await NestFactory.create(AppModule); // Apply global validation pipe app.useGlobalPipes(new ValidationPipe()); // Set global prefix and enable API versioning app.setGlobalPrefix(appConfig.app.baseUrl.prefix); app.enableVersioning({ type: VersioningType.URI, defaultVersion: appConfig.app.version.defaultVersion, prefix: appConfig.app.version.prefix, }); await app.init(); const expressApp = app.getHttpAdapter().getInstance(); return serverlessExpress({ app: expressApp }); } export const handler: Handler = async ( event: any, context: Context, callback: Callback, ) => { // Ensure Lambda doesn't wait for the event loop to be empty context.callbackWaitsForEmptyEventLoop = false; // Initialize the server on first execution server = server ?? (await bootstrap()); // Execute the serverless function return server(event, context, callback); }; The function is responsible for initializing the NestJS application and configuring it for serverless deployment. It sets up global middleware such as the validation pipe, API versioning, and prefixes. The function is the entry point application Lambda function. It ensures that Lambda doesn't wait for the event loop to be empty and initializes the server using the function on the first execution. bootstrap handler bootstrap Application Module (app.module.ts) The file is the core of the NestJS application, where the modules, controllers, services, and other components of your application are defined. Below is an overview of your application module: app.module.ts import { join } from 'path'; import { MiddlewareConsumer, Module, NestModule } from '@nestjs/common'; import { GraphQLModule } from '@nestjs/graphql'; import { ApolloDriver, ApolloDriverConfig } from '@nestjs/apollo'; import { APP_GUARD } from '@nestjs/core'; import { ConfigModule, ConfigService } from '@nestjs/config'; import { S3 } from 'aws-sdk'; import { makeExecutableSchema } from '@graphql-tools/schema'; import { DynamicModule } from '@nestjs/common/interfaces'; import { GraphQLSchema } from 'graphql/index'; const graphqlModule = { dev: GraphQLModule.forRoot ({ driver: ApolloDriver, autoSchemaFile: join(__dirname, 'src/schema.gql'), buildSchemaOptions: { dateScalarMode: 'timestamp', }, context: ({ request, reply }) => ({ request, reply }), playground: true, introspection: true, }), prod: (): DynamicModule => { const s3 = new S3({ credentials: { accessKeyId: process.env['AWS_LLM_ACCESS_KEY_ID'], secretAccessKey: process.env['AWS_LLM_SECRET_ACCESS_KEY'], }, }); const BUCKET_NAME = 'api-bucket'; const SCHEMA_FILE_KEY = 'graphql/schema.gql'; // Adjust the key as needed // Fetch the schema from S3 when the Lambda function starts const schema: Promise = s3 .getObject({ Bucket: BUCKET_NAME, Key: SCHEMA_FILE_KEY }) .promise() .then((data) => data.Body.toString('utf-8')) .then((schemaString) => makeExecutableSchema({ typeDefs: schemaString })); return GraphQLModule.forRootAsync({ driver: ApolloDriver, useFactory: async (configService: ConfigService) => { const schemaFactory = await schema; return { schema: schemaFactory, uploads: false, // Set to true if you need to handle file uploads cache: 'bounded', }; }, }); }, }; @Module({ imports: [ AuthModule, CustomerModule, // ... other modules ConfigModule.forRoot({ envFilePath: process.env.NODE_ENV === 'development' ? ['.env.development.local'] : void 0, isGlobal: true, }), process.env.NODE_ENV === 'production' ? graphqlModule.prod() : graphqlModule.dev, ], controllers: [AppController], providers: [ { provide: APP_GUARD, useClass: RoleAuthGuard, }, AuthService, CustomerService, AppService, PrismaService, LocalStrategy, JwtStrategy, RefreshStrategy, ], exports: [AuthService], }) export class AppModule implements NestModule { configure(consumer: MiddlewareConsumer) { consumer.apply(ResponseHeadersMiddleware).forRoutes('*'); } } Application module details: In the array, you import and configure various modules, including , , and others. These modules contain controllers, services, and other components that make up your application. imports AuthModule CustomerModule The array includes providers such as , , and strategies like , , and . These providers handle authentication and business logic. providers AuthService CustomerService LocalStrategy JwtStrategy RefreshStrategy The method is part of the interface and is used to apply middleware. In this example, is applied to all routes. configure NestModule ResponseHeadersMiddleware code fetches the production schema from S3, converts it to a string, and then uses to create a GraphQL schema. graphqlModule makeExecutableSchema Finally, it returns the configuration for GraphQLModule with the dynamically fetched schema for production. Optimizing NestJS Builds with Webpack In this article, I will explore in detail the Webpack configuration used to optimize the build process of a NestJS application for production. The provided Webpack configuration is intended for use with the CLI command. It leverages Webpack's capabilities to bundle, minify, and prepare your NestJS application for efficient deployment. NODE_ENV=production nest build --webpack Let's break down the Webpack configuration step by step, explaining the purpose of each section: const path = require('path'); const TerserPlugin = require('terser-webpack-plugin'); const nodeExternals = require('webpack-node-externals'); const CopyWebpackPlugin = require('copy-webpack-plugin'); module.exports = (options, webpack) => { return { ...options, entry: ['./src/main.ts'], target: 'node', mode: 'production', externals: [...options.externals, nodeExternals()], output: { libraryTarget: 'commonjs', filename: 'handler.js', path: path.join(__dirname, 'dist'), }, module: { ...options.module, }, plugins: [ ...options.plugins, ], resolve: { extensions: ['.ts', '.js', '.gql'], alias: { src: path.resolve(__dirname, 'src'), }, }, optimization: { minimizer: [ new TerserPlugin({ terserOptions: { keep_classnames: true, }, }), ], }, }; }; Imports: The configuration begins by importing the necessary Node.js modules and Webpack plugins: : The module is used to work with file and directory paths. path path : This plugin is responsible for minifying JavaScript code. TerserPlugin : It helps exclude Node.js core modules and dependencies from the bundle. nodeExternals node_modules Module Export: The Webpack configuration is wrapped in a function that takes two parameters, and . However, in this specific configuration, only is used. The function returns an object representing the Webpack configuration. options webpack options Entry Point: : This specifies the entry point of your application, which is typically the main TypeScript file ( ) in the directory. entry: ['./src/main.ts'] main.ts src Target: : Indicates that the target environment is Node.js. This ensures that Webpack understands that it is bundling code for a Node.js runtime. target: 'node' Mode: : Sets the Webpack mode to production, enabling optimizations such as minification and tree shaking. mode: 'production' Externals: : Tells Webpack to exclude external dependencies from the bundle. ensures that Node.js core modules and dependencies are not bundled. externals: [...options.externals, nodeExternals()] nodeExternals() node_modules Output: : Specifies the type of module system used in Node.js. libraryTarget: 'commonjs' : Sets the name of the output file to . filename: 'handler.js' handler.js : Defines the output directory where the bundled code will be placed. path: path.join(__dirname, 'dist') Module: : Spreads the module configuration from . This allows you to inherit module configurations from the NestJS application. ...options.module options Resolve: : Specifies the file extensions that Webpack should resolve when importing modules. extensions: ['.ts', '.js', '.gql'] : Defines an alias for the directory, simplifying the import of modules with relative paths. alias src Optimisation: The array contains an instance of the . This plugin is responsible for minifying JavaScript code and the option preserves class names during the minification process. minimizer TerserPlugin keep_classnames: true With this detailed explanation of the provided Webpack configuration, you can now understand how it optimizes the NestJS build for production. This configuration ensures that a NestJS application is bundled efficiently and ready for deployment as a serverless function, making it well-suited for production use. Conclusion In this comprehensive guide, the serverless deployment process for a NestJS application has been explored. It has covered various aspects, from configuring automation for serverless deployment to integrating a NestJS application into the deployment pipeline. Additionally, an article has delved into the details of a Webpack configuration optimized for NestJS builds. Let's summarise the key points: Serverless Deployment Configuration: I’ve begun by setting up a serverless deployment using the configuration file. This configuration provides details about the service, runtime, memory allocation, and more. It also includes plugins for local development, package settings, and resources like API Gateway models. serverless.yml Docker Image for ECR Repo: To streamline the deployment process, I’ve created a Docker image for the Elastic Container Registry (ECR) repository. This image is based on the platform and includes necessary dependencies, building, and initialization steps. public.ecr.aws/lambda/nodejs:18 Lambda Function Permissions: I’ve added permissions for the Lambda function role to interact with , like creating and managing network interfaces. These permissions are crucial for the function to operate correctly. AWS resources Schema Management: I’ve highlighted the importance of automating schema processes using resources defined in the file. This includes request and response model definitions, which are essential for the API Gateway to validate incoming requests and responses. serverless.yml Serverless Function Options: The configuration also defines function options, including image settings, command, entry point, timeout, memory size, and event triggers. These settings dictate how the Lambda function operates and responds to incoming requests. serverless.yml NestJS Integration: I’ve continued by detailing the integration of a NestJS application into the serverless deployment process. This included the entry file, which sets up the NestJS application and handles Lambda function execution. main.ts Application Module: The file defines the core structure of the Nest.js application, including module imports, providers, and middleware configuration. I also covered the setup of GraphQL modules for development and production environments. app.module.ts Webpack Configuration: I’ve concluded the article by providing a Webpack configuration optimized for production builds of NestJS applications. This configuration bundles and minifies the code and prepares it for deployment. This schematic encapsulates a robust, scalable, and efficient serverless architecture ideal for modern applications. It leverages AWS Lambda for computing, orchestrated by Amazon API Gateway for client interactions, and is bolstered by the resilience of Amazon RDS for relational data persistence. The inclusion of Amazon S3 provides scalable object storage, while Amazon ECR hosts container images for deployment. Amazon VPC ensures secure network isolation, and IAM roles enforce granular access control. NestJS underpins this architecture as the core framework, streamlining development and upkeep, while Prisma amplifies data management capabilities at the Lambda function tier. The schematic focuses on the overarching structure and may not depict the intricacies of NestJS and Prisma dependencies. Together, this architecture promises to deliver high performance, manageability, and cost-effectiveness while providing a streamlined development experience. In summary, serverless deployment of a involves careful configuration, resource management, and integration of various components. By following the steps and configurations described in this guide, you can build and deploy scalable, efficient, and maintainable serverless applications on AWS Lambda. NestJS application