implementing jenkins pipeline in a microservice architecture

NOTE:

• to deploy a jenkins cluster with master and worker nodes on AWS and Google Cloud refer to deploy jenkins cluster with Terraform repo which I've made available. this repo would help you bake your own jenkins master and worker nodes using Packer and easily deploy on AWS or GCP.

microservice components:

• Loader(Python) --> responsible for reading a JSON file containing a list of movies and pushing each movie item to Amazon SQS
• Parser(Golang) --> responsible for consuming movies by subscribing to SQS and scraping movies information from the IMDb website and storing the metadata into MongoDB
• Store(Node.js) --> responsible for servig a RESTful API with endpoints to fetch a list of movies and insert new movies into the watch list database in the MongoDB
• Marketplace(Angular & TypeScript) --> responsible for serving a frontend to browse movies by calling the store RESTful API

key approaches:

• using an aws api gateway to invoke a lambda function (written in js) and trigger github webhook
• statis code analysis for Angular and the marketplace with SonarQube and perform webhook to jenkins for completion or failure
• CVE (Common Vulnerability and Exposure) scanning of source code using Nancy
• baking Nexux Repository OSS machine image with Packer to host our private docker registery.
• using Anchore Engine for continuous visibility into supply chain security risks