www.javacodegeeks.com/2013/12…
Pipeline with SNS-SQS A workflow consist of independent tasks performed in particular sequence determined by dynamic conditions. Very often a workflow represents a business process, for example the order processing steps in a ecommerce store. Amazon Web Services offer various tools for building distributed and scalable workflow applications. One approach for building such an application is to use topics and queues for connecting the distinct steps in the workflow process. Then we can use publish/subscribe, competing consumers and other mechanisms to scale our application and soon even the simplest application takes a shape similar to this:Each step of the pipeline is connected to the next one with a queue and each step performs some actions and takes decision what is the next step. In addition using SNS/SQS involves some other low level tasks: - Serialize/deserialize the data - Ensure consistency (FIFO order) for SQSmessages - Make sure message size is not