Wednesday, September 20, 2017

NGINX | Big leap towards cloud-native application platform from a high-performance web-server

NGINX has recently (Sep 6-8) organized NGINX Conference 2017 in Portland (OR) and would like to highlight some of the key announcements made by NGINX experts in this blog. There is a paradigm shift by NGINX in recent years of offering a comprehensive application platform for Cloud-native Microservices not just a high-performance web server and the same message has been consistently delivered in this conference.

NGINX CTO (Igor Sysoev) announced their aggressive strategy to move beyond web server and offer a unique application platform for cloud-native microservice application platform with the same level of high performance. Also, it is supported by almost all major cloud vendors in the market today - AWS, Azure, OpenShift, GCP, etc.

As per w3tech figuresNGINX is now #1 web-server for 1 million busiest sites in the world. NGINX has achieved this only 5 years and it is a great achievement for opensource community.
Also, a lightweight technology like NGINX to support challenging demands of Microservices (such as monitoring, high performance, hot deployment, lightweight containers, less/zero maintenance, etc.) has been highlighted and a similar approach will be extended to the new application platform.

The overall application platform has 3 key components:

1. NGINX Controller
  • Security using RBAC (load balancing config by app owners, self-control).
  • Centralized traffic management (routing, push button LB addition, upstream servers management, SSL keys management).
  • Centralized monitoring (application metrics, requests per sec, bandwidth usage, consolidated dashboard).

2. NGINX Unit
  • A brand new lightweight open-source application server.
  • Unique in the industry to support multiple languages in one application server.
  • Current beta version supports Python, PHP & Go. Java & NodeJs support to be available soon.

3. NGINX/NGINX Plus Web Server
  • High-performance web server, which is the backbone of the entire application platform.

In conclusion, big aspirations by NGINX as a company to move forward aggressively towards establishing themselves as a cloud-native platform. Keep watching NGINX!!

References:


Saturday, March 18, 2017

5 Key Takeaways from Google Cloud Next '17 Keynote Session

Technology helps in diminishing physical boundaries and watching Google Cloud Next 2017 keynote session on my TV through YouTube was a great example to prove this theory.

Cloud has been at the top of CxO's priority list and technology events such as AWS's re:Invent and Microsoft's Build 2016 re-emphasized Cloud's perseverance. Google's Cloud Next 2017 continues the trend and here are key takeaways from Google Cloud Next's Keynote on Day 1:

#1 - G-Suite adoption by key industry players in quick time
Google highlighted the adoption of G-Suite (Gmail, Docs, Drive, Calendar) by business powerhouses such as Colgate-Palmolive and Verizon and very excited to point that with good planning, it can be achieved in the timeframe of 3-6 months. 
"Google challenges old notions and showcases that it is possible to move large-scale infrastructure in months as against multi-year approaches."
A quick Google Search reveals that Colgate & Verizon has migrated 28K users & 150K users respectively in months. Read more by clicking here.

G-Suite Solution

#2 - Cloud is an incredible & cool place where everybody wants to go


Google highlighted their Cloud capabilities with examples such as Customer Planet Labs, which takes picture of Earth every 3 hours and stores in Google Cloud.

With increased security, 99.999% up-time, scalability, faster time-to-market, competitive pricing and flexibility, Google Cloud is a promising future and will be putting itself in elite category very soon.

#3 - Future is Fast Data, Analytics, AI, Deep & Machine Learning
EBay ShopBot, which uses AI, deep learning (beyond machine learning), computer vision and natural language understanding to create a great technical differentiator.

Fei-Fei Li (Chief Scientist at Google Cloud AI) talked about many such experiences (such as the scale of thousands of people having their own self-driving cars, using AI to improve the quality of human life). 
Demo of Cloud Vision API was awesome, which extends capabilities from image to video analysis using video intelligence API. 

#4 - Key industry players put faith in Google Cloud
Google invited their esteemed clients to talk about their experience with Google and their passion was contagious.
  • EBay - R.J. Pitman talked about Google Home example (along with live demo) as integration with EBay product catalog to find information about products using voice-commands. 
  • HSBC - Darryl W (Global CIO) shared their Cloud & Cloud-scale data analytics (over 100 PB of data with large computing needs to do simulations) and their plan to movement towards GCP.
  • Disney - Mike W. (CTO) talked about their Cloud-first approach with 500 projects in Cloud involving Image Recognition, Personalization, etc,
  • SAP - Talked about SAP HANA (in-memory product), which is now available on GCP. SAP Cloud Platform (uses Cloud Foundry) chose GCP over other vendors considering scalability support & containerization.
  • Verizon - Alan D. (VP) talked about G-Suite usage for the 150K workforce.
  • Colgate-Palmolive - Mike C. (CIO) talked about using G-Suite for collaboration & workspace productivity.
  • Home Depot - Paul G (SVP) talked about moving from on-premises to Cloud along particularly data analytics environment.

#5 - Better uses of money...Eric Schmidt
And, finally Eric S. pointed out that Google put $30B in infrastructure and we should not try to replicate the same and use the money to better use. In his own words:
"We put thirty billion dollars - and I know because I approved it. So it's real, right, into this platform. Please do not attempt to duplicate it.You have better uses of your money. - Eric S."

To conclude, an exciting time ahead in Cloud marketplace with Google launching differentiating GCP capabilities in competition with Amazon's AWS and Microsoft's Azure. Google's cloud roadmap looks very promising and its brand in terms of scalability, reliability, and availability makes Google Cloud Platform a very compelling option. Personally, I believe Google's offering in Big Data, Machine Learning, and AI-related services seems to be their core competence in a highly competitive Cloud marketplace.

Tuesday, November 22, 2016

Why In-memory computing plays an important role in Microservices Architecture?

Microservices is the new architecture paradigm everyone is talking about, but it comes with its own set of complexities. As our industry gets more matured about using Microservices architecture, one of the key learnings coming out as:
The outer architectural building blocks are playing far more important role than the inner architecture of each microservice itself.
I will be sharing my perspective on microservices' outer architectural building blocks (In-memory computing & caching, API Gateway, Containers, DevOps & Cloud Computing) in a series of upcoming blog posts. This blog post is focused on "in-memory computing technology", which plays an important role in microservices architecture.

In-memory computing, in itself, is a vast technology domain but in the context of microservices architecture, I would like to keep it focused on following solution offerings:
  • In-memory database - a database system primarily residing in memory (SQL or NOSQL).
  • In-memory data grid - distributed computing based caching system usually having KV (key-value) storage.

In-memory database (IMDB)
In-memory database plays a collaborative role in microservices architecture as usually it can be deployed independently and provides highly efficient storage support to microservices. 

Note that to sustain data stored in in-memory database during deployments, a backup approach with file-system based storage is required.

These are following key design patterns, which can be applied in the context of in-memory database:
  • Pattern A - IMDB per microservice, where each microservice having its own storage
    • Applicability: Greenfield development where you have opportunity to do microservices based architecture first
    • Pros: Independent (inclusive of deployment flexibility) & completely in adherence to microservices principles
    • Cons: Duplication of data across services
  • Pattern B - IMDB as a shared component across multiple Microservices having common storage
    • Applicability: Brownfield development where you are on a path to refactor monolith application to microservices
    • Pros: Practical approach when you have shared data across services
    • Cons: Not completely aligned with Microservices principles
  • Pattern C - Hybrid of Pattern A or B (some microservices having shared database)

Microservices Architecture - In-memory database design patterns


In-memory data grid (IMDG)
In-memory data grid relies on distributed computing using clustering as underlying approach and provides a shared component (grid) for CRUD operations using memory.

As microservices architecture recommends independent deployable units with minimal shared data, in-memory data grid is not completely aligned to this architectural approach. However, in-memory grid products can provide independent cache nodes to respective microservice with variation of distributed cluster to store backup data in the grid.
In nutshell, conceptually these are different approaches:
  • Microservices architecture - It promotes independence and less dependency for linear scalability (cluster of instances of microservice but clustering at layer level is not recommended).
  • In-memory data grid - It relies on cluster of nodes (data layer) for horizontal scalability (nodes can be added/removed on need basis for scalability).

Because of the above reason, vendor like Oracle has started their cloud roadmap with less emphasis on Oracle Coherence for microservices architecture and more on cloud based offering for Cache-as-a-service, which can be easily integrated with microservices Architecture. However, this is also similar to common grid solution with variance that cloud is now playing the common grid. Also, In-memory grid solution is still relevant and playing its role behind the scenes (to support cloud's cache-as-a-service). 

From applicability perspective, following patterns can be leveraged for microservices architecture along with in-memory datagrid solution:
  • Pattern A - In-memory data grid as event/messages store
    • Applicability: Primarily for inter-microservice communication, this pattern can be leveraged.
  • Pattern B - In-memory data grid as shared data
    • Applicability: To store shared data such as backend system response (cached data), response data, content data, etc.
  • Pattern C - In-memory data grid as storage
    • Applicability: To store data in grid for a microservice and use partition approaches to separate data for each microservice

To conclude, in-memory computing plays a significant role for Microservices architecture as an underlying storage mechanism for each microservice. Also, in-memory grid computing offers an alternative solution, which respects microservice's principle of independence up to certain extent and provides a out-of-the-box solution to solve inter-communication & storage challenges for microservice architecture.

References


-->
 In-memory database & In-memory data grid solutions
In-memory database & In-memory data-grid solutions

Thursday, March 24, 2016

5 Skills A Software Developer Should Have To Be A Smart Developer


A software developer in any project plays a very critical role in realizing architecture & design. Current modern architecture world needs modern or smart developers, where they should possess pragmatic skills. Being Aware, Being Social & Being Smart is what world is looking forward to.
Smart Developer is the need of the hour
So, how do we define a smart developer? 5 key areas, which can make a developer a smart developer:

  • Ability to be focused & goal oriented
It starts with introspection and planning for your career. You can think of an approach as you take for your code:
§               Keep it modular - Personal, professional - both aspects need to be well-thought of and your TODOs (like in code), needs to be taken care of on regular basis.
§               Keep it clean & comply with rules - As we follow coding compliance rules, some rules for yourself and keep your objectives very clean and measurable
§               Keep it loosely coupled - Like your code, don't couple many objectives together - keep it simple and flexible so that they can vary independently.
§               Keep it measurable - Like your code performance SLA, keep your objectives SLA based and measure it every fortnightly/monthly/quarterly/yearly as frequent as possible.

  • Ability to market & sell your idea
o                 This is the most ignored aspect and the most difficult part. As you grow, your ideas need to be told and to be executed and in order to that, first thing is you need to sell your ideas to people. 
o                 Storytelling is a well-known technique to convey your thoughts in a way anybody can understand.
o                  SapientNitro has redefined Storytelling to Storyscaping, which is a new way to tell powerful stories with connected experiences (used in marketing). This can be applied in usual storytelling as well.

  • Ability to increase your productivity
o                 A constant effort & thought process to come up with new & improved ways to do things. A simple example - a Jmeter script to do unit-level performance test and reduce cost of quality by detecting any issues earlier.
o                 Share your knowledge with team (in the form of blog or webinars). It helps to improve productivity of entire team and also an opportunity to get feedback from others.

  • Ability to keep up with learning
o                 By reading blogs from leading tech companies (Netflix Tech Blog,Oracle OTNAWS Blogs, IBM Emerging Tech BlogDZoneTechGig,TechCrunch),
o                 Through developer wsebsite of tech companies (such as Facebook for DevelopersTwitter DevelopersAmazon AWSFacebook for developers)
o                 Asking questions on question-answer websites (such as QuoraStackoverflow)
o                 Learning through MOOC sites (CourseraUdemy etc.) or Youtube channels
o                 Finally, by following key technology people/companies on social media channels (Twitter, LinkedIn, etc.).

  • Ability to keep a healthy mind, body & soul
    • The most important one as it keeps up the spirit and make sure we have fresh & healthy mind to counter any challenge and come up with innovative ways to do things.
In conclusion, these 5 skill-sets can help being more successful in today's demanding culture with dynamic & fast changing technology world.

References:
http://www.amazon.com/Soft-Skills-software-developers-manual/dp/1617292397/
http://storyscaping.com/
http://www.techrepublic.com/blog/10-things/10-highly-valued-soft-skills-for-it-pros/


Disclaimer:

All data and information provided on this site is for informational purposes only. This site makes no representations as to accuracy, completeness, correctness, suitability, or validity of any information on this site and will not be liable for any errors, omissions, or delays in this information or any losses, injuries, or damages arising from its display or use. All information is provided on an as-is basis.This is a personal weblog. The opinions expressed here represent my own and not those of my employer or any other organization.