Amazon Web Services Cloud Big Data
Home — Cloud ServicesCloud Platform Services Solutions — Amazon Web Services Cloud Big Data

Build highly scalable and secure Big Data applications fast. No hardware to procure, no infrastructure to maintain. Amazon Web Services Cloud Big Data provides a broad range of services to help you build and deploy big data analytics applications quickly and easily. Amazon Web Services Cloud Big Data gives you fast access to flexible and low-cost IT resources, so you can rapidly scale virtually any big data application including data warehousing, clickstream analytics, fraud detection, recommendation engines, event-driven ETL, serverless computing, and Internet-of-Things processing. With Amazon Web Services Cloud Big Data you don’t need to make large upfront investments in time and money to build and maintain infrastructure. Instead, you can provision exactly the right type and size of resources you need to power big data analytics applications. You can access as many resources as you need, almost instantly, and only pay for what you use.

The most complete platform for big data. Build virtually any big data analytics application; support any workload regardless of volume, velocity, and variety of data. With 50+ services and hundreds of features added every year, Amazon Web Services Cloud Big Data provides everything you need to collect, store, process, analyze, and visualize big data on the cloud. Hadoop & Spark Amazon EMR. Easily provision a fully managed Hadoop framework in minutes. Scale your Hadoop cluster dynamically and pay only for what you use. Run popular frameworks such as Apache Spark, Apache Tez, and Presto. Interactive Query Service with Amazon Athena. Easily analyze petabytes of data in Amazon S3 using ANSI SQL. With Amazon Athena, there are no clusters or data warehouses to manage, so you can start analyzing data immediately. You don’t even need to load your data into Athena, it works directly with data stored in S3. Amazon Elasticsearch Service. Setup and deploy an Elasticsearch cluster in minutes, using a web-based console.

Amazon Web Services Cloud Big Data Elasticsearch Service

Amazon Elasticsearch Service makes it easy to deploy, operate, and scale Elasticsearch for log analytics, full text search, application monitoring, and more. Amazon Elasticsearch Service is a fully managed service that delivers Elasticsearch easy-to-use APIs and real-time capabilities along with the availability, scalability, and security required by production workloads. The service offers built-in integrations with Kibana, Logstash, and AWS services including Amazon Kinesis Firehose, AWS Lambda, and Amazon CloudWatch so that you can go from raw data to actionable insights quickly. It’s easy to get started with Amazon Elasticsearch Service. You can set up and configure your Amazon Elasticsearch Service domain in minutes from the AWS Management Console. Amazon Elasticsearch Service provisions all the resources for your domain and launches it. The service automatically detects and replaces failed Elasticsearch nodes, reducing the overhead associated with self-managed infrastructure and Elasticsearch software.

AWS Benefits

You can deploy a production-ready Elasticsearch cluster in minutes using Amazon Elasticsearch Service without having to worry about provisioning infrastructure or installing and maintaining Elasticsearch software. Amazon Elasticsearch Service is a fully managed service that simplifies time-consuming management tasks such as software patching, failure recovery, backups, and monitoring. Highly Scalable. Amazon Elasticsearch Service gives you direct access to the Elasticsearch open-source API so you don’t have to learn new programming skills. Amazon Elasticsearch Service supports Logstash, an open-source data ingestion, transformation, and loading tool; and Kibana, an open-source visualization tool. You can control access to the Elasticsearch APIs using AWS Identity and Access Management (IAM) policies. Using IAM policies, you can enable your applications to access your Amazon Elasticsearch clusters securely. Amazon Elasticsearch Service routinely applies security patches and keeps your Elasticsearch environment up to date.

Tightly Integrated With Other AWS Services

Amazon Elasticsearch Service is designed to be highly available using zone awareness, which replicates data between two Availability Zones in the same region. Amazon Elasticsearch Service monitors the health of your clusters and automatically replaces failed nodes. Amazon Elasticsearch Service offers built-in integrations with other AWS services including Amazon Kinesis Firehose, AWS IOT, and Amazon CloudWatch Logs for seamless data ingestion, AWS CloudTrail for auditing; AWS Identity and Access Management (IAM) for security; and AWS CloudFormation for cloud orchestration. Amazon Elasticsearch Service enables you to monitor your cluster through Amazon CloudWatch metrics and resize your cluster up or down via a single API call or a few clicks in the AWS Management Console. You can configure your cluster to meet your performance requirements by selecting from a range of instance types and storage options including SSD-powered EBS volumes.

Use Cases

Analyze un-structured and semi-structured logs generated by websites, mobile devices, servers, sensors, and more for a wide variety of applications such as digital marketing, application monitoring, fraud detection, ad tech, gaming, and IoT. Capture, pre-process, and load log data into Amazon Elasticsearch Service using Amazon Kinesis Firehose, Logstash, or Amazon CloudWatch Logs. You can then search, explore, and visualize the data using Kibana and the Elasticsearch query DSL to gain valuable insights about your users and applications. Provide your customers with a rich search and navigation experience. Amazon Elasticsearch Service supports faceting, which allows your customers to narrow their search results by value ranges for fields like price, product characteristics, and brands; ability to create advanced search criteria filters; search-as-you-type suggester, and near real-time index updates. In addition, you can build elasticity into your search application because Amazon Elasticsearch Service provides easy scaling features to accommodate fluctuating query volumes.
Amazon Web Services Cloud Big Data

AWS Elastic Beanstalk

AWS Elastic Beanstalk is an easy-to-use service for deploying and scaling web applications and services developed with Java, .NET, PHP, Node.js, Python, Ruby, Go, and Docker on familiar servers such as Apache, Nginx, Passenger, and IIS. You can simply upload your code and AWS Elastic Beanstalk automatically handles the deployment, from capacity provisioning, load balancing, auto-scaling to application health monitoring. At the same time, you retain full control over the AWS resources powering your application and can access the underlying resources at any time.

There is no additional charge for AWS Elastic Beanstalk — you pay only for the AWS resources needed to store and run your applications. AWS Elastic Beanstalk is the fastest way to deploy applications on AWS. You use the AWS Management Console or an Integrated Development Environment (IDE) to upload your application, and AWS Elastic Beanstalk automatically handles the deployment of capacity provisioning, load balancing, auto-scaling, and application health monitoring.

Benefits

Whether you’re looking for compute power, database storage, content delivery or other functionality, AWS has the services to help you build sophisticated applications with increased flexibility, scalability and reliability. Amazon Web Services offers a broad set of global cloud-based products including compute, storage, databases, analytics, networking, mobile, developer tools, management tools, IoT, security and enterprise applications. These services help organizations move faster, lower IT costs, and scale. As an AWS customer, you will benefit from a data center and network architecture built to meet the requirements of the most security-sensitive organizations.

An advantage of the AWS cloud is that it allows customers to scale and innovate, while maintaining a secure environment. Customers pay only for the services they use, meaning that you can have the security you need, but without the upfront expenses, and at a lower cost than in an on-premises environment. Amazon Web Services Cloud Compliance enables customers to understand the robust controls in place at AWS to maintain security and data protection in the cloud. As systems are built on top of AWS cloud infrastructure, compliance responsibilities will be shared. Hybrid cloud architecture is the integration of on-premises resources with cloud resources.

Features

AWS Lambda lets you run code without provisioning or managing servers. You pay only for the compute time you consume — there is no charge when your code is not running. With AWS Lambda, you can run code for virtually any type of application or back-end service — all with zero administration. Just upload your code and AWS Lambda takes care of everything required to run and scale your code with high availability. You can set up your code to automatically trigger from other AWS services or call it directly from any web or mobile app.

AWS Lambda automatically runs your code without requiring you to provision or manage servers. Just write the code and upload it to AWS Lambda. AWS Lambda automatically scales your application by running code in response to each trigger. Your code runs in parallel and processes each trigger individually, scaling precisely with the size of the workload. With AWS Lambda, you are charged for every 100ms your code executes and the number of times your code is triggered. You don’t pay anything when your code isn’t running.

Hybrid Cloud On AWS

Hybrid cloud architecture is the integration of on-premises resources with cloud resources. For most organizations with on-premises technology investments, operating in a hybrid architecture is a necessary part of cloud adoption. Migrating legacy IT systems takes time. Therefore, selecting a cloud provider who can help you implement a thoughtful hybrid strategy, without requiring costly new investments in on-premises hardware and software, is important to simplify operations and more easily achieve your business goals.

By working closely with enterprises, AWS has developed the industry’s broadest set of hybrid capabilities across storage, networking, security, application deployment, and management tools to make it easy for you to integrate the cloud as a seamless and secure extension of your existing investments. AWS has also created strategic partnerships with long time leaders in on-premises platform providers such as VMware, Intel, Microsoft, SAP, and others to allow you to run your existing enterprise applications on AWS with full support and high performance.