Sunday 27 July 2014

Disaster recovery for Cloud-based applications in AWS

Why you need to have DR solution  for cloud based application

  • 54% of Cloud IT Managers experienced an outage in the past 3 months
  • Top Challenges in meeting availability goals: Insufficient IT resources, Budget limitations, Software Bugs
  • 79% reports a service availability goal of “Three Nines” (99.9%)



DR and HA made easier –No need to build DR solution from scratch.AWS  already has many of the building blocks built-in –AutoScale, Snapshots  ,Cloud formation

AWS infrastructure


Types of Downtime (AWS)

  • Single resource disaster
  • Single availability zone disaster
  • Single Service disaster
  • Whole-region disaster













Network Virtualization & SDN

Network Virtualization defined as using network resources through a logical segmentation of single physical network.

VLANs  - Virtual Local Area Networks
VRF      -  Virtual Routing and Forwarding
MPLS   - Multi-protocol Label Switching
VPN     - Virtual Private Networks
MEC    - Multi- Chassis EtherChannels
GRE     - Generic Routing Encapsulation
VDC    - Virtual Device Contexts
VSANs- Virtual Storage Area Networks

Server virtualization has led to the development of virtual switches within the hypervisors. Virtual switches within the hypervisor allow for communication between virtual machines, communication between virtual machines and the physical network.

VMware –vSwitch
 VMware –Distributed Virtual Switch (DVS)
Citrix Distributes Virtual Switch (Open Switch)
Cisco Nexus 1000v
KVM-Linux Bridging ,Open Virtual Switch

VMware Vswitch Networking Components


Cisco Nexus 1000v Architecture





 Network Abstraction
Traditional network constructs were not designed to support dynamic workloads in highly virtualized environments
Overlay technologies allow for independent logical network to be built on top of existing ip infrastructure 
Abstraction uses overlays to present logical networks built on traditional infrastructure
Network abstraction
Virtual Extensible LAN (VxLAN) –Allows Layer 2 in Layer 3
Stateless Transport Tunneling (STT)
Overlay Transport Virtualization (OTV)
Locator ID Separation Protocol (LISP)
Network Virtualization using GRE (NvGRE)

SDN –Software Defined Network

SDN  is a dynamic and flexible network architecture that protects existing investments while future proofing the network. With SDN today’s static network can evolve into an extensible service delivery platform     capable of responding rapidly to changing business, end user, and market needs

Today’s network are defined by the BOX
  • Hardware ,operating system, and applications built into a single hardware device
  • Distributed algorithms between devices
  • Separate Polices
  • Federated Systems


The Value of SDN is the ability to provide configuration and automation of the entire network/fabric so new services and end systems can be deployed rapidly and operational cost can be minimized







Architecturally What It means 







Vmware SDN View




Cisco View of SDN



Saturday 26 July 2014

Hybrid Cloud Hosting and Connectors

Hybrid Hosting
Combine Hosting Platforms to Address Your Application Requirements
Hybrid Hosting combines physical hosting, virtual hosting, and managed services to build heterogeneous solutions tailored to unique sets of requirements driven by workload and application needs.

Why Hybrid?
·         Not all enterprise-class applications and workloads are cloud-ready.
·         Most enterprise-class IT infrastructures are comprised of many applications and workloads. Hybrid Hosting enables organizations to gradually transition their applications and workloads to the cloud.
·         Hybrid Hosting supports cloud planning – implement the cloud one step or even one application at a time.
·         Create additional scalability, redundancy, and flexibility for your entire IT infrastructure environment.
·         Scale your utilization of cloud resources up or down as required.
Hybrid Architecture:
·   Connect your cloud environment to existing physical infrastructure, including co-location, dedicated and virtual servers
·   Support workload and application-driven needs with a tailored solution designed to fulfill unique sets of requirements
·   Migrate to the cloud gradually with your entire environment consolidated to one provider under one roof

How it Works
Hybrid Hosting Connectors provide customers with the ability to integrate co-location, dedicated servers, virtualized environments, and cloud servers to construct a Hybrid Hosting solution. Hybrid Hosting is beneficial to organizations because it enables them to host their interoperable applications and workloads on the most appropriate hosting platforms.
Hybrid Hosting Connectors can connect workloads, applications, and equipment


Hybrid Services
·         Network & Service Monitoring: Website/HTTP & content scanning, Agent and agent-less SNMP & WMI, custom monitoring & remote testing.
·          Point-to-Point & Metro LAN Connectivity: Securely connect your locations with interfaces of up to 1Gbps. Ethernet, Fiber, Wireless High-speed.
·          Managed VPN: Static and Dynamic Virtual Private Networks to securely connect your locations and your people.
·           Managed Backups
·          Data archival (Vaulting & eVaulting)
·           Managed & Hosted Storage Solutions
·          Distributed Content Delivery (CDN)


Vcloud Connector

1. vCloud Connector:

Can be used to migrate vSphere vm to your private or public cloud. VMware vCloud Connector provides a centralized interface (vSphere Client or web browser via vcloud.vmware.com) to connect, view, copy, and operate vSphere virtualized applications across vSphere based clouds. VMware vCloud Connector can also be used as true 'hybrid cloud connector' by connecting your VMware vSphere or vCloud Director environment with a certified public cloud service from VMware's vCloud partner ecosystem. This allows you to move your existing applications in the cloud and move these applications back into the data center when desired.



vCloud Connector comes in two editions:

- VMware vCloud Connector Core Edition is a free downloadable product from VMware that lets you copy, view, and operate your computing resources across private vSphere, private vCloud Director and our set of vCloud Service Provider partners.

- vCloud Connector Advanced Edition lets you extend the logical boundaries of your datacenter, and lets you manage a single content catalog across the entire cloud environment. It includes 'Content Sync' that lets you manage and publish a vSphere folder or a vCloud catalog and subscribe to it from another vCloud (automatically synchronized between subscribing catalogs rather than manual copy). It also has 'Datacenter Extension' features that extend private datacenter networks to public cloud networks, via a layer 2 connection over an SSL VPN tunnel. This makes it possible to move workloads between clouds while retaining network settings (e.g. MAC and IP addresses), so that other applications or users in the datacenter can continue to consume and use the workload (also system management solutions can continue to manage the workload without changes).



2. vCloud Automation Center (vCAC):

vCAC essentially enables you to create blueprints for compute resources and provision them to either VMware vSphere/vCloud, Microsoft Hyper-V or KVM based environments as well as external cloud providers like Amazon EC2. vCAC is included in the vCloud Suite and has these key features:

- multi hypervisor, multi-vendor cloud management - Use the simple drag-and-drop interface for designing application deployment

- User-aware self-service portal

- User and business group access (controls which services, resources and service levels a user or different business group sin a multi-tenant environment can access)

- Resource Reservations (enables resources to be allocated for use by a specific group)

- Service Levels - defines the amount and type of resources a given service can receive, either during the initial provisioning or as part of any configuration changes

- Blueprints - contain the automation policies that define the process for building or reconfiguring compute resources

- Accelerated PaaS - application blueprint, which describes the deployment topology of applications independently from the underlying infrastructure

- Workflow designer - allows activities to be easily inserted into workflow stubs at various states of transition within a machine's life cycle





1.                       VM transfer request sent from UI to server appliance
2.                       Server appliance sends information to node appliance
3.                       Node appliance sends “export” request to vCenter server
4.                       Content is copied from datastore to node appliance cache
5.                       Content is transferred from node appliance to other cloud node appliance
6.                       New cloud node appliance tells vCloud director to import virtual machine(s)
7.                       Content transferred from new cloud node appliance to vCloud director storage
8.                       vCloud director notifies the vCenter serve to import the virtual machine(s)
9.                       Content transferred to datastore for cloud usage

Rack Connect

·         Choose an F5® BIG-IP® Local Traffic Manager or a Cisco® ASA firewall to connect your traditional hosted infrastructure to the Rackspace Cloud
·         Cloud Servers can automatically be added to your load balancer, enabling you to scale on demand
·         Connect to Rackspace with an encrypted VPN tunnel to link the Rackspace Cloud to your data center or existing IT infrastructure
·         Define Network Security Policies in the customer portal and they are automatically applied and managed across your firewall, load balancer, and Cloud Servers
·         Manage cloud and dedicated network security policies centrally in the MyRackspace customer portal
·         Add Cloud Files for easily scalable storage
·          high-capacity network delivers fast throughput for Cloud Servers, Cloud Files, and RackConnect


Windows Azure Connect 




IBM softlayer Hybrid Cloud  Connector 

As more and more workloads move to the cloud many of the customers are looking for a way to leverage all of the value and economies of scale that the cloud provides while still being able to keep sensitive data secure. Citrix and SoftLayer provide a secure and easy way to implement a hybrid cloud solution.

Citrix and SoftLayer bring cloud networking as a service to customers: The virtual editions of Citrix NetScaler (NetScaler VPX) and Citrix CloudBridge are available as an on-demand cloud networking service to provide an extra layer of security and optimization to SoftLayer workloads

When a SoftLayer customer uses Citrix NetScaler and/or CloudBridge as a service on the SoftLayer cloud, they have taken the first step to setting up a hybrid cloud. Once a NetScaler VPX has been provisioned, all they have to do is set up a physical NetScaler Application Delivery Controller appliance in the datacenter where their private information is stored. Likewise, the SoftLayer customer can create a secure and optimized tunnel between their data center and the IBM SoftLayer Cloud using the Citrix CloudBridge solution.
When the NetScaler appliance is running in the customer datacenter it takes only a few clicks in the management console to connect to NetScaler VPX running at SoftLayer

Here’s how: Setting Up CloudBridge to SoftLayer Enterprise Cloud.

Connecting to the SoftLayer Enterprise Cloud with NetScaler



The configuration utility includes a wizard that helps you to easily configure a CloudBridge Connector tunnel between any NetScaler (physical or virtual) on any network and NetScaler in the SoftLayer enterprise cloud. This can be a layer 2 or layer 3 bridge.
Using the wizard, you can perform the following steps to configure a tunnel to a NetScaler VPX instance on the SoftLayer enterprise cloud.
1. Connect to the SoftLayer enterprise cloud by providing the user log on credentials
2. Select the Citrix XenServer that is running the NetScaler VPX appliance
3. Select the NetScaler VPX appliance
4. Provide CloudBridge Connector parameters to:
• Configure a Tunnel.
• Secure the tunnel.
• Create a logical representation of the CloudBridge by specifying a name.
• Bind the Tunnel to the CloudBridge.
The wizard will automatically create the objects on both sides, removing the need to manually configure the partner node in the cloud.
To configure a CloudBridge Connector tunnel by using the configuration utility:
1. In the navigation pane, click CloudBridge
2. In the details panel, click SOFTLAYER
In the Setup CloudBridge on SoftLayer wizard, click “Next,” and  follow the instructions in the wizard.




Cloud storage Market overview

Public cloud storage is infrastructure as a service (IaaS) that provides object storage services through a REST API using Internet protocols. The service is stand-alone with no requirement for additional managed services. Vendors supply their core storage services off-premises, and include on-demand, elastic storage capabilities in a self-service model. The service price is based on capacity, data transfer and/or other access services. Stored data exists in a multitenant environment, and users access that data through the Internet or dedicated network connectivity.


Cloud Provider
Strengths
Weakness
Amazon Web Services (AWS) is a pioneer in public cloud storage services, having offered an object storage service for more than eight years. AWS Simple Storage Service (S3) is accessible through RESTful API. AWS also offers a persistent block storage service, Amazon Elastic Block Store (Amazon EBS), which serves as virtual machine (VM) storage; and a long-term archival storage, Amazon Glacier. All storage services are available in 10 regions (four in the U.S., one in Europe, one in South America and four in Asia/Pacific, with a limited public release in China). To enable hybrid cloud storage deployments, it offers AWS Storage Gateway, a cloud storage gateway device that presents an on-premises Internet SCSI (iSCSI) block and virtual tape library (VTL) interface. Amazon CloudFront, an integrated content delivery network (CDN), provides performance optimization for distributed content
AWS has a proven, well-rounded storage portfolio and is highly innovative, agile and responsive to customer needs. AWS often launches new capabilities and services well ahead of the competition. Its storage services, Amazon S3 and Amazon Glacier in particular, enjoy high brand recognition among prospective customers.
AWS offers storage services in 10 regions (including AWS GovCloud in the U.S.), with more than 50 edge locations worldwide. This geographic reach, combined with its strong channel partner ecosystem, gives AWS a clear advantage in serving a wide range of customers by geography, organization size, vertical industry and use cases.
The Amazon S3 API is evolving as a de facto standard for developers writing storage applications for the cloud. It is supported by leading independent software vendors (ISVs), such as backup, archiving and on-premises object storage vendors, which move data to the AWS cloud
Competitors, particularly Google and Microsoft, are increasingly challenging AWS's leadership on storage pricing.
AWS's lack of detailed architectural information for services such as Amazon Glacier can sometimes frustrate customers that are looking for better transparency from cloud providers

A&T focuses on the enterprise market space by enticing AT&T clients to move data into the cloud or building relationships with new clients. The storage service is built on the EMC Atmos platform, enabling hybrid storage environments for clients committed to the Atmos platform. AT&T Synaptic Storage as a Service offers basic object-based storage, as well as value-added services such as connectivity based on AT&T's NetBond service, storage for the medical imaging community, and a file synchronization and sharing capability built on EMC's Syncplicity product. The service enables customers to easily apply data resiliency policies that include local replication, remote replication, compression and write once, read many (WORM) capabilities.
AT&T has an enterprise-focused product and sales strategy, and broad experience working with large-enterprise customers.
AT&T provides extensive networking functionality for its customers and for enterprises willing to leverage AT&T's Multiprotocol Label Switching (MPLS) network or 3G/4G infrastructure.
The emphasis is on capabilities that are of high interest for enterprise customers — security and compliance, industry offerings such as medical imaging services, and turnkey storage services such as file synchronization and sharing

Market traction for cloud compute capabilities is limited for IT leaders expecting to make the transition from storing data in the cloud to a cloud compute environment that uses that data.
Global data center regional support is limited, which will hamper organizations that must meet stringent data sovereignty requirements.
AT&T is a price follower with capacity pricing that is high compared with large competitors


Google Cloud Platform (GCP) from Google offers object storage and block storage services (Google Compute Engine persistent disks associated with VMs). The object service supports two RESTful programming interfaces — XML and JavaScript Object Notation (JSON) — to create applications that can store data in the Google cloud. Google cloud storage services are available in North America, EMEA and the Asia/Pacific region. There is an emphasis on batch computing use cases, which are enabled by direct connections to Apache Hadoop and Google BigQuery engines

Google is a thought leader in building efficient, distributed data center infrastructures, and GCP leverages a number of those technologies and process innovations.
Google has deployed an extensive global network infrastructure that connects its data centers and backbone to edge points of presence (POPs) in more than 100 countries, which benefits its enterprise customers.
Google has shown its intentions to be an aggressive price leader through its scale of operations and deep pockets, reaffirming its commitment to the cloud storage business.

Google is ramping up its product management, professional services and support to better align with enterprise organizations, which means customers must be patient as those engagement capabilities evolve.
With Google Apps as the point of entry for Google into the enterprise, there has been less focus on building a strong ecosystem of partners focused on IaaS use cases in enterprise settings. As a result, its channel partners tend to be small and less experienced in serving enterprise customers for cloud storage use cases.
Google's cloud storage offering, although compliant with a number of regulations, is a general-purpose platform with no explicit vertical services for customers in regulated industries, such as financial services, healthcare or government

HP

HP offers object storage and block storage (associated with VMs) under the HP cloud brand. Object storage is based on OpenStack Swift and integrated with the Akamai CDN. HP cloud is available on the East Coast and in the Western region of the U.S. HP cloud storage continues to grow incrementally since its general availability in 2013. In 1Q14, HP reported double-digit revenue growth in its cloud, security and big data services. Recent statements by company officials indicate continued high investment in cloud technologies and related services. SLAs are in line with the industry or slightly better at 99.95% availability per month. The HP Helion OpenStack platform, introduced in May 2014, enables customers to build private clouds on the Helion platform that interoperate with the HP public cloud storage offerings or other non-HP OpenStack-based services. HP does not offer connectivity directly from its storage equipment to its public cloud storage offerings. However, it has partnerships with gateway companies, such as Panzura, to close that gap in capability
HP has an OpenStack-based platform that enables storage integration using OpenStack Swift's API, and, thus a wide variety of vendor support is available for creating extensions.
As a large, credible enterprise company, HP has the potential and expertise to handle the concerns and engagement expectations of large IT organizations familiar with HP storage, servers and services.
There is the potential for tight integration with HP storage products for building hybrid storage infrastructures to bridge on-premises and public cloud storage.

HP is a relatively new entrant in the cloud storage arena. It is still evolving in terms of services and customer engagement models, with limited capabilities outside the U.S.
HP is evolving its cloud compute and storage platform based on open-source software (OpenStack), which may slow or limit the introduction of market-leading capabilities to address changing market demands.
HP's cloud pricing is based on capacity and usage, but has not kept pace with its larger competitors' price reductions

IBM acquired SoftLayer, a private hosting and cloud IaaS provider. IBM has retired its SmartCloud Enterprise object storage offering in favor of SoftLayer's storage services. SoftLayer's object storage service is based on OpenStack Swift and was introduced in early 2012. IBM's storage services are available from 13 data centers in North America, Europe and the Asia/Pacific region. IBM is unveiling an aggressive global expansion road map for 2015. Through the recent price cuts made in June 2014, IBM has shown intentions to be price-competitive with the other large cloud storage providers
IBM's object storage service is complemented by strong bare-metal compute offerings and an easy-to-use management portal, which makes provisioning easier for cloud and managed storage offerings.
IBM's core object storage service is based on OpenStack Swift, which is emerging as a popular API and challenger to AWS S3 API in terms of ecosystem support.
For a late entrant, the storage service has commendable geographic availability and reach, which is expected to grow with strong impending investments from IBM

SoftLayer was primarily focused on Web hosting and bare-metal needs of customers in industries such as online services (e.g., gaming customers). Enterprise customers looking at mainstream use cases such as backup, archiving or content distribution need to be cautious in terms of ecosystem support.
Product enhancements, innovation and marketing efforts so far for cloud storage have been low, with a greater emphasis on compute capabilities.
IBM's portfolio includes on-premises and cloud storage services that have little in common and can be confusing to customers. IBM does not provide an OpenStack distribution or related tools to enable a hybrid cloud. None of its on-premises storage products support tiering to the object storage cloud service

Microsoft Azure offers tight integration with other Microsoft technologies, including server products, system management and various cloud offerings, such as Office 365. Services are available worldwide, including Europe and the Asia/Pacific region, with global expansion planned. Microsoft claims rapid growth of services in the double-digit range. Although Microsoft does not break out specific revenue, the Azure business is estimated to be one of the largest in the cloud space. Microsoft has invested heavily in its infrastructure; some estimates are more than $15 billion. It continues to add customers for Azure and cloud storage services via its object storage service (Azure binary large object [BLOB]) enabled through the StorSimple cloud storage solution interfaces. Microsoft pricing often is in reaction to Amazon's price reductions. For BLOB storage, Microsoft offers conventional on-demand pricing, as well as commitment-based pricing that may include a no-charge StorSimple device to support hybrid infrastructures
Microsoft is an established company with continuing large investments in the cloud infrastructure, indicating positive credibility and longevity.
Turnkey delivery of a cloud storage service via the StorSimple gateway simplifies vendor engagement for organizations unable to handle complex vendor relationships.
Microsoft has a focus on performance to enable demanding workloads, and on rapid write consistency to enable file services in a collaboration environment

For turnkey engagements based on StorSimple, hybrid storage environments lack support for global file systems and namespaces, unless services such as Distributed File Service (DFS) running in a separate file server are added.
Microsoft was a late entrant in IaaS. Although it has gained significant momentum, its partner ecosystem in the storage IaaS market segment continues to be weak.
Microsoft has limited partnerships with the major storage vendors, such as EMC, NetApp, IBM, HP and Hitachi Data Systems. Thus, it lacks credentials when used to extend enterprise on-premises storage environments.

Rackspace is a publicly listed company with a strong legacy in managed hosting and public cloud IaaS. It is a co-founder of OpenStack and the primary contributor to the OpenStack Swift project. Rackspace offers object storage (Cloud Files) integrated with the Akamai CDN, block storage (associated with VMs), and cloud backup services, including JungleDisk, which also integrates with AWS S3. Cloud Files storage service is available from Rackspace's data centers in the U.S., the U.K., Australia and Hong Kong
Rackspace offers OpenStack distribution with maintenance, services and support. Given its pivotal role in OpenStack, Rackspace has high credibility as a provider of open, interoperable hybrid cloud.
Rackspace's pricing is easy to understand: Price is for storage and bandwidth; there are no extra charges for access requests or support

Rackspace has ceded control of the OpenStack foundation. HP and IBM are formidable competitors willing to invest aggressively in building products, services and support capabilities based on OpenStack, challenging Rackspace in OpenStack-based hybrid cloud deployments.
Rackspace lacks a strong professional services team and a partner ecosystem to enable rigorous assessment, workload migration and implementation of hybrid cloud storage services globally. Its partnerships with cloud storage gateway vendors and ISVs tend to be weak, and services capabilities are limited to the U.S.
Rackspace's global expansion for its cloud storage services has historically been slower than other vendors, even in regions where it was already offering managed hosting.