You've requested...

Achieving 10x Acceleration of Spark and Hive Jobs on AWS S3 with Alluxio Tiered Storage

If a new window did not open, click here to view this asset.

Download this next:

Reduce costs without stifling innovation

Strategies for data cost optimization.

Whether it’s due to increasing volumes of data or ongoing economic uncertainty—optimizing the costs of your data strategy is critical to remain competitive in today’s complicated and ever-changing business landscape. What’s the best approach? Find out in The Ultimate Guide to Data Cost Optimization and explore:

  • Four ways you can reduce costs across the data journey
  • How to use analytics and machine learning to drive cost reductions across your organization
  • Real-world examples of how companies are reducing data costs while driving innovation

These are also closely related to: "Achieving 10x Acceleration of Spark and Hive Jobs on AWS S3 with Alluxio Tiered Storage"

  • Spark Muscles Into Big Data Processing

    It comes as no great surprise that the Apache Spark architecture has been horning in on the batch processing domain once controlled by Hadoop's MapReduce. But that's only part of the story. With data processing, streaming and machine learning capabilities on its résumé, the open source engine is learning to get along entirely without Hadoop in certain applications. In fact, one industry analyst cautiously sees a day when Spark could declare total independence, potentially bust up Hadoop cluster dominance and link separately with other Apache technologies. 

    In this three-part handbook, senior news writer Jack Vaughan examines the distinct advantages the Apache Spark architecture has over MapReduce. Also highlighted is how Spark's ability to process and analyze streaming data is helping detect fraudulent activities at a major banking and credit-card company. Next, Spark 2.0's upcoming upgrades to analytics speed, machine learning libraries, SQL support and stream processing are detailed. To close, Vaughan and senior news writer Ed Burns look at combining Spark and NoSQL databases in operational analytics applications, which could help broaden the use of both technologies.

  • A Computer Weekly buyer's guide to Computational storage & persistent memory

    Companies are finding that computational storage can solve the data bottleneck. In this 14-page buyer’s guide, Computer Weekly takes a closer look at its benefits, how it can be used and the advantages of faster computing.

Find more content like what you just read:

  • Focus: Open source

    Open source used to be an alternative to commercial off –the-shelf software. Today, the largest commercial software providers are big supporters of open source technologies.

    Download

  • Computer Weekly storage case studies

    Antony Adshead takes a look at what made the winning entries stand out from the crowd in the Computer Weekly European User Awards.

    Download

  • IT Project: Hyper-converged infrastructure

    The term hyper-convergence means different things to different people. But at its core, hyper-convergence brings together servers and storage network resources that are managed as a single unit using software. In this e-guide, learn more about the benefits of hyper-convergence and how you can derive the greatest value from your investment.

    Download

  • $265 billion: The projected cost of ransomware in 2031

    According to McKinsey, ransomware costs are projected to reach a staggering $265 billion by 2031. This white paper will show you how Panzura Detect compliments the robust passive protections inherent in Panzura CloudFS. Read on to learn more.

    Download

  • Hybrid Flash: The Essential guide

    This guide offers a comprehensive survey of the hybrid flash storage market. We give the lowdown on hybrid flash products from the big six storage vendors and the startups and specialists. Plus, we take a look at what's best for virtual desktops: All-flash or hybrid?

    Download

  • Combatting the spread of unstructured data

    The tendency for organizations to continue using legacy storage systems to manage escalating data volumes has resulted in the prevalence of unstructured data.CloudFS is designed to transform complex, multicomponent, and often multi-vendor environments into a simplified data management solution. Download now to learn more.

    Download

  • Jargon buster guide to hybrid cloud storage

    In this Jargon Buster guide we bring you definitions for the key concepts in hybrid cloud storage plus in-depth articles on hybrid cloud file and object storage, how to use the cloud as a storage tier and the key decision points when it comes to private cloud vs hybrid cloud.

    Download

  • Hyper-Converged Infrastructure Key Choices: We Look at Hyper-Converged Infrastructure and its Benefits for the Datacentre.

    We look at why it makes sense to go hyper-converged, how HCI differs from converged infrastructure, the pros and cons of hyper-converged vs traditional storage arrays, HCI software products available, and whether hyper-converged can help unleash the blistering performance potential of NVMe flash storage.

    Download

  • A comparison of Azure, AWS, and Google cloud services

    AWS, Azure, and Google are all huge names in the cloud space, offering everything from big data in the cloud to serverless computing options and more. Read on for a vendor-neutral comparison of these three providers to determine which combination – if any – best fits your organization's infrastructure requirements.

    Download

  • Event recap: VMworld 2018 Europe

    It is the 20th anniversary year for VMware and at the VMware European conference in Barcelona, the company famous for its hypervisor, showcased how it had changed the face of IT, and where it was heading next.

    Download

  • Focus: Object storage

    Object storage does away with the tree-like hierarchies of file systems used by traditional storage NAS and SAN systems.

    Download

  • Benefits of Spectra Logic’s object-based tape technology

    Spectra Logic’s object-based tape technology seamlessly integrates with NetApp StorageGRID, providing a secure, scalable, and cost-effective solution for long-term data storage in hybrid cloud environments. To learn more, check out this landing page.

    Download

  • Computer Weekly – 19 July 2016: Building big ideas in banking

    In this issue we visit JP Morgan's European software development centre in Glasgow to see how the investment bank is working with local universities and collaborating in the open source community. Software chief, Stephen Flaherty, talks about how JP Morgan uses open source software and has now begun contributing to open source projects.

    Download

  • Why Unilever combines IT with business

    In this week's Computer Weekly, we find out how consumer goods giant Unilever has changed its thinking about IT to support a global digital transformation. The UK boss of Hewlett Packard Enterprise assesses progress after the first year since HP split in two. And we examine how software development is changing in the enterprise. Read the issue now.

    Download

  • Top 10 Hottest Cloud Storage Terms to Know

    This E-Guide defines "cloud washing" and distinguishes popular buzzwords from true cloud offerings.

    Download

  • Object storage: A great fit for large, unstructured data sets

    Object storage is a rising star. In this e-guide we walk you through the key differences between object storage and the currently more mainstream approaches - file and block access. In doing so you'll clearly see the benefits and drawbacks of the object approach, which is to organise data in a flat structure with unique identifiers.

    Download

  • Secure Efficient and Flexible Capacity Tier for Veeam Backups

    PH

    Download

  • All-Flash: The Essential Guide

    This guide offers a comprehensive survey of the all-flash array market. We look at all-flash products from the big six storage vendors and the startups and specialists. Plus, we give the lowdown on all-flash vs hybrid flash arrays and all-flash vs server-side PCIe SSD.

    Download

  • Executive Interview: Tapping APAC's storage potential

    Lenovo's head of storage in Asia-Pacific singles out the region's market opportunities and predicts that the healthcare sector will go full-fledged with flash storage in the next year.

    Download

  • Storage trends 2016: Storage priorities, cloud appliances and NAS vs object storage

    This guide offers a collection of our most popular articles on storage-related issues from the first few months of 2016.

    Download

  • AWS storage: A guide to secure your data

    AWS provides a robust suite of storage and data protection solutions for your org. With durability and scalability, AWS ensures data security and continuity. Learn how AWS storage and security features enable risk mitigation, cost efficiency, and adaptation. Read the full eBook to discover how AWS levels the playing field.

    Download

  • Focus: Datacentre Uptime

    In this e-guide, we take a closer look at some high-profile datacentre outages of recent times and assess the toll they took on the companies involved, and look into what providers and consumers can do to protect themselves from downtime.

    Download

  • Backup fundamentals in the age of cloud

    In this e-guide we look at backup fundamentals like choosing incremental or differential backup as well as using snapshots to replace traditional backup. We also provide an overview of strategic considerations for backup in the age of the cloud as well as surveys of the key backup products for SMEs and enterprise deployment.

    Download

  • Developer’s guide to secure coding

    This 31-page eBook provides a roadmap to secure coding in practice. Inside, find a deep dive into common software vulnerabilities, how hackers exploit them, what you need to know to prevent a breach, and more.

    Download

  • Top 10 storage stories of 2019

    Computer Weekly's storage content decodes trends and offers practical and technical advice. So, looking at the key storage stories of 2019, we see all the main developments reflected.

    Download

  • CW APAC, November 2021: Expert guide to storage management

    In this handbook, Computer Weekly looks at how firms are rising to the storage challenge and Lenovo's viewpoint on the Asia-Pacific region's market opportunities

    Download

  • Lower your TCO with serverless applications

    Serverless applications can save up to 68 percent of development costs by automatically allocating compute on a pay-for-use basis. Read the Deloitte whitepaper Determining the Total Cost of Ownership: Comparing Serverless and Server-based Technologies to learn more.

    Download

  • NAS meets cloud and unstructured data challenges

    NAS file access storage has progressed to meet the challenges of the cloud era. This e-guide provides key insights into NAS as we know it in the era of cloud and big, unstructured data sets.

    Download

  • Turn Retail Data into a Competitive Advantage

    The right data strategy can enable your retail business to optimize processes, reduce costs, delight customers—and gain a critical advantage over your competitors. Unfortunately, most retailers today aren’t leveraging the full business value of their data. Access this e-book to learn more.

    Download

  • Turn retail data into a competitive advantage

    The right data strategy can enable your retail business to optimize processes, reduce costs, delight customers—and gain a critical advantage over your competitors. Unfortunately, most retailers today aren’t leveraging the full business value of their data. Access this e-book to learn more.

    Download

  • Data quality maturity guide: Benchmark your progress

    This guide examines the Data Quality Maturity Curve to offer an experienced perspective on where you should be at each point in your data quality journey. Browse the guide to benchmark your company’s data maturity progress.

    Download

  • CW Nordics August 2018

    In April 2017, the Swedish capital Stockholm was the scene of a terrorist attack which saw a truck used as a weapon on a pedestrianised street. It left five people dead and 14 seriously injured.

    Download

  • Computer Weekly - 1 June 2021: The technology that enabled Covid-19 genome sequencing success

    In this week's Computer Weekly, we talk to the scientists behind the UK's gene sequencing work during the coronavirus pandemic to find out how cloud and data analytics enabled their success. It's three years since GDPR entered into law – we assess its progress. And we examine low-code software development for a small business. Read the issue now.

    Download

  • CW APAC buyer's guide to cloud security

    In this buyer's guide, Computer Weekly offers advice on making cloud security choices, looks at how to guard against DDoS attacks, and finds out Amazon's approach to building secure cloud products.

    Download

  • Cloud storage hits hybrid mainstream

    In this e-guide, we take an in-depth look at what is pushing cloud, and more specifically hybrid cloud, into the mainstream and how the rise of cloud applications has driven innovations in backup, with data protection of cloud assets to the cloud arising.

    Download

  • Computer Weekly – 25 June 2019: Saving bees with the internet of things

    In this week's Computer Weekly, we find out how internet of things technologies and "smart hives" are helping bee conservation. We examine Facebook's new digital currency, Libra, and analyse its pros and cons. And we look at how IT leaders are rising to the challenge of delivering ethics and sustainability in tech. Read the issue now.

    Download

  • Migrating Oracle to AWS: Everything you need to know

    Download this e-book for real-world perspectives on the critical considerations for migrations to AWS, and find out how to evaluate these criteria to develop your Oracle on AWS cloud strategy.

    Download

  • FAQ: Hadoop for BI and Analytics

    Because it's a relatively new technology, Hadoop is surrounded by many myths and most IT professionals have little to no experience with the big data platform. This expert E-Guide aims to dispel common Hadoop misconceptions and offers advice for how to utilize it to drive big data analytics success.

    Download

  • The fastest ways to access both active and archived data

    To help organizations optimize their hybrid-cloud strategy, NetApp and Spectra Logic have partnered to offer the most cost-effective, secure, and efficient solution for cold data storage, a solution that’s compatible with Standard S3 and Amazon S3 Glacier. Learn more in this product overview.

    Download

  • Essential Guide: Optimising hybrid IT infrastructure

    In this essential guide, we include articles looking at best practice and key technologies in server, storage, networks, DevOps and hyperconverged systems to make the most of your hybrid IT.

    Download

  • Real-time analytics possible fuel for post Covid pandemic growth

    Real-time analytics promises the last word in business agility. There is obvious business value in being able to react immediately to changing patterns in customer behaviour or to prevent problems ahead of time, to give but two examples. And becoming more real-time could be an element in accelerating economic growth beyond the pandemic.

    Download

  • The complete guide to becoming a data-driven organization

    Rapid modernisation in the cloud is the most direct path to reaping the benefits of the analytics and machine learning technologies that can position an organisation as a market leader. So, what are you waiting for? Read on to learn how you activate your vast stores of data to enable higher customer acquisition rates and increased profits.

    Download

  • The Ultimate Guide to Collaboration for Small and Mid-Market Businesses

    With it being predicted that 36.2 million Americans will be working remotely by 2025, it has become critical for organizations to ensure that their collaboration solutions meet modern standards. But how can this best be done? Browse this e-book to learn more.

    Download

  • A Computer Weekly E-guide to NAS

    In the guide we look at the fundamentals of NAS and the use cases it best suits, the range of file access storage products available including in the cloud and in hybrid operation between cloud and datacentre. We also examine the question of NAS backup, looking at the challenges that have accompanied it and the solutions available.

    Download

  • CW Europe – September 2018: Costs stack up for Dutch government IT projects

    In this issue of CW Europe, we look at analysis by a Dutch newspaper which discovered that government-controlled IT projects in the Netherlands go over budget by 40%, on average. We also find out how Berlin's Digital Career Institute is building web skills among refugees and the unemployed across Germany.

    Download

  • CW Benelux ezine August 2018

    It's hardly surprising that the Netherlands is pioneering smart cities. The tech-savvy nation is already planning to have a digital port in Rotterdam with automated ships. Now, according to one Dutch academic, "almost every Dutch municipality is doing something with smart technology".

    Download

  • Computer Weekly – 17 November 2020: How Mastercard is taking digital payments into a new era

    In this week's Computer Weekly, we talk to Mastercard about how the credit card giant is using new technologies to take digital payments into a new era. After months of unprecedented uncertainty, we ask CIOs how they are planning for the next 12 months. And we examine how the growth in remote working will affect IT salaries. Read the issue now.

    Download