As analytics platforms grow in scale and complexity onprem and in the cloud, maintaining efficiency is a critical challenge, and money is being wasted.

Learn more about Pepperdata Capacity Optimizer:
https://www.pepperdata.com/product/bi...

#analyticsperformancemanagement #bigdatainfrastructure #pepperdata

AUTOMATICALLY IMPROVE PERFORMANCE WITHOUT MANUAL TUNING

Pepperdata Capacity Optimizer runs continuously to improve the capacity utilization of existing clusters without manual tuning or intervention.

Pepperdata Capacity Optimizer automatically tunes and optimizes your cluster resources, recapturing wasted capacity so you can run more applications and get the most out of your infrastructure investment. Capacity Optimizer identifies where more work can be done to allow servers with available resources to run more tasks. This is accomplished by leveraging patented machine learning technology to monitor the entire infrastructure in realtime, including hardware and applications.
On a typical cluster, Capacity Optimizer makes hundreds and even thousands of decisions per second, increasing typical enterprise cluster throughput up to 50 percent. Even the most experienced operator dedicated to resource management can’t make manual configuration changes with the precision and speed of Capacity Optimizer.

OPERATOR BENEFITS
– Maximize your infrastructure investment
– Achieve up to 50 percent increase in throughput performance
– Ensure cluster stability and efficiency
– Avoid overspending on unnecessary hardware
– Reduce time spent on capacity planning
– Run more jobs concurrently on your existing infrastructure

DEVELOPER BENEFITS
– Run more jobs
– Access additional cluster capacity
– Spend less time in backlog queues

WITH PEPPERDATA CAPACITY OPTIMIZER, ENTERPRISES CAN:
– Maximize your existing infrastructure investment. Increase hardware utilization and eliminate or reduce millions of dollars in hardware costs.
– Autotune cluster resources for peak efficiency. Rightsize resource allocation based on actual realtime capacity.
– Eliminate inefficiencies and bottlenecks to ensure infrastructure stability
– Recapture wasted capacity to optimize cluster resources
– Run more applications
– Get the most out of your infrastructure investment
– Be confident that all YARN capabilities will remain intact.

More on the episode:

This video is a quick overview of the Pepperdata Capacity Optimizer. The Capacity Optimizer is an automated solution that continuously improves the performance of analytics clusters without manual intubation or application tuning.

Essentially, what you get is patented machine learning that is automatically tuning your analytics platform in a way that allows more work to get done over time with the existing hardware. The towel on the right of the screen is showing the number of tasks that are being run because the Capacity Optimizer is applying intelligent resource management to the platform.

Typically, what we see at the enterprise level and with very busy clusters, or with even growing clusters, is that you get a to 3050% increase in the throughput of a platform; meaning the nodes are able to do 30 to50 % percent more work than they could without Capacity Optimizer.

With this automatic tuning, what we're doing is we're managing the number of cores in the amount of memory available to the scheduler in realtime. And we're doing this so that we can free up resources that would be wasted by inefficient applications. If, for example, an application asks for 100 cores but only uses 20 cores, the scheduler can't leverage those 80 cores without, you know, some sort of intervention.

You have to retune the app, or you have to change the base allocations on the nodes. So, what we're doing with Capacity Optimizer is automatically viewing every running application, and informing the resource manager and schedulers what can be used despite what's been scheduled. So, essentially what we're doing is we're saying, “here's a view of the actual hardware”.

And you can look around the reservation system because that's not really telling you what's being used. So, with Capacity Optimizer the nodes in the example on screen would be roughly wasting about 40% of the RAM at peak, given the inefficiency of the applications in the platform...

Learn more about Pepperdata Capacity Optimizer:
https://www.pepperdata.com/product/bi...

Check out our blog: https://www.pepperdata.com/blog/'>https://www.pepperdata.com/blog/

/////////////////////////////////////////////////////////////////////////////////////////

Connect with us:
Visit Pepperdata Website: https://www.pepperdata.com/
Follow Pepperdata on LinkedIn:   / pepperdata  
Follow Pepperdata on Twitter:   / pepperdata  
Like Pepperdata on Facebook:   / pepperdata