Intel 3rd Gen Xeon Scalable Processors Memory Architecture

Intel 3rd Gen Xeon Scalable Processors Memory Architecture

How to maximize performance by ensuring memory modules are properly ordered and populated in Intel 3rd Gen Xeon Scalable Processors servers

Memory Architecture of 2nd Gen Intel Xeon Scalable Processor

with two memory controllers that managed three memory channels per controller. Each channel could accept 2 DIMMs in the channel. To calculate the total DIMMs that a processor could support, multiply the number of controllers by the number of channels by the number of DIMMs per channel. For the 2nd Generation Xeon, this equaled a total of 12 DIMMs that a single processor could address.

2nd Gen Intel Xeon Scalable Processors 2 controller 6 channel memory architecture

2nd Gen Intel Xeon Scalable Processors 2 controller 6 channel memory architecture

This memory controller ran at DDR4-2933 speeds with 1 DIMM per channel populated. The speed reduced to DDR4-2666 when populated with 2 DIMMs per channel or Optane Persistent Memory Modules. The optimal configuration for maximizing memory bandwidth populated the same number of identical modules per channel. A two-socket server featured up to 24 DIMMs, allowing for two maximum performance configurations:

This memory controller ran at DDR4-2933 speeds with 1 DIMM per channel populated. The speed reduced to DDR4-2666 when populated with 2 DIMMs per channel or Optane Persistent Memory Modules. The optimal configuration for maximizing memory bandwidth populated the same number of identical modules per channel. A two-socket server featured up to 24 DIMMs, allowing for two maximum performance configurations:

It should be noted that servers featuring 16 DIMMs exist for use cases requiring a total of 1TB of memory, but effective memory bandwidth was reduced by 34 percent due to an unbalanced configuration.

Memory Architecture of 3rd Gen Intel Xeon Scalable Processors

Each processor now has four memory controllers with two channels per controller. Each channel can be populated with two DIMMs. A 3rd Gen Xeon can address a total of 16 DIMMs per processor at full performance.

3rd Gen Intel Xeon Scalable Processors 4 controller 8 channel memory architecture

Each processor now has four memory controllers with two channels per controller. Each channel can be populated with two DIMMs. A 3rd Gen Xeon can address a total of 16 DIMMs per processor at full performance.

Each of the eight channels runs at DDR4-3200. This is regardless of the number of DIMMs per channel or if 200-series Optane Persistent Memory is populated. Improvements have also been made to the memory scheduler, lowering effective memory latency while increasing the overall bandwidth.

This new design results in a 2.6x increase in overall memory capacity and 1.5x increase in memory compared to 2nd Generation Xeon Scalable, without increasing read latencies at the local or remote socket layer. A two-socket server features up to 32 DIMMs and we still have two balanced memory configurations to choose from for maximum performance:

Each of the eight channels runs at DDR4-3200. This is regardless of the number of DIMMs per channel or if 200-series Optane Persistent Memory is populated. Improvements have also been made to the memory scheduler, lowering effective memory latency while increasing the overall bandwidth. This new design results in a 2.6x increase in overall memory capacity and 1.5x increase in memory compared to 2nd Generation Xeon Scalable, without increasing read latencies at the local or remote socket layer. A two-socket server features up to 32 DIMMs and we still have two balanced memory configurations to choose from for maximum performance:

3rd Generation Xeon Scalable allows for larger capacity memory configurations without sacrificing memory bandwidth. So do some basic considerations should be followed when planning server memory:

  • Memory modules must have identical specifications. Each DIMM must have an identical size, speed and rank.
  • Channels are identically populated with either one or two DIMMs.
  • Each CPU socket in the server must have an identical memory layout.

Scalable processors are available now in DellEMC PowerEdge 15G Servers, HPE ProLiant Gen10 Plus servers and Cisco UCS M6-series servers. We can accommodate virtually any use case or workload.

Monitor Your Server’s Health to Ensure Maximized Uptime

Monitor Your Server’s Health to Ensure Maximized Uptime

A boom in Information Technology in the last few years has resulted in an unprecedented growth in the use of the Internet across several users. Everyone depends on the Internet for their day-to-day operations, be it households or business organizations. It is a storehouse of information and is used by one and all. In addition, organizations remain connected to their clients and other third party stakeholders through the Internet. So it is quite natural for them to desire a smoothly running website and server so that it helps them in their work.

Importance of server
A server is a vital piece of equipment that acts as the support system of an organization. It stores all important information relating to the organization, its employees, clients, and customers. In addition, it helps the organization stay connected with the rest of the world by way of the Internet. Besides this, important functions like communication, website hosting, website maintenance, etc., are also performed by the server system of an organization.

Server uptime
Server uptime is the duration of time for which the server system can be left unattended without causing a disruption in the functioning of the organization. It is a measure of the reliability and stability of the server and helps the system administrators to know for how long the server will function without crashing.
Downtimes are very common and can happen to any computer system. Technical failures, faulty software, network problems, all these factors contribute to downtime or outages in the server system. These lead to disruptions in running a website or a server, causing losses to the company and inconvenience to the customers.

Monitor server health for server uptime maximization
Every organization desires a server that runs spontaneously. Hence, the target of every IT department should be to maximize server uptime to ensure that the server functions for the maximum time without suffering from downtime. Server uptime monitoring is aimed at server uptime maximization. In addition, it keeps a vigil on the server’s stability as to how long it can run without getting crashed.
Server health has to be monitored from time to time so that server uptime is maximized. In addition, server monitoring should be done regularly so that system administrators are alerted in case of any existing or upcoming problems and can fix them in time.

Hardware problems, lack of routine maintenance, network issues, improper designing by engineers, etc., can lead to server downtime. These have to be checked in advance to take necessary action to resolve these.
A server functioning without disruptions will ensure that the server can be left unattended for a more extended period. However, not in all cases is longer server uptime desirable. For example, there are some software or applications in which regular updates have to be done, and server uptime is reduced.

By ensuring a healthy server system, the organization can serve its clients better and see that the server is readily available for use by them. Monitoring your server’s health to ensure maximized uptime becomes a prime objective of any company.

Latest 3rd generation Xeon Scalable processor called Ice Lake

Latest 3rd generation Xeon Scalable processor called Ice Lake

Processor:

The 10 nanometer-based CPU is delivering up to 40 cores per processor.

The processors also add Intel SGX (Software Guard Extensions) for built-in security, as well as Intel Crypto Acceleration. It includes Intel’s DL Boost for AI acceleration.

  • AI acceleration: 

    Intel says that with hardware and software optimizations, Ice Lake delivers 74 percent faster AI performance compared with the prior generation. Compared to the third-generation AMD Epyc 7763, Intel says the platform delivers up to 1.5 times higher performance across a broad mix of 20 popular AI workloads. Compared to the Nvidia A100 GPU, it says it delivers up to 1.3 times higher performance on a broad mix of 20 popular AI workloads.

  • Built-in security:

    Intel SGX, and security has the technology can protect as much as 1 terabyte of code and data in private memory areas called enclaves.

    Ice Lake chips also feature cryptographic acceleration that promises to let the chip deliver both security and performance.

  • Intel Ice Lake vs. Intel Cascade Lake

Some of the key differences between Intel’s new 3rd gen Xeon CPUs with Intel’s 2nd gen Xeon Scalable processors. The below table highlights the processor architecture, cache latencies, memory controller, memory latency, and capacity.

Latency Intel Xeon Platinum 8380 Processor (Ice Lake) Intel Xeon Platinum 8280 Processor (Cascade Lake)
L1 hit cache, cycles 5 4
L2 hit cache, cycles 14 14
L3 hit cache (same socket) 21.7 20.2
L3 hit cache (remote socket) 118 180
Memory Controller On die – 8 ch On Die – 6ch
 

Max DIMM Capability

2 DPC 3200/2933/2666 New: PMem (SKU dependent) runs at memory channel speed 1 DPC 2933/2 DPC 2666 (SKU dependent)
DRAM read latency local socket 85 81
DRAM read latency remote socket 139 138
Max Memory Capacity per Socket 6TB (DDR+PMem). 4TB (DDR) 4.5 TB (DDR+PMem). 3TB (DDR)

RAM:

The platform supports up to six terabytes of system memory per socket, up to eight channels of DDR4-3200 memory per socket, and up to 64 lanes of PCIe Gen4 per socket.

Ice Lake delivers an average 46 percent performance increase on popular data center workloads

Network:

Intel produces network-optimized “N-SKUs” to support diverse network environments. The new processors deliver on average up to 62 percent more performance on a range of broadly-deployed network and 5G workloads over the prior generation, Intel says. More than 15 major telecom equipment manufacturers and communications service providers are readying POCs and networking deployments with Ice Lake.

Workload:

Ice Lake delivers up to 1.56 times more AI inference performance for image classification than the prior generations, Intel says. This makes it suitable for AI, complex image or video analytics, and consolidated workloads at the edge.

Intel Optane SSD Storage:

Intel increased the capacity of the drive which started at 375GB, tops at 1.5TB. Optane SSDs perfect companion for slower media. we primarily designed for endurance and frequently used in a two-tier architecture. Optane SSDs are often set up to absorb all of the writes in a system, protecting larger, slower media behind it. These can be QLC SSDs for instance, that perform well for read-heavy workloads, but don’t have much endurance or write performance.

vSAN, Azure HCI, StorONE, and many others are well adept at making multi-tier work well.

PMem: Intel Optane Persistent Memory

A way to bridge the gap between volatile DRAM and high-performance SSDs. PMem 200 is quoted to deliver 32% more memory bandwidth than Gen1. New modules are optimized for the new 3rd Gen Intel Xeon Scalable Processors, making the combination, with Intel SSDs.

In the memory bandwidth throughput, with PMem 200 picking up 3,200 MT/s support.

Core count starts at 16 cores and goes up to 40. With the first PMem, users could add 3TB of PMem for a total memory per socket of 4.5TB, now the total is 6TB per socket, with 4TB of PMem 200 being added. The maximum thermal design power dropped from 18W to 15W. And the newest persistent memory comes with eADR, extended Asynchronous DRAM Refresh.

The MemVerge Memory Machine management interface can help administrators through a number of use cases:

Crash recovery:

The snapshot GUI is used to quickly bring back the database and/or troubleshoot the cause. The database log and Memory Machine Dashboard data determine the time of the crash, allowing the admin to select and restore a snapshot that is closest to the crash time. Developers can then use that restored instance for debugging.

Accelerating Animation & VFX with Memory DVR:

Animation:

Artists want to explore different options on a base Maya scene. They load the base scene, apply the changes, and save it as a different project. They can save many separate scenes, but to show these options they must be repetitively reloaded, which takes a long time.

With Memory DVR functionality, load a base scene once, take a snapshot as the basic snapshot, then apply changes and take another snapshot. To apply a different effect, simply restore the snapshot, edit, and take another snapshot. The restore speed of in-memory snapshots is a few seconds compared to minutes for reloading scenes from storage.

Accelerating Genomic Analytics with Memory DVR:

Scientists want to experiment with a machine learning algorithm using different parameter settings. They load the data, set the parameter, run the algorithm, and check out the results. if the results are not good, the data is reloaded, a different set of parameters is applied, and the algorithm is run again.

With Memory DVR functionality, load the data once and take a snapshot. From that point on, if the results are not good, restore the base data and another run with new parameters is done in seconds.

Intel Agilex FPGAs that leverage PCIe Gen4.

Intel Agilex FPGA family leverages heterogeneous 3D system-in-package (SiP) technology to integrate Intel’s first FPGA fabric built on 10nm process technology and 2nd Gen Intel Hyperflex FPGA Architecture to deliver up to 40% higher performance1 or up to 40% lower power1 for applications in Data Center, Networking, and Edge compute.

Workloads:

VDI, databases, AI and machine learning, Cloud, big data, HPC and Analytics.

About us

Navigator System offers end-to-end data center maintenance services that allow you to extend the life of your IT assets.

MANAGED IT SERVICES are

  • 24×7 Field Services & Technical Support
  • Multi-Vendor Maintenance Programs (NetGuard)
  • Cloud & Network Migration Services
  • Monitoring & Infrastructure Management
  • Consulting & Project Management Services
  • Network Security
  • Network Lifecycle Management
  • Asset Recovery Programs
  • Spares Management & Repairs for AMC contracts
  • Materials Management & Reverse Logistics for AMC contracts

CONTACT:

Call our Sales Team: +91 9986288377
Email: sales@navigatorsystem.com

Azure VMware Solution (AVS) | NSPL Cloud Migration

Azure VMware Solution (AVS) | NSPL Cloud Migration

Azure VMware Solution (AVS) Migration

Migrate and modernize your VMware workloads to VMware on Azure with NSPL expert Cloud Migration Services

Fixed-Price Cloud Migration Services for VMware on Azure

You can now get scale, automation and fast provisioning for your VMware workloads on global Azure infrastructure with NSPL specialist Azure VMware Solution (AVS) Services and Product Capability.

  • Run your application workloads in a familiar, tried and trusted environment
  • Maintain your investment in VMware vSphere (people, process and technology)
  • Benefit from the scalability, automation and DevOps that Public Cloud offers

From discovery & assessment through migration delivery and post-migration validation, NSPL bears the risk and the reward of delivery at a price point that is unmatched in the marketplace.

TALK TO NSPL CLOUD MIGRATION EXPERT: +91 9986288377

About us: Navigator System provides fast, reliable, and affordable Infrastructure Solution and Professional Services for both SMBs and large enterprises. Built with best class Solution and support in mind, NSPL offers enterprise-grade level functionality, while being lightweight and easy to to protect their critical data in virtualized and hybrid environments.

NSPL Vmware solution offers you complete suite of backup, replication, and recovery features for physical, virtual, and cloud environments. By providing you with great flexibility and multiple automation options, VMWare solution saves you time and resources, allowing you to direct your attention elsewhere.