Dynamic PCIe Bus AssignmentThe dynamic PCIe bus assignment feature enables you to dynamically assign or remove aPCIe bus from a root domain. The dynamic PCIe bus assignment feature is enabled whenyour system runs the required firmware and software. If your system does not run the requiredfirmware and software, the ldmadd-ioand ldmremove-iocommands fail gracefully. Whenenabled, you can run the ldmadd-ioand ldmremove-iocommands without stopping the rootdomain or putting the root domain in delayed reconfiguration.Dynamic PCIe bus assignment has these restrictions:■PCIe bus containing rKVMS devices is restricted to the primary domain only. This isenforced by the logical domains manager.■Direct I/O is not supported. All PCIe slots are directly connected to a PCIe root port.Related Information■Oracle VM Server for SPARC documentation (docs)■“Oracle VM Server for SPARC Overview” on page 27■“I/O Domain Resiliency” on page 28I/O Domain ResiliencyI/O domain resiliency improves the availability and performance of an I/O domain by enablingit to continue to run even when one of its associated root domains is interrupted. When a rootdomain is interrupted, the I/O domains that use its services continue to run by enabling itsaffected devices to fail over to the alternate I/O path. When the root domain returns to service,the affected devices in the resilient I/O domain are also returned to service and the failovercapabilities are restored.28SPARC M7 Series Servers Administration Guide • January 2017
Understanding Oracle Enterprise Manager Ops CenterI/O domain resiliency is a logical domain configuration strategy that involves:■Creating NPRDs to provide virtualized I/O services to the I/O domain. The NPRDs own atleast one PCIe bus from at least one CMIOU.■Creating virtualized I/O services from the NPRDs to the I/O domain. The I/O domain musthave at least two I/O connections with one of the connections coming from one IOH on oneCMIOU and the other connection coming from another IOH on a different CMIOU.■Creating alternate paths to the I/O connections by using multipathing.I/O domain resiliency has these restrictions:■Multipath I/O configurations are required for uninterrupted I/O services.■Current support is limited to SR-IOV devices.For this feature, follow these guidelines:■For fibre channel cards:■Generally, add cards in pairs for redundancy.■Spread the cards across IOHs.■Enable MPxIO in the service domain.■For NIC cards:■Generally, add cards in pairs for redundancy.■Use IEEE 802.3ad link aggregations in the service domain.■For InfiniBand cards:■Generally, add cards in pairs for redundancy.■Avoid sharing the PCI bus with other cards, if possible.