Raptor T2P9D01 User Manual

Summary of T2P9D01

  • Page 1

    T2p9d01 mainboard user's guide for system configuration and set up © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com.

  • Page 2

    Table of contents copyright and disclaimers............................................................................................5 safety information............................................................................................................6 electrical safety.....................

  • Page 3

    Bmc serial console............................................................................................................................................ 21 trusted platform module connector............................................................................................................

  • Page 4

    Secondary chassis fan header........................................................................................................................ 61 fan zones..............................................................................................................................62 connection...

  • Page 5

    Copyright and disclaimers copyright © 2017 – 2018 raptor computing systems, llc. All rights reserved. Product warranty or service will not be extended if: (1) the product is damaged by the consumer in any way, including any alterations that affect the operability of the feature or features being cla...

  • Page 6

    Safety information electrical safety • to reduce the risk of electric shock, disconnect the power cable before relocating or servicing the system. • when adding or removing devices to or from the system, ensure that the power cables for the devices are unplugged before the signal cables are connecte...

  • Page 7

    Notices federal communications commission statement this device complies with part 15 of the fcc rules. Operation is subject to the following two conditions: • this device may not cause harmful interference, and • this device must accept any interference received including interference that may caus...

  • Page 8

    Mainboard specifications processor 2x ibm power9 “sforza” socket (lga 2601) 4 - 24 core ibm power9 processors high speed xbus interconnect core logic direct attach pcie form factor eatx, 12” x 13” system features fan control y nominal fan zones 3 fan connectors 7 fan control driver max31785 / ast250...

  • Page 9

    Bmc 1x rs232 port on internal header 1x ttl port on internal header environmental requirements operation: 10°c - 35°c storage: -40°c - 70°c humidity: 20% - 90%, non-condensing note: specifications are subject to change without notice. © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide ...

  • Page 10

    Mainboard overview design the t2p9d01 has been specifically designed for applications requiring high security, high i/o capability, and large amounts of processing capability. Pcie slots and peripherals are directly connected to each cpu, therefore two cpus must be installed to use all pcie slots. ©...

  • Page 11

    Installation note: before you install this mainboard into your chassis, study the pattern of mounting studs, rear panel slots, and internal chassis components to ensure the mainboard fits correctly. There are 10 mounting holes available on the t2p9d01; ensure that your chassis provides studs for all...

  • Page 12

    Cpu installation and removal background the power9 cpu uses a unique retention mechanism designed to center-load the cpu in the socket and ensure good contact in the area of the central lands. This mechanism is spring loaded; a single 5/32” hex screw engages and disengages the retention system. The ...

  • Page 13

    Installation warning: both the cpus and the mainboard are static sensitive. Installation and removal of either cpu must take place in an appropriate anti-static environment. Carefully remove the protective cover, making sure not to touch any of the exposed socket pins. © 2017 - 2018 raptor computing...

  • Page 14

    Align the notches of the cpu with the protrusions on the socket, then carefully place the cpu in the socket. If no indium pad is present on the bottom of the heatsink assembly, carefully center an indium pad on top of the cpu. Place the heatsink assembly on top of the cpu, following instructions giv...

  • Page 15

    Using a 5/32” hex driver fully inserted into the retention mechanism screw, tighten the retention mechanism screw by turning the driver clockwise until a hard stop has been reached. Your cpu now is correctly installed. If you have a second cpu, repeat this process for the other socket. Removal remov...

  • Page 16

    Ram installation and removal population tables quantity slot population processor 1 processor 2 a1 b1 c1 d1 a2 b2 c2 d2 a1 b1 c1 d1 a2 b2 c2 d2 1 dimm x processor not installed 2 dimms x x 3 dimms x x x 4 dimms x x x x 5 dimms x x x x x 6 dimms x x x x x x 7 dimms x x x x x x x 8 dimms x x x x x x x...

  • Page 17

    Installation for maximum performance under typical workloads, ram should be populated according to the table above. Using proper anti-static procedures, locate the slot in which you want to install ram, then gently move the two retaining prongs away from the center of the slot until they reach a har...

  • Page 18

    Headers and connectors pin numbering conventions all headers on the tlp9d01 follow a standard layout, with pin 1 being denoted with a white silkscreen marking. Dual row headers follow the numbering convention shown above, where all even pins are on one side of the header and all odd pins are on the ...

  • Page 19

    Front panel j9800 pin function pin function 1 power button (active low) 2 ground 3 reset button (active low) 4 ground 5 +3.3v (main power) 6 fan fail led cathode 7 led anode +3.3v (main power) 8 fan fail led anode (+5v main power) 9 led anode +3.3v (standby power) 10 nic 2 link / activity led cathod...

  • Page 20

    13 identify button (active low) 14 hdd activity led cathode 15 +3.3v (main power) 16 power led cathode 17 key 18 key 19 nmi button (active low) 20 ground © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 20

  • Page 21

    Bmc serial console j7701 pin function pin function 1 dcd 2 rxd 3 txd 4 dtr 5 ground 6 dsr 7 rts 8 cts 9 nri 10 key © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 21.

  • Page 22

    Trusted platform module connector j10105 pin function pin function 1 lpc clock 2 ground 3 lpc frame (active low) 4 key 5 tpm reset (active low) 6 n/c 7 lpc address / data bit 3 8 lpc address / data bit 2 9 +3.3v (main power) 10 lpc address / data bit 1 11 lpc address / data bit 0 12 ground 13 i2c cl...

  • Page 23

    15 +3.3v (standby power) 16 lpc serial irq 17 ground 18 n/c 19 window open (active low) 20 bmc gpio b3 (active low) © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 23.

  • Page 24

    Flexver™ connector j10111 pin function pin function 1 rtc battery (+3.0v) 2 ground 3 +3.3v (standby power) 4 ground 5 +3.3v (main power) 6 module presence detect 1 (active low) 7 integrity loop 0 8 integrity loop 0 9 lpc address / data bit 3 (secure) 10 lpc address / data bit 0 (platform) 11 lpc add...

  • Page 25

    13 lpc address / data bit 1 (secure) 14 lpc address / data bit 2 (platform) 15 lpc address / data bit 0 (secure) 16 lpc address / data bit 3 (platform) 17 lpc serial irq (secure) 18 lpc serial irq (platform) 19 lpc frame (active low, secure) 20 lpc frame (active low, platform) 21 cpu 0 presence dete...

  • Page 26

    Occ mode j6912 pin function pin function 1 occ alert (active low) 2 ground (current limited) © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 26.

  • Page 27

    Bmc external reset header j7000 pin function pin function 1 n/c 2 bmc reset (active low) 3 ground © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 27.

  • Page 28

    Bmc ttl auxiliary serial header j10116 pin function pin function 1 ground 2 bmc com2 rxd (ttl) 3 bmc com2 txd (ttl) © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 28.

  • Page 29

    Bmc heartbeat indicator header j10114 pin function pin function 1 ground 2 bmc heartbeat led cathode © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 29.

  • Page 30

    Internal usb 3.0 header j10106 pin function pin function 1 +5.0v usb power (current limited) 2 superspeed rx (port 4, negative polarity) 3 superspeed rx (port 4, positive polarity) 4 ground 5 superspeed tx (port 4, negative polarity) 6 superspeed tx (port 4, positive polarity) 7 ground 8 hub (port 1...

  • Page 31

    11 hub (port 2, positive polarity) 12 hub (port 2, negative polarity) 13 ground 14 superspeed tx (port 3, positive polarity) 15 superspeed tx (port 3, negative polarity) 16 ground 17 superspeed rx (port 3, positive polarity) 18 superspeed rx (port 3, negative polarity) 19 +5.0v usb power (current li...

  • Page 32

    Bmc i2c port 5 j9602 pin function pin function 1 bmc i2c scl 2 ground 3 bmc i2c sda © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 32.

  • Page 33

    Bmc i2c port 6 j9603 pin function pin function 1 bmc i2c scl 2 ground 3 bmc i2c sda © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 33.

  • Page 34

    Planar vpd programming header j10104 pin function pin function 1 +3.3v (standby power) 2 scl 3 ground 4 sda © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 34.

  • Page 35

    Fpga programming header j10107 pin function pin function 1 ground 2 spi clock 3 spi mosi 4 spi miso 5 spi slave select (active low) 6 +3.3v (standby power) © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 35.

  • Page 36

    Fpga mode switch 1 j7800 pin function pin function 1 mode enable bit 1 (active low, pullup) 2 ground © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 36.

  • Page 37

    Chassis intrusion detect j9900 pin function pin function 1 intrusion detect (active low, pullup) 2 rtc battery (+3.0v, current limited) © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 37.

  • Page 38

    Fpga mode switch 2 j10109 pin function pin function 1 mode enable bit 2 (active low, pullup) 2 ground © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 38.

  • Page 39

    Pm8068 sas debug connector j1 pin function pin function 1 +1.8v (main power) 2 uart tx (port 0) 3 uart tx (port 1) 4 uart rx (port 0) 5 uart rx (port 1) 6 ground 7 reset (active low) 8 jtag tdi 9 jtag tms 10 jtag tclk © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all ...

  • Page 40

    11 jtag reset (active low) 12 jtag tdo © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 40

  • Page 41

    5v power j19511 pin function pin function 1 +5v (main power) 2 ground 3 ground © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 41.

  • Page 42

    Cpu 1 secure mode disable j1600 pin function pin function 1 n/c 2 secure mode disable (active high) 3 +1.1v (standby power, current limited) © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 42.

  • Page 43

    Cpu 2 secure mode disable j4300 pin function pin function 1 n/c 2 secure mode disable (active high) 3 +1.1v (standby power, current limited) © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 43.

  • Page 44

    Pmbus connector j10103 pin function pin function 1 i2c scl 2 i2c sda 3 alert (active low, open drain) 4 ground 5 +3.3v (main power) © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 44.

  • Page 45

    Cpu eps power connectors j10101 / j10102 pin function pin function 1 ground 2 ground 3 ground 4 ground 5 +12v (eps main power) 6 +12v (eps main power) 7 +12v (eps main power) 8 +12v (eps main power) © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved htt...

  • Page 46

    Atx power connector j10100 pin function pin function 1 +3.3v (main power) 2 +3.3v (main power) 3 ground 4 +5.0v (main power) 5 ground 6 +5.0v (main power) 7 ground 8 atx power good (active high) 9 +5.0v (standby power) 10 +12v (main power) © 2017 - 2018 raptor computing systems, llc t2p9d01 user's g...

  • Page 47

    11 +12v (main power) 12 +3.3v (main power) 13 +3.3v (main power) 14 no connection 15 ground 16 atx power enable (active low) 17 ground 18 ground 19 ground 20 no connection 21 +5.0v (main power) 22 +5.0v (main power) 23 +5.0v (main power) 24 ground © 2017 - 2018 raptor computing systems, llc t2p9d01 ...

  • Page 48

    Cpu 1 pci express slots j6100 / j6200 pin function pin function a1 ground b1 +12v (main power) a2 +12v (main power) b2 +12v (main power) a3 +12v (main power) b3 +12v (main power) a4 ground b4 ground a5 jtag tck (n/c, pull down) b5 smbus clock © 2017 - 2018 raptor computing systems, llc t2p9d01 user'...

  • Page 49

    A6 jtag tdi (n/c, +3.3v pull up) b6 smbus data a7 jtag tdo (n/c) b7 ground a8 jtag tms (n/c, +3.3v pull up) b8 +3.3v (main power) a9 +3.3v (main power) b9 jtag trst (n/c, pull down) a10 +3.3v (main power) b10 +3.3v (standby power) a11 pe reset (active low) b11 wake (active low) a12 ground b12 reserv...

  • Page 50

    A42 ground b42 lane 6 tx (n) a43 lane 6 rx (n) b43 ground a44 lane 6 rx (p) b44 ground a45 ground b45 lane 7 tx (p) a46 ground b46 lane 7 tx (n) a47 lane 7 rx (n) b47 ground a48 lane 7 rx (p) b48 presence detect (active low) a49 ground b49 ground a50 reserved (n/c) b50 lane 8 tx (p) a51 ground b51 l...

  • Page 51

    A78 ground b78 lane 15 tx (p) a79 ground b79 lane 15 tx (n) a80 lane 15 rx (n) b80 ground a81 lane 15 rx (p) b81 presence detect (active low) a82 ground b82 reserved (n/c) © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 51.

  • Page 52

    Cpu 2 pci express slots © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 52.

  • Page 53

    J6300 / j6400 / j6500 pin function pin function a1 ground b1 +12v (main power) a2 +12v (main power) b2 +12v (main power) a3 +12v (main power) b3 +12v (main power) a4 ground b4 ground a5 jtag tck (n/c, pull down) b5 smbus clock a6 jtag tdi (n/c, +3.3v pull up) b6 smbus data a7 jtag tdo (n/c) b7 groun...

  • Page 54

    A33 reserved (n/c) b33 lane 4 tx (p) a34 ground b34 lane 4 tx (n) a35 lane 4 rx (n) b35 ground a36 lane 4 rx (p) b36 ground a37 ground b37 lane 5 tx (p) a38 ground b38 lane 5 tx (n) a39 lane 5 rx (n) b39 ground a40 lane 5 rx (p) b40 ground a41 ground b41 lane 6 tx (p) a42 ground b42 lane 6 tx (n) a4...

  • Page 55

    A69 lane 12 rx (p) b69 ground a70 ground b70 lane 13 tx (p) a71 ground b71 lane 13 tx (n) a72 lane 13 rx (n) b72 ground a73 lane 13 rx (p) b73 ground a74 ground b74 lane 14 tx (p) a75 ground b75 lane 14 tx (n) a76 lane 14 rx (n) b76 ground a77 lane 14 rx (p) b77 ground a78 ground b78 lane 15 tx (p) ...

  • Page 56

    Cpu 2 micro pcie connector j10108 pin function pin function a1 +3.3v (main power) b1 n/c (reserved) a2 ground b2 ground a3 lane 0 rx (p) b3 lane 0 tx (p) a4 lane 0 rx (n) b4 lane 0 tx (n) a5 ground b5 ground © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights res...

  • Page 57

    A6 lane 1 rx (p) b6 lane 1 tx (p) a7 lane 1 rx (n) b7 lane 1 tx (n) a8 ground b8 ground a9 n/c (scl) b9 n/c (bp type) a10 n/c (sda) b10 n/c (wake) a11 ground b11 ground a12 pe reset (active low) b12 differential clock (p) a13 presence detect (active low) b13 differential clock (n) a14 ground b14 gro...

  • Page 58

    Cpu 1 fan header j7905 pin function pin function 1 ground 2 +12v (main power) 3 tachometer input 4 pwm output © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 58.

  • Page 59

    Cpu 2 fan header j7904 pin function pin function 1 ground 2 +12v (main power) 3 tachometer input 4 pwm output © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 59.

  • Page 60

    Primary chassis fan headers j7900 / j7901 / j7902 / j7903 pin function pin function 1 ground 2 +12v (main power) 3 tachometer input 4 pwm output © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 60

  • Page 61

    Secondary chassis fan header j10110 pin function pin function 1 ground 2 +12v (main power) 3 tachometer input 4 pwm output © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 61.

  • Page 62

    Fan zones connections the t2p9d01 supports three separate fan zones: zone 1: cpu 1 (1 fan) zone 2: cpu 2 (1 fan) zone 3: chassis (4 fans, fifth connector not monitored) note: at least one chassis fan providing airflow over the mainboard surface is strongly recommended. A minimum of 7cfm airflow over...

  • Page 63

    Usage initial power-on when first applying standby power to the t2p9d01, i.E., when the system is plugged in after being disconnected from power, the internal bmc needs to boot before any other operation request will be accepted. The status of this bmc boot is indicated by two front panel led patter...

  • Page 64

    To select an option, use the arrow keys to move the highlighted entry, then press to select the highlighted entry. Note that depending on your selected boot medium, you may need to edit the linux command line parameters before booting via the “e” command. Most current ppc64/ppc64el boot media assume...

  • Page 65

    The system connected to wall power. Transfer the bmc firmware image to the bmc /tmp/ directory using scp, then execute pflash -b -e -p /tmp/.Pnor to update the bmc firmware. Note: when updating early revisions of the bmc firmware, and to a lesser degree during any bmc firmware update, there is a pos...

  • Page 66

    Early boot device firmware introduction the t2p9d01 firmware allows device firmware to be installed in the main system pnor. Device firmware may be required for add-on card operation in the early boot process. Warning: we strongly recommend that you only use libre device firmware to provide continue...

  • Page 67

    Pflash -p bootkernfw -e © 2017 - 2018 raptor computing systems, llc t2p9d01 user's guide version 1.04 all rights reserved https://www. Raptorcs.Com 67.

  • Page 68

    Support getting help if you require assistance operating your t2p9d01, you may contact raptor computing systems technical support directly at support@raptorcs.Com . Alternatively, we also have a wiki and other support resources available online at https://www.Raptorcs.Com ; the information you requi...

  • Page 69

    Errata pcb version 1.00 er0001 µpcie connector (j10108) is incorrectly identified as oculink (sff-8621) due to errors that were discovered post-production in ibm openpower reference designs. While the physical connector is the same as oculink ports, the wiring is different, notably in the presence d...