After porting a 5G pcie driver to NX (Jetpack5.0.2/JetPack4.6.1), kernel boot stucked
Mar 04, 2024
Hi NV_Team,
We have a PCIe 5G module and it can be found through ‘lspci’, after porting the 5g pcie driver to kernel, and flash to NX the kernel Image, then NX can’t bootup, here is the bootup uart log(JetPack5.0.2, we also tried JetPack4.6.x can’t bootup yet).
\0\0?
[0000.025] W> RATCHET: MB1 binary ratchet value 4 is larger than ratchet level 2 from HW fuses.
[0000.033] I> MB1 (prd-version: 2.3.0.0-t194-41334769-0a17edc1)
[0000.039] I> Boot-mode: Coldboot
[0000.042] I> Platform: Silicon
[0000.045] I> Chip revision : A02P
[0000.048] I> Bootrom patch version : 15 (correctly patched)
[0000.053] I> ATE fuse revision : 0x200
[0000.056] I> Ram repair fuse : 0x0
[0000.059] I> Ram Code : 0x2
[0000.062] I> rst_source: 0x0, rst_level: 0x0
[0000.067] I> Boot-device: QSPI (instance: 0)
[0000.071] I> Qspi flash params source = brbct
[0000.075] I> Qspi clock source : pllp
[0000.078] I> Qspi-0 initialized successfully
[0000.082] I> Boot chain mechanism: A/B
[0000.086] I> Current Boot-Chain Slot: 0
[0000.089] I> BR-BCT Boot-Chain: 0, status: 0. update flag: 0
[0000.094] I> Qspi flash params source = brbct
[0000.101] W> PROD_CONFIG: device prod data is empty in MB1 BCT.
[0000.108] I> Temperature = 54000
[0000.111] W> Skipping boost for clk: BPMP_CPU_NIC
[0000.115] W> Skipping boost for clk: BPMP_APB
[0000.120] W> Skipping boost for clk: AXI_CBB
[0000.123] W> Skipping boost for clk: AON_CPU_NIC
[0000.128] W> Skipping boost for clk: CAN1
[0000.131] W> Skipping boost for clk: CAN2
[0000.136] I> Boot-device: QSPI (instance: 0)
[0000.140] I> Qspi flash params source = mb1bct
[0000.144] I> Qspi clock source : pllc_out0
[0000.148] I> Qspi-0 reinitialized
[0000.151] I> Qspi flash params source = mb1bct
[0000.164] I> Non-ECC region[0]: Start:0x80000000, End:0x100000000
[0000.171] W> Thermal config not found in BCT
[0000.179] W> MEMIO rail config not found in BCT
[0000.191] I> Qspi flash params source = mb1bct
[0000.204] I> Qspi flash params source = mb1bct
[0000.238] I> Qspi flash params source = mb1bct
[0000.802] I> Qspi flash params source = mb1bct
[0000.819] I> Qspi flash params source = mb1bct
[0000.858] W> Platform config not found in BCT
[0000.885] I> Qspi flash params source = mb1bct
[0000.910] I> MB1 done
\0?鄊ain enter
SPE VERSION #: R01.00.18 Created: Jan 29 2021 @ 14:18:27
HW Function test
Start Scheduler.
in late init
?
[0000.920] I> Welcome to MB2(TBoot-BPMP) (version: default.t194-mobile-1ca012e4)
[0000.920] I> DMA Heap @ [0x526fa000 - 0x52ffa000]
[0000.921] I> Default Heap @ [0xd486400 - 0xd48a400]
[0000.922] E> DEVICE_PROD: Invalid value data = 70020000, size = 0.
[0000.927] W> device prod register failed
[0000.931] I> gpio framework initialized
[0000.935] I> tegrabl_gpio_driver_register: register 'nvidia,tegra194-gpio' driver
[0000.942] I> tegrabl_gpio_driver_register: register 'nvidia,tegra194-gpio-aon' driver
[0000.950] I> No valid sdcard_params in mb1_bct
[0000.954] I> Boot_device: QSPI_FLASH instance: 0
[0000.959] I> qspi flash-0 params source = boot args
[0000.964] I> QSPI-0l initialized successfully
[0000.967] I> sdmmc-3 params source = safe params
[0001.367] I> sdmmc DDR50 mode
[0001.385] I> Found 41 partitions in QSPI_FLASH (instance 0)
[0001.402] W> Cannot find any partition table for 00000003
[0001.403] > PARTITION_MANAGER: Failed to publish partition.
[0001.419] I> Found 19 partitions in SDMMC_USER (instance 3)
[0001.420] I> Active Boot chain : 0
[0002.091] I> Relocating BR-BCT
[0002.092] > DEVICE_PROD: device prod is not initialized.
[0002.398] I> Relocating OP-TEE dtb from: 0x6bfff1d0 to 0x70050000, size: 1008
[0002.399] I> [0] START: 0x80000000, SIZE: 0x2f000000
[0002.399] I> [1] START: 0xaf010000, SIZE: 0x18bf0000
[0002.400] I> [2] START: 0xc7d00000, SIZE: 0xc0000
[0002.400] I> [3] START: 0xca000000, SIZE: 0x800000
[0002.401] I> dram_block larger than 80000000
[0002.403] I> [4] START: 0x100000000, SIZE: 0x380000000
[0002.415] I> Setting NS memory ranges to OP-TEE dtb finished.
[0002.418] I> found decompressor handler: lz4
[0002.809] I> EKB detected (length: 0x410) @ VA:0x52709400
[0002.811] I> Setting EKB blob info to OPTEE dtb finished.
銷OTICE: BL31: v2.6(release):4fa405dbd
NOTICE: BL31: Built : 20:16:55, Aug 10 2022
I/TC:
?
bpmp: init
bpmp: tag is 128431eec76692047e1ac1ebc0392266
sku_dt_init: not sku 0x00
銲/TC: Non-sec鈉lk_early initialized
鋟re e鈓ail_early initialized
鋢鈌use initialized
hwwdt initialized
鋞erna鈚194_ec_get_ec_list: found 45 ecs
鋖 DT found鈋c initialized
?鈜mon_setup_monitors: found 3 monitors
vmon initialized
?
鈇dc initialized
fmon_populate_monitors: found 73 monitors
fmon initialized
mc initialized
reset initialized
nvhs initialized
uphy_early initialized
emc_early initialized
392 clocks registered
clk initialized
io_dpd initialized
thermal initialized
thermal_mrq initialized
i2c initialized
vrmon_dt_init: vrmon node not found
vrmon_chk_boot_state: found 0 rail monitors
vrmon initialized
regulator initialized
avfs_clk_platform initialized
soctherm initialized
aotag initialized
powergate initialized
dvs initialized
pm initialized
suspend initialized
pg_late initialized
pg_mrq_init initialized
strap initialized
nvl initialized
emc initialized
emc_mrq initialized
clk_dt initialized
tj_init initialized
uphy_dt initialized
uphy_mrq initialized
uphy initialized
ec_swd_poll_start: 281 reg polling start w period 47 ms
ec_late initialized
hwwdt_late initialized
reset_mrq initialized
ec_mrq initialized
fmon_mrq initialized
clk_mrq initialized
avfs_mrq initialized
mail_mrq initialized
i2c_mrq initialized
tag_mrq initialized
console_mrq initialized
mrq initialized
clk_sync_fmon_post initialized
銲/TC: OP-TEE version: 3.16 (gcc version 9.3.0 (Buildroot 2020.08)) #2 Thu Aug 11 03:鈉lk_dt_late initialized
?鈔oc_late initialized
?鈖m_post initialized
dbells initialized
?20鈊mce initialized
cvc initialized
?UTC 2022 aar鈇vfs_clk_mach_post initialized
鋍h64鈇vfs_clk_platform_post initialized
?
鈉vc_late initialized
regulator_post initialized
銲/T鈘m initialized
console_late initialized
clk_dt_post initialized
mc_reg initialized
銫: WARNING: This OP-TEE configuration 鈖g_post initialized
profile initialized
fuse_late initialized
extras_post initialized
entering main console loop
] bpmp: init complete
鋗ight be insecure!
I/TC: WARNING: Please check https://optee.readthedocs.io/en/latest/architecture/porting_guidelines.html
I/TC: Primary CPU initializing
I/TC: Primary CPU switching to normal world boot
?
[0003.438] I> Welcome to NVDisp-Init
[0003.438] I> NVDisp-Init version: t194-f9ecfedc
[0003.439] I> CPU-BL Params @ 0xca020000
[0003.439] I> 0) Base:0x00000000 Size:0x00000000
[0003.439] I> 1) Base:0xc8300000 Size:0x00100000
[0003.440] I> 2) Base:0xc9800000 Size:0x00200000
[0003.440] I> 3) Base:0xc8600000 Size:0x00200000
[0003.442] I> 4) Base:0xc8200000 Size:0x00100000
[0003.447] I> 5) Base:0xc8100000 Size:0x00100000
[0003.451] I> 6) Base:0xc9400000 Size:0x00400000
[0003.456] I> 7) Base:0xc9000000 Size:0x00400000
[0003.460] I> 8) Base:0xc8000000 Size:0x00100000
[0003.465] I> 9) Base:0xc7f00000 Size:0x00100000
[0003.469] I> 10) Base:0xca800000 Size:0x00800000
[0003.474] I> 11) Base:0x40000000 Size:0x00040000
[0003.478] I> 12) Base:0xc7e00000 Size:0x00100000
[0003.483] I> 13) Base:0x40046000 Size:0x00002000
[0003.487] I> 14) Base:0x40048000 Size:0x00002000
[0003.492] I> 15) Base:0xaf000000 Size:0x00004000
[0003.496] I> 16) Base:0x4004a000 Size:0x00002000
[0003.500] I> 17) Base:0xc7c00000 Size:0x00100000
[0003.505] I> 18) Base:0x4004c000 Size:0x00002000
[0003.509] I> 19) Base:0xc9a00000 Size:0x00600000
[0003.514] I> 20) Base:0x4004e000 Size:0x00002000
[0003.518] I> 21) Base:0xc7dc0000 Size:0x0000c000
[0003.523] I> 22) Base:0x00000000 Size:0x00000000
[0003.527] I> 23) Base:0xc7de0000 Size:0x00020000
[0003.532] I> 24) Base:0xcc000000 Size:0x02000000
[0003.536] I> 25) Base:0x40050000 Size:0x00002000
[0003.541] I> 26) Base:0x40040000 Size:0x00006000
[0003.545] I> 27) Base:0xc8c00000 Size:0x00400000
[0003.550] I> 28) Base:0xc8400000 Size:0x00200000
[0003.554] I> 29) Base:0xc8800000 Size:0x00400000
[0003.558] I> 30) Base:0xc7dd0000 Size:0x00010000
[0003.563] I> 31) Base:0x00000000 Size:0x00000000
[0003.567] I> 32) Base:0xf8000000 Size:0x08000000
[0003.572] I> 33) Base:0xce000000 Size:0x2a000000
[0003.576] I> 34) Base:0xcb000000 Size:0x01000000
[0003.581] I> 35) Base:0xae000000 Size:0x01000000
[0003.585] I> 36) Base:0xa0000000 Size:0x0e000000
[0003.590] I> 37) Base:0xca000000 Size:0x00800000
[0003.594] I> 38) Base:0x80000000 Size:0x20000000
[0003.599] I> 39) Base:0xb0000000 Size:0x08000000
[0003.603] I> 40) Base:0x00000000 Size:0x00000000
[0003.608] I> 41) Base:0x00000000 Size:0x00000000
[0003.612] I> 42) Base:0x00000000 Size:0x00000000
[0003.617] I> 43) Base:0x00000000 Size:0x00000000
[0003.621] I> 44) Base:0x00000000 Size:0x00000000
[0003.625] I> 45) Base:0x00000000 Size:0x00000000
[0003.630] GIC-SPI Target CPU: 0
[0003.633] Interrupts Init done
[0003.636] calling constructors
[0003.639] initializing heap
[0003.641] I> Heap: [0xa0960000 ... 0xadf00000]
[0003.646] initializing threads
[0003.648] initializing timers
[0003.651] creating bootstrap completion thread
[0003.656] top of bootstrap2()
[0003.658] CPU: MIDR: 0x4E0F0040, MPIDR: 0x80000000
[0003.663] initializing platform
[0003.666] E> DEVICE_PROD: Invalid value data = 0, size = 0.
[0003.671] W> device prod register failed
[0003.675] I> Bl_dtb @0xadf00000
[0003.678] I> gpio framework initialized
[0003.689] I> tegrabl_gpio_driver_register: register 'nvidia,tegra194-gpio' driver
[0003.695] I> tegrabl_gpio_driver_register: register 'nvidia,tegra194-gpio-aon' driver
[0003.701] I> fixed regulator driver initialized
[0003.715] I> register 'maxim' power off handle
[0003.717] I> virtual i2c enabled
[0003.717] I> registered 'maxim,max20024' pmic
[0003.718] I> tegrabl_gpio_driver_register: register 'max20024-gpio' driver
[0003.719] I> Boot-device: QSPI
[0003.722] I> Boot_device: QSPI_FLASH instance: 0
[0003.727] I> configure_qspi_clk: qparams clk_src = 5, clk_div = 0, clk_src_freq = 800000000, interface_freq = 50000000
[0003.737] I> configure_qspi_clk: FORCING INTERFACE_FREQ TO 133000000!!
[0003.745] I> QSPI source rate = 204000 Khz
[0003.748] I> Requested rate for QSPI clock = 34000 Khz
[0003.753] I> BPMP-set rate for QSPI clk = 34000 Khz
[0003.758] I> tx_clk_tap_delay : 0
[0003.761] I> rx_clk_tap_delay : 16
[0003.764] I> QSPI Flash Size = 32 MB
[0003.772] I> Qspi initialized successfully
[0003.772] I> qspi flash-0 params source = boot args
[0003.776] W> No board IDs available
[0003.779] E> Failed to get board id info!
[0003.785] I> sdmmc-3 params source = safe params
[0003.792] I> Found 41 partitions in QSPI_FLASH (instance 0)
[0003.794] W> Cannot find any partition table for 00000003
[0003.798] E> Failed to publish 00000003
[0003.804] I> Found 19 partitions in SDMMC_USER (instance 3)
[0003.826] I> regulator 'vdd-hdmi-5v0' already enabled
[0003.833] I> regulator 'vdd-hdmi-5v0' already enabled
[0003.833] I> hdmi cable connected
[0003.839] W> set volts not configured for 'vdd-1v0'
[0003.845] W> set volts not configured for 'vdd-1v8-hs'
[0003.845] I> retrieved tmds range from prod_list_hdmi_soc
[0003.852] E> invalid display type
[0003.854] E> cannot find any other nvdisp nodes
[0003.870] I> edid read success
[0003.882] I> edid read success
[0003.883] I> width = 640, height = 480, frequency = 25174825
[0003.883] I> width = 1920, height = 1080, frequency = 148500000
[0003.884] I> width = 1360, height = 768, frequency = 85500000
[0003.884] I> width = 720, height = 480, frequency = 27000000
[0003.884] I> width = 720, height = 576, frequency = 27000000
[0003.888] I> width = 640, height = 480, frequency = 25174825
[0003.894] I> width = 720, height = 480, frequency = 26973026
[0003.899] I> width = 1280, height = 720, frequency = 74175824
[0003.905] I> width = 1920, height = 1080, frequency = 148351648
[0003.911] I> width = 720, height = 576, frequency = 26973026
[0003.916] I> width = 1280, height = 720, frequency = 74175824
[0003.922] I> width = 1920, height = 1080, frequency = 148351648
[0003.928] I> width = 1920, height = 1080, frequency = 74175824
[0003.933] I> width = 1920, height = 1080, frequency = 74175824
[0003.939] I> Best mode Width = 1920, Height = 1080, freq = 148351648
[0003.950] I> hdmi_enable, starting HDMI initialisation
[0003.955] I> hdmi_enable, HDMI initialisation complete
[0003.965] initializing target
[0003.965] calling apps_init()
[0003.966] starting app kernel_boot_app
[0003.967] I> Kernel type = Normal
Jetson UEFI firmware (version 1.0-d7fb19b built on 2022-08-10T20:18:13-07:00)
e[2Je[04De[=3he[2Je[09D
** WARNING: Test Key is used. **
L4TLauncher: Attempting GRUB Boot
L4TLauncher: Attempting Direct Boot
L4T boot options
0: primary kernel
1: backup kernel
Press 0-1 to boot selection within 3.0 seconds.
Press any other key to boot default (Option: 0)
EFI stub: Booting Linux Kernel...
EFI stub: Using DTB from configuration table
EFI stub: Loaded initrd from LINUX_EFI_INITRD_MEDIA_GUID device path
EFI stub: Exiting boot services and installing virtual address map...
I/TC: Secondary CPU 1 initializing
I/TC: Secondary CPU 1 switching to normal world boot
I/TC: Secondary CPU 2 initializing
I/TC: Secondary CPU 2 switching to normal world boot
I/TC: Secondary CPU 3 initializing
I/TC: Secondary CPU 3 switching to normal world boot
I/TC: Secondary CPU 4 initializing
I/TC: Secondary CPU 4 switching to normal world boot
I/TC: Secondary CPU 5 initializing
I/TC: Secondary CPU 5 switching to normal world boot
ERROR: MPIDR 0x80000000: exception reason=0 syndrome=0xbe000000
ERROR: **************************************
ERROR: RAS Error in L2, ERRSELR_EL1=0x200:
ERROR: Status = 0xfc00630d
ERROR: IERR = SCF to L2 Decode Error Write: 0x63
ERROR: SERR = Illegal address (software fault): 0xd
ERROR: Overflow (there may be more errors) - Uncorrectable
ERROR: Uncorrectable (this is fatal)
ERROR: MISC0 = 0x100000000080000
ERROR: MISC1 = 0x40ac0000001
ERROR: ADDR = 0x8000000055c00000
ERROR: **************************************
ERROR: RAS error handled!
ERROR: sdei_dispatch_event returned -1
ERROR: MPIDR 0x80000001: exception reason=0 syndrome=0xbe000000
ERROR: Not a RAS error!
EUnhandled Exception in EL3.
x30 = 0x000000004000f184
x0 = 0x0000000000000103
x1 = 0x0000000000000204
x2 = 0x0000000000000003
x3 = 0x0000000000000001
x4 = 0x000000004001dc4a
x5 = 0x0000000000000040
x6 = 0x0000000000000001
x7 = 0x0000000000000004
x8 = 0x0000000000000008
x9 = 0x0000000000000000
x10 = 0x000000000000073d
x11 = 0x0000000000000040
x12 = 0x0000000000000010
x13 = 0x0000000000000003
x14 = 0x0000000000000000
x15 = 0x0000000000000000
x16 = 0x00000000d2721fcb
x17 = 0x0000000000000000
x18 = 0xffff7a8e0020d700
x19 = 0x000000004001db8a
x20 = 0x0000000000000004
x21 = 0x00000000be000000
x22 = 0x0000000000000000
x23 = 0x00000000400197c0
x24 = 0x0000000000000001
x25 = 0x0000000000000000
x26 = 0x0000000000000000
x27 = 0xffff7a8e0020d700
x28 = 0x0000000040017c00
x29 = 0x0000000040017ba0
scr_el3 = 0x000000000000073d
sctlr_el3 = 0x0000000030cd183f
cptr_el3 = 0x0000000000000000
tcr_el3 = 0x0000000080823518
daif = 0x00000000000003c0
mair_el3 = 0x00000000004404ff
spsr_el3 = 0x00000000200002cc
elr_el3 = 0x00000000400022d0
ttbr0_el3 = 0x000000004001dd81
esr_el3 = 0x00000000be000000
far_el3 = 0x0000000000000000
spsr_el1 = 0x0000000000000000
elr_el1 = 0x0000000000000000
spsr_abt = 0x0000000000000000
spsr_und = 0x0000000000000000
spsr_irq = 0x0000000000000000
spsr_fiq = 0x0000000000000000
sctlr_el1 = 0x0000000030d50820
actlr_el1 = 0x0000000000000001
cpacr_el1 = 0x0000000000000000
csselr_el1 = 0x0000000000000000
sp_el1 = 0x0000000000000000
esr_el1 = 0x0000000000000000
ttbr0_el1 = 0x0000000000000000
ttbr1_el1 = 0x0000000000000000
mair_el1 = 0x0000000000000000
amair_el1 = 0x0000000000000000
tcr_el1 = 0x0000000000000000
tpidr_el1 = 0x0000000000000000
tpidr_el0 = 0x0000000000000000
tpidrro_el0 = 0x0000000000000000
par_el1 = 0x0000000000000000
mpidr_el1 = 0x0000000080000200
afsr0_el1 = 0x0000000000000000
afsr1_el1 = 0x0000000000000000
contextidr_el1 = 0x0000000000000000
vbar_el1 = 0x0000000000000000
cntp_ctl_el0 = 0x0000000000000000
cntp_cval_el0 = 0x0000000000000000
cntv_ctl_el0 = 0x0000000000000000
cntv_cval_el0 = 0x0000000000000000
cntkctl_el1 = 0x0000000000000002
sp_el0 = 0x0000000040017ba0
isr_el1 = 0x0000000000000000
dacr32_el2 = 0x0000000000000000
ifsr32_el2 = 0x0000000000000000
actlr_el1 = 0x0000000000000001
gicc_hppir = 0x00000000000003ff
gicc_ahppir = 0x00000000000003ff
gicc_ctlr = 0x00000000000005eb
gicd_ispendr regs (Offsets 0x200 - 0x278)
Offset: value
0000000000000200: 0x0000000000000000
0000000000000204: 0x0000000000000000
0000000000000208: 0x0000000000000000
000000000000020c: 0x0000000000000000
0000000000000210: 0x0000000000000000
0000000000000214: 0x0000000000000000
0000000000000218: 0x0000000000000000
000000000000021c: 0x0000000000020000
0000000000000220: 0x0000000000000000
0000000000000224: 0x0000000000000000
0000000000000228: 0x0000000000000000
000000000000022c: 0x0000000000000000
0000000000000230: 0x0000000000000000
0000000000000234: 0x0000000000000000
0000000000000238: 0x0000000000000000
000000000000023c: 0x0000000000000000
0000000000000240: 0x0000000000000000
0000000000000244: 0x0000000000000000
0000000000000248: 0x0000000000000000
000000000000024c: 0x0000000000000000
0000000000000250: 0x0000000000000000
0000000000000254: 0x0000000000000000
0000000000000258: 0x0000000000000000
000000000000025c: 0x0000000000000000
0000000000000260: 0x0000000000000000
0000000000000264: 0x0000000000000000
0000000000000268: 0x0000000000000000
000000000000026c: 0x0000000000000000
0000000000000270: 0x0000000000000000
0000000000000274: 0x0000000000000000
0000000000000278: 0x0000000000000000
000000000000027c: 0x0000000000000000