nvk: Allocate shaders from a heap

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Add a shader heap to nvk_device

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Return a VkResult from nvk_shader_upload()

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Add a heap data structure

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Rework nvk_queue_submit_simple()

This is a few changes rolled into one:

 1. Add a sync flag to force a stall before returning
 2. Re-order dw and push_dw_count to put the count first
 3. Take an array of extra BOs instead of just one

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

util/vma: Allow initializing zero-size heaps

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: WFI in pipeline barriers

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use meta for doing blits with the 3D hardware

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk/meta: Save/restore descriptor set 0

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Support load_layer_id

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

vulkan/meta: Implement vkCmdBlitImage()

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

vulkan/meta: Fixes for clear

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

vulkan/meta: Add a create_sampler helper

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

vulkan/meta: Add a helper for image view types

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

vulkan/meta: Add key types

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Properly implement robustBufferAccess

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Add lowering for load_global_constant_bounded

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: drop nvk_nir.h

Instead, move the definition of nvk_nir_lower_descriptors to
nvk_shader.h.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: use common pipeline layout code

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: use common descriptor set layout code

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Bring back push sync and dumping

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Also store the push BO map in nvk_queue_state

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Add an nvk_queue_submit wrapper

Instead of having the common queue code call into drm_nouveau code
directly, add a wrapper layer.  This gives us a place to put things like
command buffer dumping.  Importantly, we move calling
`vk_queue_set_error()` to this layer because it may abort if the
`VK_ABORT_ON_DEVICE_LOST` is set and we may want to dump before that
happens.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Embed a nv_device_info in nvk_physical_device

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Reference descriptor set layouts in the sets themselves

We need descriptor set layouts for vkUpdateDescriptorSets() but they
have different lifetimes.  This is the entire reason for doing reference
counting at all but we haven't actually set up the descriptor set code
to take references yet.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Implement VK_KHR_push_descriptor

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Fix up whitespace in nvk_descriptor_set.c

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use vk_object_zalloc/free for descriptor pools/sets

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Re-indent vk_instance.c

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau: Drop nouveau_ws_push

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau: Use DRM interfaces directly in MME tests

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Remove remaining references to nouveau_push.h

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Implement vkCmdExecuteCommands()

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use nvk_cmd_bo for push bufs

This allows us to recycle them.  It also makes implementing secondary
command buffers tractable.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Allocate upload buffers from the command pool

Instead of the growing BO thing

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Add an nvk_cmd_buffer_ref_bo helper

We only need this for internal stuff that isn't tracked any other way.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Add an nvk_cmd_buffer_push helper

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Rework side-band data upload

Instead of doing magic alignments, it now takes an explicit alignment
parameter.  Also, we now have a version of the helper which does the
memcpy.  This should encourage users to avoid reading reading upload
maps in case they're ever write-combine in the future.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Constant buffer alignment is actually 64B

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Fully populate QMDs before uploading

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: memcpy root descriptors for compute instead of doing a DMA

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Return VkResult from nvk_cmd_buffer_upload_alloc

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Add BO recycling to the command pool

Command BOs (nvk_cmd_bo) are automatically mapped recyclable BOs to use
for upload and push buffers.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use cmd instead of cmd_buffer

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Break nvk_cmd_pool into its own file

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use queue_submit_simple for zero_vram

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use submit_simple for draw state init

We also move it to being a queue function.  This architecturally makes
more sense even if it seems a bit redundant at first. Worst case, we
initialize multiple times but this guarantees that we're initialized by
the time we try to submit something.  It also doesn't matter now because
we only have the one queue.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Initialize the queue later in device setup

We basically want it at the end but before we set up meta.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Add an nvk_queue_submit_simple helper

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use a regular BO for the queue state push

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use a regular BO for the empty push

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Submit pushbufs directly

By getting rid of the winsys stuff we can batch everything into a single
ioctl which should be a bit more efficient.  It also simplifies BO
reference handling because we no longer need any of the save/restore
nonsense because we're the ones building the BO list, not the pushbuf
code.  This should be a lot more robust.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Move queue_sumbit to nvk_queue_drm_nouveau.c

We're about to start doing nouveau DRM specific stuff in here so let's
move it to a nouveau DRM specific file.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Always allocate empty_push

We always allocate it on queue_submit anyway so we may as well allocate
it up-front.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use bo_new_mapped for the zero page

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau: Add a nouveau_ws_bo_new_mapped helper

Error handling for allocating a bo and immediately mapping it is a pain.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use nv_push directly for graphics pipelines

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau: Move push dumping to nv_push.c

Because we need access to classes, we also add a basic device info
struct.  We'll expand on this a bit later.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau: Move push validate to nv_push.c

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/parser: Take a FILE* in DUMP_*_MTHD_DATA

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau: Move nv_push and helpers to their own header

We put this in nvidia-headers to separate it from the pushbuf stuff.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau: Rename the fields of vk_push

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau: Add an nv_push struct

This encapsulates the minimum we need for the push macros/functions.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use p for the nouveau_ws_push_buffer in zero_vram

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Implement vkCmdDraw[Indexed]Indirect()

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use MME for vkCmdDraw[Indexed]()

This lets us move the instance loop to the MME and stop emitting state
per-instance.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/mme: Add helper macros for setting fields

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use MME for clears

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Add MME infrastructure

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/mme: Add unit tests for the Turing+ MME simulator

These verify that its behavior is the same as the hardware.  Very useful
for reverse engineering.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/mme: Make the winsys headers C++ safe

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/mme: Add an isaspec-based dumper

This actually dumps everything, unlike the pretty printer which tries to
dump something readable and may ignore bits of instructions if it thinks
they're no-ops.  Useful for debugging the pretty printer.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/mme: Add a tiny simulator for the Turing+ MME

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/mme: Add a builder for the Turing+ MME

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/mme: Add an assembler and disassembler for the Turring+ MME

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/mme: Add isaspec XML for the Turing+ MME

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/mme: Add basic structures for the Turing+ MME

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/parser: Add more arrays

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/push: Fix a void pointer arithmetic bug

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nil: Don't claim texture support for 2-bit SNORM

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Increase the graphics pipeline push space

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use VK_IMAGE_USAGE_*_ATTACHMENT_BIT for image clears

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Drop a TODO

Dynamic buffer bindings work fine

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use f for extension features

It's shorter and more ergonamic and the driver is still small so we can
pick a reasonable convention before things get out-of-hand.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Fix unused result warnings in pushbuf resets.

We know we aren't hitting the resize paths here, so errors can't be
thrown.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Fix uninitialized result usage in NVK_DEBUG_ZERO_MEMORY.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Avoid strict aliasing warning in the pushbuffer encoding.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: fix zero page refing

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/parser: Put the dump helpers in C files

This should make the build faster since we don't have to compile those
giant functions with giant switch statements constantly.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/parser: Use more idiomatic python

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/parser: Convert to mako

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: alloc a zero page and use it for vertex runouts

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Initialize fixed draw/default state once

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Start every command buffer with a nop

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Split nvk_queue into its own file

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: fix mem leaks

device would leak in various situations.
Separate out lables were needed in the earlier
versions of this function but now we can just
use a single label

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: delete commented code

nvk_CmdClearColorImage first lived in nvk_cmd_copy,
then moved to nvk_cmd_meta, and finally in nvk_cmd_clear

I seems that this was left behind in one of the moves

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: fix implicit-fallthrough warnings with clang

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: use common physical device enumeration

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: fix OOB read inside nvk_get_va_format

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>