nvk/queue: add support for syncobjs and sparse binds

Reviewed-by: Faith Ekstrand <faith.ekstrand@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Add support for sparse images

Reviewed-by: Faith Ekstrand <faith.ekstrand@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Add support for sparse buffers

Reviewed-by: Faith Ekstrand <faith.ekstrand@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/mme: Support the new UAPI

Reviewed-by: Faith Ekstrand <faith.ekstrand@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/winsys: add support for the vma bind interfaces

Reviewed-by: Faith Ekstrand <faith.ekstrand@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: always sync internal cmd bufs for vma lifetimes.

We always sync on the internal push buf submissions for zero vram
and ctx setup, these shouldn't be bottlenecks.

Reviewed-by: Faith Ekstrand <faith.ekstrand@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/shim: Use the imported nouveau_drm.h headers

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use the imported nouveau_drm.h headers

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/winsys: Use the imported nouveau_drm.h headers

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

drm-uapi: Import nouveau_drm.h

From https://cgit.freedesktop.org/drm-misc/

    commit e02238990b1ab2dfc8abb4c28369f1da6e863f81
    Author: Danilo Krummrich <dakr@redhat.com>
    Date:   Fri Aug 4 20:23:43 2023 +0200

        drm/nouveau: new VM_BIND uAPI interfaces

Signed-off-by: Faith Ekstrand <faith.ekstrand@collabora.com>
Reviewed-by: Karol Herbst <kherbst@redhat.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau: Move shader topology info to nv_device_info

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Decorate CmdBegin/EndRendering entrypoints

These decorations are necessary for proper building on Android and
Windows.  You don't notice them in regular Linux builds, though.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Implement GetRenderingAreaGranularityKHR

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Implement CmdBindIndexBuffer2KHR

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use VkBufferUsageFlags2

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Implement the maintenance5 image layout queries

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Rework memory requirements to handle aspects correctly

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Misc. style nits

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: enable EXT_depth_clip_enable

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: enable EXT_depth_clip_control

This is already handled in the dynamic state.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Implement CopyQueryPoolResults with a compute shader

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Separate the MME query copy code out a bit

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Enable the SPIR-V DeviceGroup capability

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Add support for variable pointers

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Add a root_desc_addr to the root descriptor table

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use nvk_root_descriptor_offset for drawInfoBase

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Rework multi-plane format features a bit

We need to avoid returning certain feature flags such as rendering or
storage from vkGetPhysicalDeviceFormatFeatures*() but still allow those
for single-plane views of the image which means allowing them in
vkGetPhysicalDeviceImageFormatProperties*().

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Improve image format properties and limits

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/nvk: Enable VK_KHR_sampler_ycbcr

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/nvk: Add multiple sampler planes for CONVERSION_SEPARATE_RECONSTRUCTION_FILTER_BIT

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/nvk: Create helper function for sampler creation

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/nvk: Support multi-plane descriptors in nvk_nir_lower_descriptors.c

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/nvk: Add YCbCr sampler NIR lowering pass

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use the new NIL helper for image level extents for copies

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nil: Add a nil_image_level_extent_px() helper

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: enable rgb32 texel buffer support

This is needed for zink.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Disable shaderStorageImageReadWithoutFormat pre-Maxwell.

On Kepler and earlier, image loads must get lowered based on the declared
format, since we don't have a SULDP op.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau: Drop GART size from nv_device_info

The kernel always returns something rediculously high, like 40 bits or
something.  There's really no point in us tracking it.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/codegen: Do not keep redundant info for tessellation domain

Just add an assert instead.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Do not keep redundant info for tessellation domain

This is not needed after merge_tess_info that or's the info of both the
tesc and tese shaders.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: fix independent color write masks.

This fixes:
dEQP-VK.renderpass.suballocation.attachment_write_mask.attachment_count_*

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

docs/relnotes: Stick something about NVK in new_features.txt

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

docs: Add NVK to features.txt

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

docs: Add a docs page for NVK

Reviewed-by: Adam Jackson <ajax@redhat.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Don't skip zero-size bindings in GetDescriptorSetLayoutSupport

We still need to handle them in the case of variable descriptor counts.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: align geometry clip setting with nvc0

This fixes
dEQP-VK.clipping.clip_volume.depth_clamp.point_list,Fail
dEQP-VK.clipping.clip_volume.depth_clip.point_list,Fail

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Flush more state on VI_BINDINGS_VALID dirty

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Bind 3D depth/stencil images as 2D arrays

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk/tess: don't emit patch control points in pipeline

Let the dynamic state thing emit these.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

vulkan/meta: Use vk_meta_get_pipeline_layout in blit/resolve

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

vulkan/meta: Add a get_pipeline_layout helper

This helper handles the cache lookup and constructs a pipeline layout
and a descriptor set layout, as needed, all in one go.  This saves a bit
of boilerplate in the various meta functions.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

Revert "vulkan: Allow scissors or viewports to be set without counts"

This reverts commit b551f26a0caad52de620222e2df8416e80332943.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use the new core vk_sampler struct

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: enable fp helper invocations loads on more gens

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Require an environment variable for poorly tested hardware

We really only know that Turing and Ampere work right now.  Maxwell has
recieved some testing but still can't survive a CTS run.  Other hardware
is even less well tested.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau: fix max_warps_per_mp_for_sm for builds with asserts disabled

Fixes: 1b756be2bca ("nvk: properly calculate SLM region by taking per arch limits into account")
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: properly calculate SLM region by taking per arch limits into account

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: replace mp with tpc

The tls space is calculate per TPC, but nouveau also doesn't report the MP
count to us, but the TPC count instead.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: fix num_gprs for Volta+

Fixes OOR_REG errors being thrown

Signed-off-by: Karol Herbst <git@karolherbst.de>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Implement VK_EXT_physical_device_drm

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Don't enumerate pre-Kepler GPUs

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Move the winsys device to nvk_device

Vulkan requires that different VkDevices be unable to affect each other.
To correctly provide this invariant, each VkDevice really needs its on
virtual address space.  This means opening a new nouveau_device per
nvk_device.  This may make device creation a tiny bit less efficient but
we can fix that with some sort of caching if we absolutely need to.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Add a ws_dev to nvk_device and use it

At the moment, this is just a convenient short-hand but we're about to
permanently move the nouveau_ws_device to nvk_device so it will be the
only way to access it soon.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Rename nvk_device::ctx to ws_ctx

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use nv_device_info for class checks

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau: Move gart_size to nv_device_info

This is more complicated than the others since it is a calculated value.
For nv_device_info struct, we want the raw version that raw query from
the chip.  We move the calculation into nvk_create_drm_physical_device().

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau: Move more stuff into nv_device_info

The device_id and is_integrated fields in nouveau_device can be dropped
entirely since they're redundant with nv_device_info::device_id and
nv_device_info::type.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Set deviceType based on nv_device_info::type

The is_integrated bool is based on VRAM size which is a bit clunky and
not really what the Vulkan query means.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau: Stop using hex for SM numbers

There's no indication that NVIDIA considers this to be anything other
than a decimal number.  Much to the contrary, the number of 5s and 9s in
the SM number table implies they very much are base 10.  Given that
Lovelace is SM90, we'll likely be hitting 100 fairly soon at which point
this will stop fitting in a uint8_t.  Switch to decimal to compress it
down a bit.

Also, rename the field to SM which beter matches the NVIDIA docs and
ensures that there are no users of this which are likely to be confused.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau: Put PCI info in a pci substruct in nv_device_info

We separate out device_id because even non-PCI devices have one.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Only advertise EXT_pci_bus_info on discrete GPUs

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Drop nvk_physical_device::instance

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use canonical variable names in nvk_sampler.c

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use canonical variable names in nvk_bo_sync.c

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use canonical variable names in nvk_shader.c

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use canonical variable names in nvk_physical_device.c

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: handle alignments in device memory

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Add an addr field to nvk_image_plane

Nothing actually needs the pointer to the memory object so it's better
to not even include it.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: init image fields for requirements

Fixes a crash in dEQP-VK.memory.requirements.create_info.*

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Add a buffer alignment helper

This consolodates buffer alignment calculations into one place,
including physical device queries, buffer creation, and buffer memory
requirements queries.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Reformat nvk_buffer.c

Mostly, using dev instead of device and re-flow the arguments to
nvk_GetDeviceBufferMemoryRequirements().

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/winsys: fix SM value for Ada

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Add support for probing as a platform device.

The driver now comes up on gk20a (Jetson TK1).

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Clean up redundant vendor checking for physical device creation.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Quiet a compiler warning.

Looks like it's always set to me, but :shrug:

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/winsys: Fix an undefined use in the error path.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk/query: fix push buffer size for copy pool results.

the immediate takes two slots, so bump this by one,
fixes a crash in zink KHR-GL45.transform_feedback.query_vertex_interleaved_test

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Enable external memory extensions

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Support dma-buf export

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Support dma-buf import

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nouveau/winsys: Add dma-buf import support

This requires a lock and a buffer cache on the nouveau_ws_device.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Require dedicated allocations for external images

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Dedicated allocations override internal

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Add external memory queries

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Add device and driver UUIDs

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use abbreviated names in nvk_device_memory.c

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Use NVIDIA_VENDOR_ID in pdev try_create()

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Enable descriptor indexing

These values follow the already existing per-stage and descriptor set
limits.  If we change these to be similar to the reported values of the
proprietary driver, care must be taken as Turing has bigger limits for
uniform buffers than older generations.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Add nir non-uniform optimization pass

The hardware supports non-uniform access natively so we do not need to
lower most non-uniform access in the shader. Just lower the ubo access
as it should probably be faster when we uniformly load from real hw
ubos in the future.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>

nvk: Handle cases of descriptor bindings with variable counts

We need to compute the allocated descriptor buffer size at descriptor allocation
time. So we need to split to a pre-computed size for all the other bindings
except the one with the variable count.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24326>