jp9000
/
obs-studio
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
obs-studio/plugins/win-capture/graphics-hook/dxgi-capture.cpp

337 lines
7.8 KiB
C++
Raw Normal View History

win-capture: Add graphics-hook library This library is a completely refactored and rewritten version of the original graphics hook. The code is more clean, readable, and has a variety of new features, such as scaling and forcing memory capture. Currently, only D3D9, 10, and 11 are implemented. (This commit may be updated on this branch)
2014-11-10 15:04:40 -08:00
#include <d3d10_1.h>
#include <d3d11.h>
win-capture: Add IDXGISwapChain1::Present1 hook support Allows capturing games/programs that may be using Present1 instead of the regular Present call for rendering.
2017-06-19 15:45:00 -07:00
#include <dxgi1_2.h>
win-capture: Add graphics-hook library This library is a completely refactored and rewritten version of the original graphics hook. The code is more clean, readable, and has a variety of new features, such as scaling and forcing memory capture. Currently, only D3D9, 10, and 11 are implemented. (This commit may be updated on this branch)
2014-11-10 15:04:40 -08:00
#include <d3dcompiler.h>
#include "d3d1x_shaders.hpp"
#include "graphics-hook.h"
#include "../funchook.h"
win-capture: Add D3D12 capture support Currently only supports shared texture capture, and doesn't support rescaling.
2016-10-29 08:25:08 -07:00
#if COMPILE_D3D12_HOOK
#include <d3d12.h>
#endif
win-capture: Use right call type for hook funcs Although STDMETHODCALLTYPE is technically WINAPI (__stdcall), it's best not to make any assumptions.
2015-02-14 07:34:55 -08:00
typedef HRESULT (STDMETHODCALLTYPE *resize_buffers_t)(IDXGISwapChain*, UINT,
UINT, UINT, DXGI_FORMAT, UINT);
typedef HRESULT (STDMETHODCALLTYPE *present_t)(IDXGISwapChain*, UINT, UINT);
win-capture: Add IDXGISwapChain1::Present1 hook support Allows capturing games/programs that may be using Present1 instead of the regular Present call for rendering.
2017-06-19 15:45:00 -07:00
typedef HRESULT (STDMETHODCALLTYPE *present1_t)(IDXGISwapChain1*, UINT, UINT,
const DXGI_PRESENT_PARAMETERS *);
win-capture: Add graphics-hook library This library is a completely refactored and rewritten version of the original graphics hook. The code is more clean, readable, and has a variety of new features, such as scaling and forcing memory capture. Currently, only D3D9, 10, and 11 are implemented. (This commit may be updated on this branch)
2014-11-10 15:04:40 -08:00
static struct func_hook resize_buffers;
static struct func_hook present;
win-capture: Add IDXGISwapChain1::Present1 hook support Allows capturing games/programs that may be using Present1 instead of the regular Present call for rendering.
2017-06-19 15:45:00 -07:00
static struct func_hook present1;
win-capture: Add graphics-hook library This library is a completely refactored and rewritten version of the original graphics hook. The code is more clean, readable, and has a variety of new features, such as scaling and forcing memory capture. Currently, only D3D9, 10, and 11 are implemented. (This commit may be updated on this branch)
2014-11-10 15:04:40 -08:00
struct dxgi_swap_data {
IDXGISwapChain *swap;
win-capture: Capture all D3D12 backbuffers D3D12 capture does not take in to account when multiple backbuffers are in used. With previous versions of Direct3D there was no need to do this, but with D3D12 you must explicitly capture each specific backbuffer currently in use.
2016-12-23 01:45:31 -08:00
void (*capture)(void*, void*, bool);
win-capture: Add graphics-hook library This library is a completely refactored and rewritten version of the original graphics hook. The code is more clean, readable, and has a variety of new features, such as scaling and forcing memory capture. Currently, only D3D9, 10, and 11 are implemented. (This commit may be updated on this branch)
2014-11-10 15:04:40 -08:00
void (*free)(void);
};
static struct dxgi_swap_data data = {};
static bool setup_dxgi(IDXGISwapChain *swap)
{
IUnknown *device;
HRESULT hr;
win-capture/graphics-hook: Fix D3D10/D3D11 detection When hooking DXGI-based graphics programs in the hook, the first hook point is IDXGISwapChain::Present. To be able to initiate a capture, a pointer to the device context that created the swap chain is required, which can be retrieved via IDXGISwapChain::GetDevice. Determining whether the device context was D3D10 or D3D11 has always been somewhat of an issue due to D3D10 and D3D11 being nearly identical, as well as their interoperability/interchangeability. The GetDevice function would first be called with the UUID of ID3D10Device, then if that failed, the UUID of ID3D11Device. However, with certain specific D3D11 games, GetDevice would for some unknown reason succeed with the UUID of ID3D10Device, which would cause capture to fail. (Conversely, attempting to call GetDevice with the UUID of ID3D11Device on a device that's actually ID3D10Device would always succeed, so reversing the order of the test was not an option). There were originally three known D3D11 games that would erroneously succeed when querying a D3D10 device interface: Call of Duty: Ghosts, Just Cause 3, and theHunter: Call of the Wild. All other known D3D11 games would work correctly. Because it was only these three games, a hack was originally implemented in the form of an executable exception list that would force them to capture D3D11. Unfortunately, Oculus games are now failing under the same circumstance as well, so a simple hack will no longer work. To fix this, a more reliable method of detecting which context it is had to be discovered: simply check the feature level using ID3D11Device::GetFeatureLevel. If the feature level is D3D_FEATURE_LEVEL_11_0 or D3D_FEATURE_LEVEL_11_1, the device is definitely a D3D11 device. Otherwise, continue the tests as they were before. Successfully tested with many D3D10 games, many D3D11 games, and especially those three D3D11 games that previously were detected as D3D10 erroneously.
2017-06-14 20:38:33 -07:00
hr = swap->GetDevice(__uuidof(ID3D11Device), (void**)&device);
if (SUCCEEDED(hr)) {
ID3D11Device *d3d11 = reinterpret_cast<ID3D11Device*>(device);
D3D_FEATURE_LEVEL level = d3d11->GetFeatureLevel();
device->Release();
win-capture: Add graphics-hook library This library is a completely refactored and rewritten version of the original graphics hook. The code is more clean, readable, and has a variety of new features, such as scaling and forcing memory capture. Currently, only D3D9, 10, and 11 are implemented. (This commit may be updated on this branch)
2014-11-10 15:04:40 -08:00
win-capture/graphics-hook: Fix D3D10/D3D11 detection When hooking DXGI-based graphics programs in the hook, the first hook point is IDXGISwapChain::Present. To be able to initiate a capture, a pointer to the device context that created the swap chain is required, which can be retrieved via IDXGISwapChain::GetDevice. Determining whether the device context was D3D10 or D3D11 has always been somewhat of an issue due to D3D10 and D3D11 being nearly identical, as well as their interoperability/interchangeability. The GetDevice function would first be called with the UUID of ID3D10Device, then if that failed, the UUID of ID3D11Device. However, with certain specific D3D11 games, GetDevice would for some unknown reason succeed with the UUID of ID3D10Device, which would cause capture to fail. (Conversely, attempting to call GetDevice with the UUID of ID3D11Device on a device that's actually ID3D10Device would always succeed, so reversing the order of the test was not an option). There were originally three known D3D11 games that would erroneously succeed when querying a D3D10 device interface: Call of Duty: Ghosts, Just Cause 3, and theHunter: Call of the Wild. All other known D3D11 games would work correctly. Because it was only these three games, a hack was originally implemented in the form of an executable exception list that would force them to capture D3D11. Unfortunately, Oculus games are now failing under the same circumstance as well, so a simple hack will no longer work. To fix this, a more reliable method of detecting which context it is had to be discovered: simply check the feature level using ID3D11Device::GetFeatureLevel. If the feature level is D3D_FEATURE_LEVEL_11_0 or D3D_FEATURE_LEVEL_11_1, the device is definitely a D3D11 device. Otherwise, continue the tests as they were before. Successfully tested with many D3D10 games, many D3D11 games, and especially those three D3D11 games that previously were detected as D3D10 erroneously.
2017-06-14 20:38:33 -07:00
if (level >= D3D_FEATURE_LEVEL_11_0) {
win-capture: Add graphics-hook library This library is a completely refactored and rewritten version of the original graphics hook. The code is more clean, readable, and has a variety of new features, such as scaling and forcing memory capture. Currently, only D3D9, 10, and 11 are implemented. (This commit may be updated on this branch)
2014-11-10 15:04:40 -08:00
data.swap = swap;
win-capture/graphics-hook: Fix D3D10/D3D11 detection When hooking DXGI-based graphics programs in the hook, the first hook point is IDXGISwapChain::Present. To be able to initiate a capture, a pointer to the device context that created the swap chain is required, which can be retrieved via IDXGISwapChain::GetDevice. Determining whether the device context was D3D10 or D3D11 has always been somewhat of an issue due to D3D10 and D3D11 being nearly identical, as well as their interoperability/interchangeability. The GetDevice function would first be called with the UUID of ID3D10Device, then if that failed, the UUID of ID3D11Device. However, with certain specific D3D11 games, GetDevice would for some unknown reason succeed with the UUID of ID3D10Device, which would cause capture to fail. (Conversely, attempting to call GetDevice with the UUID of ID3D11Device on a device that's actually ID3D10Device would always succeed, so reversing the order of the test was not an option). There were originally three known D3D11 games that would erroneously succeed when querying a D3D10 device interface: Call of Duty: Ghosts, Just Cause 3, and theHunter: Call of the Wild. All other known D3D11 games would work correctly. Because it was only these three games, a hack was originally implemented in the form of an executable exception list that would force them to capture D3D11. Unfortunately, Oculus games are now failing under the same circumstance as well, so a simple hack will no longer work. To fix this, a more reliable method of detecting which context it is had to be discovered: simply check the feature level using ID3D11Device::GetFeatureLevel. If the feature level is D3D_FEATURE_LEVEL_11_0 or D3D_FEATURE_LEVEL_11_1, the device is definitely a D3D11 device. Otherwise, continue the tests as they were before. Successfully tested with many D3D10 games, many D3D11 games, and especially those three D3D11 games that previously were detected as D3D10 erroneously.
2017-06-14 20:38:33 -07:00
data.capture = d3d11_capture;
data.free = d3d11_free;
win-capture: Add graphics-hook library This library is a completely refactored and rewritten version of the original graphics hook. The code is more clean, readable, and has a variety of new features, such as scaling and forcing memory capture. Currently, only D3D9, 10, and 11 are implemented. (This commit may be updated on this branch)
2014-11-10 15:04:40 -08:00
return true;
}
}
win-capture/graphics-hook: Fix D3D10/D3D11 detection When hooking DXGI-based graphics programs in the hook, the first hook point is IDXGISwapChain::Present. To be able to initiate a capture, a pointer to the device context that created the swap chain is required, which can be retrieved via IDXGISwapChain::GetDevice. Determining whether the device context was D3D10 or D3D11 has always been somewhat of an issue due to D3D10 and D3D11 being nearly identical, as well as their interoperability/interchangeability. The GetDevice function would first be called with the UUID of ID3D10Device, then if that failed, the UUID of ID3D11Device. However, with certain specific D3D11 games, GetDevice would for some unknown reason succeed with the UUID of ID3D10Device, which would cause capture to fail. (Conversely, attempting to call GetDevice with the UUID of ID3D11Device on a device that's actually ID3D10Device would always succeed, so reversing the order of the test was not an option). There were originally three known D3D11 games that would erroneously succeed when querying a D3D10 device interface: Call of Duty: Ghosts, Just Cause 3, and theHunter: Call of the Wild. All other known D3D11 games would work correctly. Because it was only these three games, a hack was originally implemented in the form of an executable exception list that would force them to capture D3D11. Unfortunately, Oculus games are now failing under the same circumstance as well, so a simple hack will no longer work. To fix this, a more reliable method of detecting which context it is had to be discovered: simply check the feature level using ID3D11Device::GetFeatureLevel. If the feature level is D3D_FEATURE_LEVEL_11_0 or D3D_FEATURE_LEVEL_11_1, the device is definitely a D3D11 device. Otherwise, continue the tests as they were before. Successfully tested with many D3D10 games, many D3D11 games, and especially those three D3D11 games that previously were detected as D3D10 erroneously.
2017-06-14 20:38:33 -07:00
hr = swap->GetDevice(__uuidof(ID3D10Device), (void**)&device);
if (SUCCEEDED(hr)) {
data.swap = swap;
data.capture = d3d10_capture;
data.free = d3d10_free;
device->Release();
return true;
}
win-capture: Add graphics-hook library This library is a completely refactored and rewritten version of the original graphics hook. The code is more clean, readable, and has a variety of new features, such as scaling and forcing memory capture. Currently, only D3D9, 10, and 11 are implemented. (This commit may be updated on this branch)
2014-11-10 15:04:40 -08:00
hr = swap->GetDevice(__uuidof(ID3D11Device), (void**)&device);
if (SUCCEEDED(hr)) {
data.swap = swap;
data.capture = d3d11_capture;
data.free = d3d11_free;
device->Release();
return true;
}
win-capture: Add D3D12 capture support Currently only supports shared texture capture, and doesn't support rescaling.
2016-10-29 08:25:08 -07:00
#if COMPILE_D3D12_HOOK
hr = swap->GetDevice(__uuidof(ID3D12Device), (void**)&device);
if (SUCCEEDED(hr)) {
data.swap = swap;
data.capture = d3d12_capture;
data.free = d3d12_free;
device->Release();
return true;
}
#endif
win-capture: Add graphics-hook library This library is a completely refactored and rewritten version of the original graphics hook. The code is more clean, readable, and has a variety of new features, such as scaling and forcing memory capture. Currently, only D3D9, 10, and 11 are implemented. (This commit may be updated on this branch)
2014-11-10 15:04:40 -08:00
return false;
}
win-capture: Fix hook bug that could cause crashes I had this issue where IDXGISwapChain::ResizeBuffers would fail in the hooks, causing games to crash when they resized their backbuffers because ResizeBuffers would return an 'invalid call' HRESULT value. In the ResizeBuffers documentation it says that it will only happen if a backbuffer currently has any outstanding references, but there's no way this would happen unless ResizeBuffers internally calls Present or vise versa. After ResizeBuffers has been called, the very first call to Present will somehow seemingly invalidate and/or destroy the current backbuffer. It's very strange, but that seems to be what's going on, at least for the game I was testing. So if you are performing a post-overlay capture, then you must ignore the capture on the very first call to Present. It's Microsoft's code so you can't really know what's going on, you just have to work around these strange issues seemingly in the dark.
2015-02-14 07:35:53 -08:00
static bool resize_buffers_called = false;
win-capture: Add graphics-hook library This library is a completely refactored and rewritten version of the original graphics hook. The code is more clean, readable, and has a variety of new features, such as scaling and forcing memory capture. Currently, only D3D9, 10, and 11 are implemented. (This commit may be updated on this branch)
2014-11-10 15:04:40 -08:00
static HRESULT STDMETHODCALLTYPE hook_resize_buffers(IDXGISwapChain *swap,
UINT buffer_count, UINT width, UINT height, DXGI_FORMAT format,
UINT flags)
{
HRESULT hr;
if (!!data.free)
data.free();
data.swap = nullptr;
data.free = nullptr;
data.capture = nullptr;
unhook(&resize_buffers);
resize_buffers_t call = (resize_buffers_t)resize_buffers.call_addr;
hr = call(swap, buffer_count, width, height, format, flags);
rehook(&resize_buffers);
win-capture: Fix hook bug that could cause crashes I had this issue where IDXGISwapChain::ResizeBuffers would fail in the hooks, causing games to crash when they resized their backbuffers because ResizeBuffers would return an 'invalid call' HRESULT value. In the ResizeBuffers documentation it says that it will only happen if a backbuffer currently has any outstanding references, but there's no way this would happen unless ResizeBuffers internally calls Present or vise versa. After ResizeBuffers has been called, the very first call to Present will somehow seemingly invalidate and/or destroy the current backbuffer. It's very strange, but that seems to be what's going on, at least for the game I was testing. So if you are performing a post-overlay capture, then you must ignore the capture on the very first call to Present. It's Microsoft's code so you can't really know what's going on, you just have to work around these strange issues seemingly in the dark.
2015-02-14 07:35:53 -08:00
resize_buffers_called = true;
win-capture: Add graphics-hook library This library is a completely refactored and rewritten version of the original graphics hook. The code is more clean, readable, and has a variety of new features, such as scaling and forcing memory capture. Currently, only D3D9, 10, and 11 are implemented. (This commit may be updated on this branch)
2014-11-10 15:04:40 -08:00
return hr;
}
win-capture: Use IUnknown for getting swap backbuffers Using IDXGIResource doesn't work with D3D12. D3D12 textures are not a subclass of that class.
2016-10-29 08:23:44 -07:00
static inline IUnknown *get_dxgi_backbuffer(IDXGISwapChain *swap)
win-capture: Add graphics-hook library This library is a completely refactored and rewritten version of the original graphics hook. The code is more clean, readable, and has a variety of new features, such as scaling and forcing memory capture. Currently, only D3D9, 10, and 11 are implemented. (This commit may be updated on this branch)
2014-11-10 15:04:40 -08:00
{
IDXGIResource *res = nullptr;
HRESULT hr;
win-capture: Use IUnknown for getting swap backbuffers Using IDXGIResource doesn't work with D3D12. D3D12 textures are not a subclass of that class.
2016-10-29 08:23:44 -07:00
hr = swap->GetBuffer(0, __uuidof(IUnknown), (void**)&res);
win-capture: Add graphics-hook library This library is a completely refactored and rewritten version of the original graphics hook. The code is more clean, readable, and has a variety of new features, such as scaling and forcing memory capture. Currently, only D3D9, 10, and 11 are implemented. (This commit may be updated on this branch)
2014-11-10 15:04:40 -08:00
if (FAILED(hr))
hlog_hr("get_dxgi_backbuffer: GetBuffer failed", hr);
return res;
}
static HRESULT STDMETHODCALLTYPE hook_present(IDXGISwapChain *swap,
UINT sync_interval, UINT flags)
{
win-capture: Use IUnknown for getting swap backbuffers Using IDXGIResource doesn't work with D3D12. D3D12 textures are not a subclass of that class.
2016-10-29 08:23:44 -07:00
IUnknown *backbuffer = nullptr;
win-capture: Fix hook bug that could cause crashes I had this issue where IDXGISwapChain::ResizeBuffers would fail in the hooks, causing games to crash when they resized their backbuffers because ResizeBuffers would return an 'invalid call' HRESULT value. In the ResizeBuffers documentation it says that it will only happen if a backbuffer currently has any outstanding references, but there's no way this would happen unless ResizeBuffers internally calls Present or vise versa. After ResizeBuffers has been called, the very first call to Present will somehow seemingly invalidate and/or destroy the current backbuffer. It's very strange, but that seems to be what's going on, at least for the game I was testing. So if you are performing a post-overlay capture, then you must ignore the capture on the very first call to Present. It's Microsoft's code so you can't really know what's going on, you just have to work around these strange issues seemingly in the dark.
2015-02-14 07:35:53 -08:00
bool capture_overlay = global_hook_info->capture_overlay;
win-capture: Add graphics-hook library This library is a completely refactored and rewritten version of the original graphics hook. The code is more clean, readable, and has a variety of new features, such as scaling and forcing memory capture. Currently, only D3D9, 10, and 11 are implemented. (This commit may be updated on this branch)
2014-11-10 15:04:40 -08:00
bool test_draw = (flags & DXGI_PRESENT_TEST) != 0;
bool capture;
HRESULT hr;
if (!data.swap && !capture_active()) {
setup_dxgi(swap);
}
capture = !test_draw && swap == data.swap && !!data.capture;
win-capture: Fix hook bug that could cause crashes I had this issue where IDXGISwapChain::ResizeBuffers would fail in the hooks, causing games to crash when they resized their backbuffers because ResizeBuffers would return an 'invalid call' HRESULT value. In the ResizeBuffers documentation it says that it will only happen if a backbuffer currently has any outstanding references, but there's no way this would happen unless ResizeBuffers internally calls Present or vise versa. After ResizeBuffers has been called, the very first call to Present will somehow seemingly invalidate and/or destroy the current backbuffer. It's very strange, but that seems to be what's going on, at least for the game I was testing. So if you are performing a post-overlay capture, then you must ignore the capture on the very first call to Present. It's Microsoft's code so you can't really know what's going on, you just have to work around these strange issues seemingly in the dark.
2015-02-14 07:35:53 -08:00
if (capture && !capture_overlay) {
win-capture: Add graphics-hook library This library is a completely refactored and rewritten version of the original graphics hook. The code is more clean, readable, and has a variety of new features, such as scaling and forcing memory capture. Currently, only D3D9, 10, and 11 are implemented. (This commit may be updated on this branch)
2014-11-10 15:04:40 -08:00
backbuffer = get_dxgi_backbuffer(swap);
win-capture: Fix hook bug that could cause crashes I had this issue where IDXGISwapChain::ResizeBuffers would fail in the hooks, causing games to crash when they resized their backbuffers because ResizeBuffers would return an 'invalid call' HRESULT value. In the ResizeBuffers documentation it says that it will only happen if a backbuffer currently has any outstanding references, but there's no way this would happen unless ResizeBuffers internally calls Present or vise versa. After ResizeBuffers has been called, the very first call to Present will somehow seemingly invalidate and/or destroy the current backbuffer. It's very strange, but that seems to be what's going on, at least for the game I was testing. So if you are performing a post-overlay capture, then you must ignore the capture on the very first call to Present. It's Microsoft's code so you can't really know what's going on, you just have to work around these strange issues seemingly in the dark.
2015-02-14 07:35:53 -08:00
if (!!backbuffer) {
win-capture: Capture all D3D12 backbuffers D3D12 capture does not take in to account when multiple backbuffers are in used. With previous versions of Direct3D there was no need to do this, but with D3D12 you must explicitly capture each specific backbuffer currently in use.
2016-12-23 01:45:31 -08:00
data.capture(swap, backbuffer, capture_overlay);
win-capture: Fix hook bug that could cause crashes I had this issue where IDXGISwapChain::ResizeBuffers would fail in the hooks, causing games to crash when they resized their backbuffers because ResizeBuffers would return an 'invalid call' HRESULT value. In the ResizeBuffers documentation it says that it will only happen if a backbuffer currently has any outstanding references, but there's no way this would happen unless ResizeBuffers internally calls Present or vise versa. After ResizeBuffers has been called, the very first call to Present will somehow seemingly invalidate and/or destroy the current backbuffer. It's very strange, but that seems to be what's going on, at least for the game I was testing. So if you are performing a post-overlay capture, then you must ignore the capture on the very first call to Present. It's Microsoft's code so you can't really know what's going on, you just have to work around these strange issues seemingly in the dark.
2015-02-14 07:35:53 -08:00
backbuffer->Release();
}
win-capture: Add graphics-hook library This library is a completely refactored and rewritten version of the original graphics hook. The code is more clean, readable, and has a variety of new features, such as scaling and forcing memory capture. Currently, only D3D9, 10, and 11 are implemented. (This commit may be updated on this branch)
2014-11-10 15:04:40 -08:00
}
unhook(&present);
present_t call = (present_t)present.call_addr;
hr = call(swap, sync_interval, flags);
rehook(&present);
win-capture: Fix hook bug that could cause crashes I had this issue where IDXGISwapChain::ResizeBuffers would fail in the hooks, causing games to crash when they resized their backbuffers because ResizeBuffers would return an 'invalid call' HRESULT value. In the ResizeBuffers documentation it says that it will only happen if a backbuffer currently has any outstanding references, but there's no way this would happen unless ResizeBuffers internally calls Present or vise versa. After ResizeBuffers has been called, the very first call to Present will somehow seemingly invalidate and/or destroy the current backbuffer. It's very strange, but that seems to be what's going on, at least for the game I was testing. So if you are performing a post-overlay capture, then you must ignore the capture on the very first call to Present. It's Microsoft's code so you can't really know what's going on, you just have to work around these strange issues seemingly in the dark.
2015-02-14 07:35:53 -08:00
if (capture && capture_overlay) {
/*
* It seems that the first call to Present after ResizeBuffers
* will cause the backbuffer to be invalidated, so do not
* perform the post-overlay capture if ResizeBuffers has
* recently been called. (The backbuffer returned by
* get_dxgi_backbuffer *will* be invalid otherwise)
*/
if (resize_buffers_called) {
resize_buffers_called = false;
} else {
backbuffer = get_dxgi_backbuffer(swap);
if (!!backbuffer) {
win-capture: Capture all D3D12 backbuffers D3D12 capture does not take in to account when multiple backbuffers are in used. With previous versions of Direct3D there was no need to do this, but with D3D12 you must explicitly capture each specific backbuffer currently in use.
2016-12-23 01:45:31 -08:00
data.capture(swap, backbuffer, capture_overlay);
win-capture: Fix hook bug that could cause crashes I had this issue where IDXGISwapChain::ResizeBuffers would fail in the hooks, causing games to crash when they resized their backbuffers because ResizeBuffers would return an 'invalid call' HRESULT value. In the ResizeBuffers documentation it says that it will only happen if a backbuffer currently has any outstanding references, but there's no way this would happen unless ResizeBuffers internally calls Present or vise versa. After ResizeBuffers has been called, the very first call to Present will somehow seemingly invalidate and/or destroy the current backbuffer. It's very strange, but that seems to be what's going on, at least for the game I was testing. So if you are performing a post-overlay capture, then you must ignore the capture on the very first call to Present. It's Microsoft's code so you can't really know what's going on, you just have to work around these strange issues seemingly in the dark.
2015-02-14 07:35:53 -08:00
backbuffer->Release();
}
}
win-capture: Add graphics-hook library This library is a completely refactored and rewritten version of the original graphics hook. The code is more clean, readable, and has a variety of new features, such as scaling and forcing memory capture. Currently, only D3D9, 10, and 11 are implemented. (This commit may be updated on this branch)
2014-11-10 15:04:40 -08:00
}
return hr;
}
win-capture: Add IDXGISwapChain1::Present1 hook support Allows capturing games/programs that may be using Present1 instead of the regular Present call for rendering.
2017-06-19 15:45:00 -07:00
static HRESULT STDMETHODCALLTYPE hook_present1(IDXGISwapChain1 *swap,
UINT sync_interval, UINT flags,
const DXGI_PRESENT_PARAMETERS *params)
{
IUnknown *backbuffer = nullptr;
bool capture_overlay = global_hook_info->capture_overlay;
bool test_draw = (flags & DXGI_PRESENT_TEST) != 0;
bool capture;
HRESULT hr;
if (!data.swap && !capture_active()) {
setup_dxgi(swap);
}
capture = !test_draw && swap == data.swap && !!data.capture;
if (capture && !capture_overlay) {
backbuffer = get_dxgi_backbuffer(swap);
if (!!backbuffer) {
DXGI_SWAP_CHAIN_DESC1 desc;
swap->GetDesc1(&desc);
data.capture(swap, backbuffer, capture_overlay);
backbuffer->Release();
}
}
unhook(&present1);
present1_t call = (present1_t)present1.call_addr;
hr = call(swap, sync_interval, flags, params);
rehook(&present1);
if (capture && capture_overlay) {
if (resize_buffers_called) {
resize_buffers_called = false;
} else {
backbuffer = get_dxgi_backbuffer(swap);
if (!!backbuffer) {
data.capture(swap, backbuffer, capture_overlay);
backbuffer->Release();
}
}
}
return hr;
}
win-capture: Add graphics-hook library This library is a completely refactored and rewritten version of the original graphics hook. The code is more clean, readable, and has a variety of new features, such as scaling and forcing memory capture. Currently, only D3D9, 10, and 11 are implemented. (This commit may be updated on this branch)
2014-11-10 15:04:40 -08:00
static pD3DCompile get_compiler(void)
{
pD3DCompile compile = nullptr;
char d3dcompiler[40] = {};
int ver = 49;
while (ver > 30) {
sprintf_s(d3dcompiler, 40, "D3DCompiler_%02d.dll", ver);
HMODULE module = LoadLibraryA(d3dcompiler);
if (module) {
compile = (pD3DCompile)GetProcAddress(module,
"D3DCompile");
if (compile) {
break;
}
}
ver--;
}
return compile;
}
static uint8_t vertex_shader_data[1024];
static uint8_t pixel_shader_data[1024];
static size_t vertex_shader_size = 0;
static size_t pixel_shader_size = 0;
bool hook_dxgi(void)
{
pD3DCompile compile;
ID3D10Blob *blob;
HMODULE dxgi_module = get_system_module("dxgi.dll");
HRESULT hr;
void *present_addr;
void *resize_addr;
win-capture: Add IDXGISwapChain1::Present1 hook support Allows capturing games/programs that may be using Present1 instead of the regular Present call for rendering.
2017-06-19 15:45:00 -07:00
void *present1_addr = nullptr;
win-capture: Add graphics-hook library This library is a completely refactored and rewritten version of the original graphics hook. The code is more clean, readable, and has a variety of new features, such as scaling and forcing memory capture. Currently, only D3D9, 10, and 11 are implemented. (This commit may be updated on this branch)
2014-11-10 15:04:40 -08:00
if (!dxgi_module) {
return false;
}
compile = get_compiler();
if (!compile) {
hlog("hook_dxgi: failed to find d3d compiler library");
return true;
}
/* ---------------------- */
hr = compile(vertex_shader_string, sizeof(vertex_shader_string),
"vertex_shader_string", nullptr, nullptr, "main",
"vs_4_0", D3D10_SHADER_OPTIMIZATION_LEVEL1, 0, &blob,
nullptr);
if (FAILED(hr)) {
hlog_hr("hook_dxgi: failed to compile vertex shader", hr);
return true;
}
vertex_shader_size = (size_t)blob->GetBufferSize();
memcpy(vertex_shader_data, blob->GetBufferPointer(),
blob->GetBufferSize());
blob->Release();
/* ---------------------- */
hr = compile(pixel_shader_string, sizeof(pixel_shader_string),
"pixel_shader_string", nullptr, nullptr, "main",
"ps_4_0", D3D10_SHADER_OPTIMIZATION_LEVEL1, 0, &blob,
nullptr);
if (FAILED(hr)) {
hlog_hr("hook_dxgi: failed to compile pixel shader", hr);
return true;
}
pixel_shader_size = (size_t)blob->GetBufferSize();
memcpy(pixel_shader_data, blob->GetBufferPointer(),
blob->GetBufferSize());
blob->Release();
/* ---------------------- */
present_addr = get_offset_addr(dxgi_module,
global_hook_info->offsets.dxgi.present);
resize_addr = get_offset_addr(dxgi_module,
global_hook_info->offsets.dxgi.resize);
win-capture: Add IDXGISwapChain1::Present1 hook support Allows capturing games/programs that may be using Present1 instead of the regular Present call for rendering.
2017-06-19 15:45:00 -07:00
if (global_hook_info->offsets.dxgi.present1)
present1_addr = get_offset_addr(dxgi_module,
global_hook_info->offsets.dxgi.present1);
win-capture: Add graphics-hook library This library is a completely refactored and rewritten version of the original graphics hook. The code is more clean, readable, and has a variety of new features, such as scaling and forcing memory capture. Currently, only D3D9, 10, and 11 are implemented. (This commit may be updated on this branch)
2014-11-10 15:04:40 -08:00
win-capture: explicitly cast function pointers This solves invalid conversions when building with gcc
2015-02-04 23:24:59 -08:00
hook_init(&present, present_addr, (void*)hook_present,
win-capture: Add graphics-hook library This library is a completely refactored and rewritten version of the original graphics hook. The code is more clean, readable, and has a variety of new features, such as scaling and forcing memory capture. Currently, only D3D9, 10, and 11 are implemented. (This commit may be updated on this branch)
2014-11-10 15:04:40 -08:00
"IDXGISwapChain::Present");
win-capture: explicitly cast function pointers This solves invalid conversions when building with gcc
2015-02-04 23:24:59 -08:00
hook_init(&resize_buffers, resize_addr, (void*)hook_resize_buffers,
win-capture: Add graphics-hook library This library is a completely refactored and rewritten version of the original graphics hook. The code is more clean, readable, and has a variety of new features, such as scaling and forcing memory capture. Currently, only D3D9, 10, and 11 are implemented. (This commit may be updated on this branch)
2014-11-10 15:04:40 -08:00
"IDXGISwapChain::ResizeBuffers");
win-capture: Add IDXGISwapChain1::Present1 hook support Allows capturing games/programs that may be using Present1 instead of the regular Present call for rendering.
2017-06-19 15:45:00 -07:00
if (present1_addr)
hook_init(&present1, present1_addr, (void*)hook_present1,
"IDXGISwapChain1::Present1");
win-capture: Add graphics-hook library This library is a completely refactored and rewritten version of the original graphics hook. The code is more clean, readable, and has a variety of new features, such as scaling and forcing memory capture. Currently, only D3D9, 10, and 11 are implemented. (This commit may be updated on this branch)
2014-11-10 15:04:40 -08:00
rehook(&resize_buffers);
rehook(&present);
win-capture: Add IDXGISwapChain1::Present1 hook support Allows capturing games/programs that may be using Present1 instead of the regular Present call for rendering.
2017-06-19 15:45:00 -07:00
if (present1_addr)
rehook(&present1);
win-capture: Add graphics-hook library This library is a completely refactored and rewritten version of the original graphics hook. The code is more clean, readable, and has a variety of new features, such as scaling and forcing memory capture. Currently, only D3D9, 10, and 11 are implemented. (This commit may be updated on this branch)
2014-11-10 15:04:40 -08:00
hlog("Hooked DXGI");
return true;
}
uint8_t *get_d3d1x_vertex_shader(size_t *size)
{
*size = vertex_shader_size;
return vertex_shader_data;
}
uint8_t *get_d3d1x_pixel_shader(size_t *size)
{
*size = pixel_shader_size;
return pixel_shader_data;
}