Dev builds (2.10)

[stgatilov]

Changelog of 2.10 development:

dev16202-9175
* Major changes in security camera (5528, 4731, Wiki).
* Entity limit removed raised to 64K (5439, announcement).
* Added secrets tracking system for mappers to use (5549, Wiki).
* Integrated Sotha's "automaton" AI from Ulysses into core assets.
* Menu: improved the main page and the "new game" page to make it easier for new players.
* Menu: ask for confirmation on game restart, fixed menu music setting.
* Menu: show checkboxes near objectives after mission is failed (5049).
* Fixed rare crash in script-generated frobs (5542).
* Added idPlayer::GetObjectiveVisible script event (5543).
* Fixed rare collision bug causing lags (5439, r9157).
* Debug visualization no longer blocks SMP performance improvements (5468).
* Fixed script-generated game saves by disabling screenshot due to SMP.
* Added missing frob highlight to plaster materials (4487).
* Removed missing material reference in skin "wench/purple_bodice".
* Minor fixes to mirroring: puddle, bc_teatray.
Known problems: Volta 1, Volta 2, and Snowed Inn don't start due to broken menu.

dev16215-9224
* More work on security camera (5528, Wiki) --- not finished yet.
* Massive changes in dmap to make it faster (5562, 5488, announcement).
* Fixed vertices merging in dmap which could cause sparklies (5486).
* OpenAL (sound) upgraded to 1.21.1, fixing bsinc resampler (5564).
* Added first implementation of tooltips in settings menu (2626).

dev16225-9284
* Map loading optimizations: texture storage, parallel image loading, models loading (5591).
* Fixed map not starting after prior error + removed 5 seconds delay at the end of loading (5118).
* Removed mandatory snapping from dmap, fixing thin objects like ropes (5486).
* Improved precision of windings in dmap compilation (5580).
* SIMD code cleanup: enabled AVX on Linux, disabled denormals (4550).
* Dropped visportals are now further classified as "leaky" and generic ones (5353, wiki).
* Fixed creation of script threads with object method call (4713).
* Added cvar s_alReverbGain to tone down EFX reverb (5587).
* r_materialOverride fixed with Frontend Acceleration.
* Fixed when player is in the void with "r_useLightAreaCulling 0".
* Minor fixes in menu tooltips.
* Fixed GL debug groups on AMD (5280).
* Changes in FPS counter, which make displayed value more stable when com_showFpsAvg is large.

dev16238-9330
* Frob highlight replaced with frob outline (5427) --- not finished yet.
* Linux platform-specific code now uses GLFW for window, GL-init and input handling (5510, 5293, testing).
* Windows build can change desktop resolution once again; also made "borderless" mode default (5510).
* New dmap diagnostics for location separators and location entities (5354).
* Dmap leak pointfiles are much shorter now (5592).
* FFmpeg video formats further restricted to mp4+h264+aac and roq (4845, announcement).
* Fixed occasional crash at the end of RunScript AI task, happening e.g. in WS3 mission (5538).
* Debug cvars r_lockSurfaces and r_maxTri improved.
* Upgraded GLFW to 3.3.4.
* Added generic hash map in the code; fixed race condition in shader loading during map start (5597).
* Refactoring of Clear methods in code (5593).
* Added slider in menu for reverb cvar s_alReverbGain (5587).
* Menu tooltip improvements.
* Experimental: localization system now accepts string placeholders (5261).

dev16256-9358
* Implemented new object manipulation and body dragging physics (5599 announcement).
* Extracted static geometry into its own VBO in VertexCache, fixing performance regression since 2.07 (5598).
* Added weapons to inventory grid (5601).
* Fixed in-game mission downloader warning when downloading localization pack (5551).
* Fixed in-game mission downloader warning when FM is not available on the chosen mirror (5551).
* Disabled bindless textures by default because it does not work on modern AMD GPUs.
* Reduced lower limit on texture units to 32, probably fixing the "Too few!" startup error on bad GL drivers.
* Allow choosing adaptive VSync in setting menu.
* Fullscreen options in menu: borderless goes first + block resolution when borderless is selected.
* Interaction table performance optimization when loading from savefile.
* Changed number of contacts in physics to 32 everywhere + minor filling optimization (3871).
* Save missions.tdminfo immediately after FM download finishes.
* Better logging of FM downloads under LC_MAINMENU & LT_INFO (5551).
* Saint Lucia FM: adjusted mission loading GUI to display tip for about 20% of loading time (5118).

dev16269-9407
* Reimplemented frob-highlighting of surfaces (5427).
* Removed TDM version display in the main menu.
* Replaced r_glProfiling and r_logSmpTimings with Tracy profiler library.
* Better handling of position-independent executable setting on Linux.
* Improved third-party libs usage: fixed OpenAL build on GCC10, fixed rebuilding libs with GCC different from 5.

dev16325-9462
* PNG image format is now supported in materials, PCX support removed (5665).
* Major refactoring of image formats in: SEED, screenshots of all kind. DevIL library removed (5665).
* Rough prototype of .srt subtitles in briefing video (2454).
* Fixed stack overflow crash if CPU-resident image is defaulted e.g. when not found (5665).
* Mission statistics now show number of game loads.
* Silenced "missing vertex or index cache" console warning.
* Calling "set" in GUI script with not enough arguments now results in Error instead of crash (5323).
* Debug cvar r_skipFog expanded to filter out boundaries.
* r_immediateRenderingEmulate = 1 by default, probably fixing debug visualization for people using deprecated GL profile.
* Fixed GPL header in source code files.

dev16330-9508
* Extended support of subtitles to both briefing video and in-game sounds (2454: BEWARE interface will change!)
* Support updating the currently installed mission in in-game downloader (5661).
* Supported hide_distance for particle emitters and geometry of light entities (5668).
* JPG and PNG images are no longer compressed by pk4/zip (they are already compressed by themselves).
* Fixed entity arguments broken in event system after entity limit removal (5439). The bug crashed Snowed Inn on startup.
* Refactored entity think code, optimized away thinking of frobable entities.
* Added con_nowrap cvar: it caps lengthy lines in game console instead of wrapping them to the next line.
* Added a ton of trace scopes in game, dmap, and loading (enabled by com_enableTracing 1 and Tracy connection).
* Minor fixes: parallelSky, r_showViewEntities, image_preload 0, r_singleModelName.
Known problems: GUI is not drawn in-game until paper is frob-highlighted.

dev16335-9550
* Added hot-reload support: LOD settings, _color and shaderParms, noshadows, angle, targets, frobmovers + rotate/translate, bound entities (5683).
* Fixed error on respawning an AI (5683).
* Added con_fontSize cvar, which allows making console font smaller, also enabled mipmapping.
* Refactored shaders loading, which fixes SMP-specific crash on AMD drivers (5012).
* Non-bound lights are turned off when they are hidden e.g. using LOD (post).
* Fixed noshadows_lod_N not working sometimes (5691).
* Fixed GUI rendering on parchments --- known problem from previous build.
* Fixed color banding in lockpick success/failure highlights.
* Changing tdm_lod_bias has immediate effect without restart.
* Small fix towards loading RGTC normal maps from DDS.
* Removed old broken code for entities binding/unbinding (5414).
* Some showPrimitives fixes.
* Automation: fixed bug with astronomical timer for game controls (not used anywhere yet).

dev16342-9552
* Merged branch with major changes in main menu GUI (5323, thread).
Known problems: All the missions from the list do not work as expected in main menu: custom background is missing, empty briefing page is shown, in rare cases even briefing/debriefing video can disappear. This will be properly fixed only when 2.10 is released. Right now you can download fixed pk4 file by direct link from the same page --- fixed version should work as expected.

dev16350-9577
* Support "set X on head" spawnarg for attached heads (post).
* Fixed lockpicking getting stuck if you go away (5715).
* Hopefully fixed random flickering when frob-highlighting objects with stencil shadows enabled.
* Fast and deterministic normal maps compression on CPU (5716).
* Optimized OGG files loading.
* Optimized TGA files loading.
* Continued work on X-ray support.
* Continued work on subtitles support (2454).
* Added new models and prefabs by @Wellingtoncrab.
* Added material textures/darkmod/window/wooden_frame01/wooden_frame01_dark.
* Probably fixed reloadModels for .lwo files.

dev16358-9588
* Fixed crashes in image loading on AMD driver (5591).
* Fixed occasional crashes in TGA loading optimization (5716).
* Generate mipmaps for non-DDS textures in software, see cvar image_mipmapMode.
* Frob outline disabled by default, see r_frobOutline (thread).
* Tweaked render order ("sort last") for particle materials.
* Continued work on subtitles (2454).
* Removed [cleanup] button in mod selection menu (thread).

dev16368-9627 (*)
* Major changes in frob highlight/outline: translucency, alpha test, shine-through (5427).
* Restored geometric frob outline under r_frobOutline 2 (5427, post).
* Fixed bug breaking GL core profile, which usually caused black menu on AMD (post).
* (WIP) Volumetric light effect.
* Renderer's "safe mode" changed to windowed 800 x 600 (post).
* Cap volume parameter in sound shader by 1.5 (4627).
* Lockpicking sound no longer affected by EFX reverb.
* Some changes in time handling, fixed timescale on uncapped FPS (5324, 4698).
* Reduced pause on game start from 1.0 to 0.1 seconds (5314).
* Minor dmap (aas) acceleration (5562).
* Minor optimizations in models / sounds loading.
* Don't drop held item after bumping dead/unconscious AIs (3516).
* Tweaked render order ("sort last") for particle materials, reverting some.
* Some changes in randomization (5763).
* Minor fix in game console.
* Adjusted stlucia.pk4 to avoid tdm_installer analysis... unsuccessfully.
* Changed integration of doctest unit tests.
Known problems: some maps broken with "clip model outside world bounds" warning spam.

dev16390-9648
* Fixed "clip model outside world bounds" warning spam on some maps (post).
* Fixed sparklies on hard geometric frob outline with bloom (5427).
* DDS textures can be used in image programs, although they should not (5781).
* Fixed spotlights/projected lights illuminating objects outside their frustum (5529).
* Continued work on volumetric light shader: LOD, stencil, etc. (5816).
* Allow xray shader in GUI overlays, fixed rare crash.
* Do not spam warnings when index cache is not ready yet, e.g. during noclip on large map.
* Minor fix of game console behavior.
* (WIP) Changed frustum of spotlights when near != 0 (5815).
* Fixed AlertDuration of security camera (5528).
* Fixed normalmaps: flagstones_mossy_01 (5777), flagstones_gravel (5760), ash_001 and ash01_crumb_edge (5784), blocks_large_mildew (5786), ornament_shield_white_eagleandpallets (5803).
* Added material for rough_grey_blocks (5789).
* Added missing "torn" skins for all paintings.
* Commented out additional camera screen materials (5676).

beta210-01 (rev 16399-9702)
* Projected lights: restored TDM 2.07 behavior, fix lighting outside frustum (5815).
* Fixed light frustum precision (4888).
* Major changes in volumetric lights (5816).
* Continued work on security camera (5528).
* X-ray improvements.
* Fixed severe slowdown with soft stencil shadows and antialiasing.
* Allow lifting ragdolls above ground, unless they have "ground_when_dragged" (5599).
* Fixed mirrors getting black under "image_useTexStorage 1" (topic).
* Added script events: vecRotate, getCalibratedLightgemValue, setSolid, getEntityFlag.
* Take entity orientation account in flinderization offsets.
* Removed "emitter_size" spawnarg.
* Fixed r_showLights.
* Refactor shaders: extracted common code to includes.

beta210-02 (rev 16411-9731)
* Fixed dbghelp.dll issue which blocked running TDM on fresh Windows 7 (issue).
* Fixed rare depth fighting when SSAO is on.
* Fixed OpenGL error with shadow maps when no light fallbacks to stencil implementation.
* Fixed envshot command (5796).
* Restored materials and prefabs for multiple camera GUIs.
* X-ray: supported "suppressInSubview" spawnarg on lights (also affects other subviews like mirrors)
* Added X-ray related assets: materials, visible/invisible skins.
* Added script events: getLocationPoint, pointIsInBounds, getTraceSurfType.
* Preserve opacity towards AIs and restore frobability in script event setSolid.
* Func_emitters can now be bound without the particle flickering rapidly.
* Fixed "condump unwrap".
* Added display case models without glass to allow them to have breakable glass.
* Added forcescreenaspect + hcenter GUI keywords for aspect-ratio-independent images.
* Removed a few subtitles lines which were for testing only.
* Internal typeinfo changes.

beta210-03 (rev 16421-9771)
* Reverted to 2.09 frob-highlight: no outline, use material frob stages.
* Added three new frob outline presets by @kingsal and @nbohr1more.
* Changed the way volumetric lights are set up (see wiki page).
* Volumetric lights respect noshadows and don't affect lightgem.
* Added script events: getHealth, setHealth, setSolid,projectDecal; fixed getLocationPoint.
* Added script event getEnemy and canSee to security camera.
* Add Epifire's flinder models to the security cameras.
* Fixed subtitles going sticky on save/load.
* Slightly reduced subtitles font size, added semi-transparent black background.
* Added subtitles to Saint Lucia mission.
* Fixed dmap issue in generating unoptimized collision maps for patch-only entities (5859).
* Elemental no longer has 8 legs, wasting time in inverse kinematics.
* Some optimizations in frontend: fix disabled optimization, avoid vertex data copy.
* Added r_useInteractionTriCulling -1 mode to move some CPU load to GPU.
* Fixed lamp cubemap light textures.
* Fixed language switches broken by new main menu GUI.
* Fixed occasional spam about slow jobs (threshold is now 100 ms instead of 10 ms).
* Corrected OpenGL usage of clipping planes in shadow map generation.
* Console printing is now threadsafe, which could crash Frontend Acceleration.
* Improvements in system console on Windows.
* Allow all SIMD code supported by compiler on Elbrus CPU.

beta210-04 (rev 16441-9798)
* Security camera now supports AI detection, also fixed volumetric lights.
* Fixed save/load for volumetric lights, supported scrolling light materials.
* Fixed scrolling light textures (5860).
* Fixed uncompressed normal maps and backface lighting (5862).
* stain01bwet material now works as it always did, no depth fighting (5325).
* Skip X-ray rendering when it is already within subview.
* Removed parchment from message about secrets (5549).
* Fixed and upscaled droppuddle texture (5870).
* Extended tooltips in video settings menu.
* Fixed randomization of gui::random_value on game load.
* A bit more subtitles in Saint Lucia mission.
* Fixed 1280 x 960 resolution in 4:3.
* Fixed rare graphic bug in some debug tools.
* Small optimization in frontend: reuse index array for interaction.

beta210-05 (rev 16457-9815)
* Fixed bright lines on the boundary of light volume on AMD drivers (5876).
* Fixed secret counter increased multiple times on single-count entities (5549).
* Security camera: "sweepWaitSoundOffset" spawnarg controls snd_end timing.
* Security camera: snd_sparks and snd_death can be used simultaneously.
* Security camera: split "seeAI" spawnarg into "seeAI", "seeAnimals", "seeBodies".
* Fixed the xray model stuck in place when shouldered.
* Improved player GUI for taking damage.
* Added spawnarg "animal_patrol_wait" to allow animals that move continuously (post).
* Portal sky scissor optimization.
* A bit of cleaning in source code conan dependencies (5839).
* Fixed hover highlight on Restart Game button in settings menu.
* Volumetric lights refactoring.

beta210-06 (rev 16472-9845)
* Fixed saving/loading of suppressInSubview for X-ray.
* Fixed language setting being ignored on restart (post).
* Reimplemented rotation in new grabber code, rotating heavy objects is easy now (post).
* Fixed weird spots sticking on screen sometimes when bloom is on (post).
* Fixed seeAI setting for security camera towards AIs on hostile teams; updated editor descriptions.
* Fixed one more bug causing tdm_installer to analyze installation.
* image_downsize no longer affects loading screens and other GUIs.
* Fixed lighting with "image_useNormalCompression 0".
* Added editor description for nodrop spawnarg.
* Reorganized mapper tool prefabs, fixed Epifire's wall-mounted security camera prefab.
* Removed non-working 16-bit color option from the menu settings.
* Improved EFX in New Job mission (5594).
* Fixed issue in Saint Lucia mission: all voiceovers being played on mission restart (4828).
* Some more corrections to subtitles in Saint Lucia mission.

beta210-07 (rev 16474-9850)
* Set r_useMultiDrawIndirect to 0, fixing NaN flickering on AMD drivers.
* Fixed X-ray combined with Render Scale.

beta210-08 (rev16475-9853)
* Fixed crash on index cache resize with now default "r_useMultiDrawIndirect 0".

Changelog of earlier versions can be found here.

[stgatilov]

(Reserved)

[stgatilov]

New dev build is available: dev16202-9175

Changelog of all versions is in the second post of the thread.

[stgatilov]

New dev build is available: dev16215-9215

UPDATE: I have just noticed that the code revision of this build is 9224, so I renamed the version to dev16215-9224

[stgatilov]

New dev build is available: dev16225-9284

[stgatilov]

New dev build is available: dev16238-9330

[stgatilov]

New dev build: dev16256-9358

[stgatilov]

New dev build: dev16269-9407

[datiswous]

On 3/2/2021 at 2:45 PM, stgatilov said:

Better handling of position-independent executable setting on Linux.

What does this do?

On 3/2/2021 at 2:45 PM, stgatilov said:

Removed TDM version display in the main menu.

Why was this removed? I thought it be a handy reminder of what version I'm using.

[stgatilov]

4 hours ago, datiswous said:

What does this do?

If you build engine from source, you have better chances of success.

Quote

Why was this removed? I thought it be a handy reminder of what version I'm using.

The main idea was to remove version check: it does not reflect our versioning system properly.

[wesp5]

2 hours ago, stgatilov said:

The main idea was to remove version check: it does not reflect our versioning system properly.

I think this is still a bad idea. There should be a place where you can see which version you run.

[stgatilov]

Just now, wesp5 said:

I think this is still a bad idea. There should be a place where you can see which version you run.

Open console: it shows major version + engine revision.
When taken together, they allow to fully identify version.

[wesp5]

Yeah, this might be fine for developers, but what about normal people? Not everybody is active here...

[stgatilov]

On 5/29/2021 at 4:17 AM, wesp5 said:

Yeah, this might be fine for developers, but what about normal people? Not everybody is active here...

Normal people don't need to know version.

If you want to check for updates, just finish your current playthrough and run tdm_installer without any settings,

[datiswous]

On 3/2/2021 at 2:44 PM, stgatilov said:

Although we would be glad if you catch and report bugs before the next beta phase starts

What is the right place to post bugs? I can do an error report in the bugtracker, but rather be sure if it's a bug before posting there.

I would guess TDM Tech Support, but it would clutter the other non-dev topics. Would be better I think if there is a subsection for that there.

[stgatilov]

28 minutes ago, datiswous said:

What is the right place to post bugs? I can do an error report in the bugtracker, but rather be sure if it's a bug before posting there.

I would guess TDM Tech Support, but it would clutter the other non-dev topics. Would be better I think if there is a subsection for that there.

Some time ago I wrote this article.

Basically, both bugtracker and TDM Tech Support forum are OK.
However:

1. Bugtracker is usually for the cases when you are sure this is a bug.
2. Issues in bugtracker (outside of current roadmap) have tendency to be overlooked. There is so many of them, and I'm afraid no one monitors for new issues.
3. Forum is much better to get fast response. It is better for talking in general: bugtracker is mostly for technical discussions.

So I'd suggest Tech Support forum.

[MirceaKitsune]

This is useful to know, thanks for sharing! I run most FOSS games from their repositories: TDM is among the only exception due to how it's packaged by its own installer. I might stick to the install manager for game data... the engine I'm already able to compile and use independently if its URL hasn't changed.

One curiosity tempts me to ask: Is there a reason why we're using the much older SVN instead of Git? While at that, do we have an official mirror on Github and / or Gitlab for the engine and its game code? It always felt like development could be even better if users on those popular platforms could clone through them and submit pull requests there.

[stgatilov]

On 6/12/2021 at 2:39 AM, MirceaKitsune said:

One curiosity tempts me to ask: Is there a reason why we're using the much older SVN instead of Git?

Because SVN is used in gamedev, but git is not.
Anyway, I'm sick of this question already.

Quote

While at that, do we have an official mirror on Github and / or Gitlab for the engine and its game code? It always felt like development could be even better if users on those popular platforms could clone through them and submit pull requests there.

Yes, there are plans for official mirror on GitHub for the engine.

[stgatilov]

New dev build is available: dev16330-9508
And I forgot to announce the previous dev build too : dev16325-9462

Note that subtitles support should work now, but the way how subtitles are specified will most likely change.

[Araneidae]

A small misfeature in the current dev build (also saw it on dev16325-9462 running the game from a terminal and running a mission causes the console colour to go yellow and stay yellow on exit from the game!  The terminal colour changes to yellow a following point in the log:

============= ReloadEngine end ===============
Couldn't exec autocommands.cfg - file does not exist.
Found 0 new missions and 0 packages.
Found 154 mods in the FM folder.
[swscaler @ 0x9fd6f80] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x9fd6f80] Warning: data is not aligned! This can lead to a speed loss
[swscaler @ 0x9fd6e80] deprecated pixel format used, make sure you did set range correctly

The text in square brackets is coloured grey, the rest of the text after that is in yellow.

Earlier in the log I did notice the following lines which might be relevant:

2 warnings
WARNING: terminal type 'xterm-256color' is unknown. terminal support may not work correctly
terminal support enabled ( use +set in_tty 0 to disabled )
pid: 54238
Async thread started

Clearly this is not an important issue, barely an irritation.

[HMart]

On 7/26/2021 at 5:38 AM, stgatilov said:

New dev build is available: dev16330-9508
And I forgot to announce the previous dev build too : dev16325-9462

Note that subtitles support should work now, but the way how subtitles are specified will most likely change.

Did something changed in the latest dev 2.10 dev16330-9508 version about bindless textures? I didn't updated my AMD RX 570X driver and when I enabled bindless textures before they were broken and today just because, I enabled it and textures are fine! Are you guys just silently disabling the feature in AMD GPU's now or is it really working? How can I tell?

[cabalistic]

I attempted a fix, but it didn't actually fix the issue, it just made it somewhat less visible. Previously, the AMD shader compiler confused diffuse and normal map lookups, which is very noticeable due to the green/red tint of the normal maps. Now, it confuses diffuse and specular lookups, which is not as obvious, but it's still just as wrong, unfortunately.

[HMart]

Oh ok thanks for the info cabalistic, thanks for trying to solve it at lest.

Btw I did all in my power, trying to make AMD aware of this problem, I exposed the problem on twitter to the official driver guy and I sent two bug reports on this problem, using the driver bug report feature, but unless many other AMD users do the same, I don't think they will prioritize this particular bug, if only a few complain.  

[duzenko]

9 hours ago, HMart said:

Btw I did all in my power, trying to make AMD aware of this problem, I exposed the problem on twitter to the official driver guy and I sent two bug reports on this problem, using the driver bug report feature

Noble intentions, even though AMD has never shown any interest in user bug reports

[Araneidae]

Am playing The Bakery Job with dev16330-9508 and I seem to have stumbled across an interesting bug: on the upstairs door (which requires two lock picks) if I look away from the door between the first and second pick the door becomes completely unpickable.  Haven't investigated elsewhere, other doors, saving and reloading etc, but imagine this might be a more general issue with this build...

Edit: Have confirmed this is a problem in the training mission.  To reproduce:

• Pick up the picks, go to the second door.
• Pick the first tumbler.
• Look away and change picks in the inventory (I have mouse wheel bound to my inventory)
• Picking no longer does anything: there is a green or red flash on the lock pick, but no sound or other action.

Edited August 1, 2021 by Araneidae