Added optispeech and tmt projects

This commit is contained in:
thepaperpilot 2020-11-05 14:44:00 -06:00
parent 8f54b3bee0
commit 1878cfaea7
18 changed files with 92 additions and 6 deletions

Binary file not shown.

View file

@ -0,0 +1,7 @@
---
layout: default
title: OptiSpeech Demo 1
---
<iframe width="560" height="315" src="https://www.youtube.com/embed/9uHqIRs7ZjM" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen style="display: block; margin: auto;"></iframe>
This video shows a talker with WAVE sensors placed on the the tongue hitting a virtual target sphere located at the alveolar ridge. When an alveolar consonant is hit (e.g., /s/, /n/, /d/) the sphere changes color from red to green.

View file

@ -0,0 +1,7 @@
---
layout: default
title: OptiSpeech Demo 2
---
<iframe width="560" height="315" src="https://www.youtube.com/embed/Oz42mKvlzqI" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen style="display: block; margin: auto;"></iframe>
This video shows an American talker learning a novel sound not found in English. When the post-alveolar consonant is hit, the target sphere changes color from red to green. Here, the NDI WAVE system serves as input.

View file

@ -0,0 +1,13 @@
---
layout: default
title: OptiSpeech 2
---
The program is being updated by a team in the UT Dallas Speech Production Lab led by Anthony Lawn, so the program uses a more modern version of Unity, has an easier to use interface, can more easily support new features, and can connect to additional EMA systems, namely the Carstens AG501.
![](/assets/optispeech-assets/new-interface.png)
In addition, the program now includes documentation and unit tests to improve program stability and maintainability going forward.
![](/assets/optispeech-assets/documentation.png)
![](/assets/optispeech-assets/unittests.png)

View file

@ -0,0 +1,7 @@
---
layout: default
title: OptiSpeech Summary
---
The Optispeech project involves designing and testing a real-time tongue model that can be viewed in a transparent head while a subject talks — for the purposes of treating speech errors and teaching foreign language sounds. This work has been conducted in partnership with Vulintus and with support from the National Institutes of Health (NIH). The UT Dallas Speech Production Lab is currently updating the program to use updated versions of Unity and adding support for more features and hardware.
![](/assets/optispeech-assets/system-architecture-600.jpg)

View file

@ -0,0 +1,5 @@
---
layout: default
title: TMT Contributions
---
In addition to many bug fixes and providing support to various mod creators on [the TMT discord](https://discord.gg/F3xveHV), I've directly contributed to the project by updating documentation, improving the discord link displays, and implementing the "lore" feature. I've additionally made several other tweaks that don't necessarily fit all TMT projects so they aren't present in the project itself, but appear as references in the source code for The Game Dev Tree.

5
_content/tmt/summary.md Normal file
View file

@ -0,0 +1,5 @@
---
layout: default
title: TMT Summary
---
The Modding Tree is a modding platform made by Acamaeda for an incremental game called The Prestige Tree. I've contributed many features and bug fixes, and used the framework to create my own mod, The Game Dev Tree.

View file

@ -0,0 +1,7 @@
---
layout: default
title: The Game Dev Tree
---
I personally felt like the original game could've benefited from keeping earlier layers relevant for longer, and if layers resetting was along the branches rather than entire rows. To help test the modding framework, I made my own mod called The Game Dev Tree, that uses those concepts as a core foundation for its game design. It also became a bit of a playground to implement new ideas for TMT in a live game so I could receive feedback from players.
![](/assets/tmt-assets/screenshot.png)

View file

@ -0,0 +1,9 @@
---
layout: default
title: OptiSpeech
category: Other
cards: [OptiSpeech Summary, OptiSpeech Demo 1, OptiSpeech Demo 2, OptiSpeech 2]
links: []
tags: [c#, unity]
---
The Optispeech project involves designing and testing a real-time tongue model that can be viewed in a transparent head while a subject talks — for the purposes of treating speech errors and teaching foreign language sounds. This work has been conducted in partnership with Vulintus and with support from the National Institutes of Health (NIH). The UT Dallas Speech Production Lab is currently updating the program to use updated versions of Unity and adding support for more features and hardware.

10
_posts/2020-10-18-tmt.md Normal file
View file

@ -0,0 +1,10 @@
---
layout: default
title: The Modding Tree
category: Other
banner: tmt
cards: [TMT Summary, TMT Contributions, The Game Dev Tree]
links: ["Source Code|https://github.com/thepaperpilot/The-Modding-Tree", "The Game Dev Tree|http://thepaperpilot.org/gamedevtree/"]
tags: [js]
---
The Modding Tree is a modding platform made by Acamaeda for an incremental game called The Prestige Tree. I've contributed many features and bug fixes, and used the framework to create my own mod, The Game Dev Tree.

BIN
assets/banners/tmt.png Normal file

Binary file not shown.

After

Width:  |  Height:  |  Size: 83 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 41 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 918 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 63 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 41 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 124 KiB

View file

@ -320,7 +320,8 @@ button.accordion:focus {
}
.two-section,
.three-section {
.three-section,
.four-section {
display: flex;
flex-flow: wrap;
}
@ -333,6 +334,10 @@ button.accordion:focus {
width: calc(33% - 40px) !important;
}
.four-section .card {
width: calc(25% - 40px) !important;
}
.card-title a {
color: white;
}
@ -343,7 +348,8 @@ button.accordion:focus {
@media screen and (max-width: 1200px) {
.two-section .card,
.three-section .card {
.three-section .card,
.four-section .card {
width: 95% !important;
}
}

View file

@ -3,7 +3,7 @@ layout: default
title: The Paper Pilot
nocard: true
sections: [puppet, featured projects]
favorites: [NaN, Tower Offense, Slime Chargers!]
favorites: [NaN, Tower Offense, Slime Chargers!, The Modding Tree]
---
<div id="puppet">
<div id="current_chat"></div>
@ -32,7 +32,17 @@ favorites: [NaN, Tower Offense, Slime Chargers!]
<div class="section" id="featured projects">
<h1>Featured Projects</h1>
<div class="three-section">
<div class="four-section">
<div class="card">
<div class="card-content">
<div class="card-image">
<a href="/optispeech"><img src="/assets/optispeech-assets/new-interface.png"></a>
</div>
<span class="card-title"><a href="/optispeech">OptiSpeech!</a><span class="language">C#</span></span>
<p>I led a team updating a legacy Unity project for research on speech therapy to use a modern version with a focus on extensability to facilitate future maintenance and features.</p>
<a href="/optispeech">read more</a>
</div>
</div>
<div class="card">
<div class="card-content">
<div class="card-image">
@ -56,7 +66,7 @@ favorites: [NaN, Tower Offense, Slime Chargers!]
<div class="card">
<div class="card-content">
<div class="card-image">
<a href="/dicearmor"><img src="/assets/dicearmor-assets/editors.jpg"></a>
<a href="/dicearmor"><img src="/assets/dicearmor-assets/da2.jpg"></a>
</div>
<span class="card-title"><a href="/dicearmor">Dice Armor!</a><span class="language">C#</span></span>
<p>I was the lead programmer on a team of nine creating this game in a semester long college course. I programmed all the gameplay systems as well as incorporated Babble Buds for the cutscenes and tutorial.</p>
@ -84,7 +94,7 @@ favorites: [NaN, Tower Offense, Slime Chargers!]
</div>
{% endcomment %}
</div>
<div class="three-section">
<div class="four-section">
{% for project in page.favorites %}
{% for page in site.posts %}
{% if page.title == project %}