Posts

Machine Learning and the Brain

Image
4 minute read. Simplicity can generate vast complexity - the Mandelbrot fractal is a wonderful example. Iterating one tiny equation leads to patterns of infinite depth and detail, nearly repeating, but not quite. Computers and software are based on nothing more than the transistor logic gate and bits memory - Alan Turing realized stringing enough of them together could solve nearly any algorithmic problem. The human genome has 2.5 billion base-pairs of DNA, which is only about 600MB of data. Somehow all the information that generated you or me could fit on one CD-ROM from the '90s, even though we largely can't even fathom how our own bodies function.  Deep neural networks are a relatively simple construct that led directly to the explosion of machine learning (ML) we're witnessing today, from facial recognition to real-time translation to image generation and artificial intelligence. They are a recursive statistical process, inspired by a theory of how the brain might w...

AI apocalypse?

Image
5 minute read. My previous post on Machine Learning / Artificial Intelligence might have come across as a bit foreboding, but I actually find myself much less concerned about humanity's future than many software engineers I know. There's a rich background of dystopian science fiction about AI enslaving humanity, but I find it to be a bit far-fetched, even though I have no doubt that ML algorithms will eventually, perhaps soon, far surpass human skill in any measurable contest. The question of our future though, is not one of intelligence, but of power and motivation. We are building AI to solve problems. I speak not of myself personally (I don't work in the field) and not even of my employer (though they are certainly expanding the state of the art along with most other tech companies), but of humanity in general: we are a global society and no one acts in a vacuum. The primary fear I hear is that AI will, through superior intellect, come to either control or destroy us ev...

The Egotism of Consciousness

Image
2 minute read. We used to say humans were the only conscious beings, so it didn't matter how we treated animals. In fact we even labeled many humans (slaves, native peoples, various foreign enemies) as animals, justifying their mistreatment as well. But running even deeper than the desire to have power over other beings is the desire to feel special ourselves - that our very nature puts us above someone or something.  We've been steadily widening our definitions as we have become more civil to more people and creatures. The more we study animals, the more we see ourselves - our brains are really not so different. Yet we feel comfortable with this broadening definition of consciousness because we smugly know that we humans still have more processing power. But now, along comes artificial intelligence.  Suddenly there is more talk of consciousness and specifically how artificial intelligence doesn't have it , but what terrible things it could mean if it were attained. Fundam...

Software is Literature

Image
5 minute read. Originally an aerospace engineer, I've been a software engineer now for about half my career, but it doesn't quite feel like engineering to me. I don't want to start an argument on the definitions of terms, but hear me out, I think there are some interesting differences.  I remember first thinking it was odd that at my university, the Computer Science department was not in the College of Engineering, but in the College of Arts & Sciences. Sure, "science" is right there in the name, but the practitioners are generally known as software engineers, and certainly they ran in the same circles as the rest of us engineers. However, while the civil, mechanical, aerospace, electrical, and chemical engineers were required to fill our time with math, physics, and mechanics, the software engineers had to take humanities and social science electives just like the comparative literature majors.  I also remember when my career first turned from aerospace - I j...

Perseverance - a history of Manifold

Image
7 minute read. If I had known it would take this long, would I have started? This is a question I asked myself when looking back at the development of Manifold , and I honestly don't know the answer. Certainly taking on this challenge was born largely of naivety in software engineering, especially when realizing I worked on it for almost eight years before it saw the light of day.  Why did I take on this project? It started with 3D printing, where I found out that much of the lack of reliability stemmed from models that had non-manifold mesh data. Manifoldness is what allows a mesh to represent a solid, with a clear inside and outside, so without this the computer is left to guess what your intentions are. In many cases there is simply no clear way for an algorithm to proceed when it encounters a non-manifold mesh.  At first I thought these non-manifold meshes were simply the result of bugs, but while working at Microsoft I got to work with experts from many of the major CAD ...

3D Interaction

Image
8 minute read. UX (user experience) design is hard - for those not in the industry, it's basically a slightly broader term for UI (user interface) or GUI (graphical user interface), which is to say how we as engineers let you the user interact with our software. I'll preface this by saying I have no formal training in UX, but then again I don't have formal training in sculpture or software engineering either, and I like to think that hasn't stopped me. 2D UX is plenty tricky, but 3D is a real bear. I've ended up designing and building a fair amount of 3D UX simply because there was no one else (a common deficiency of large software companies is a dearth of UX experts). I'm pretty proud of what I've built and I'll describe it in the hopes that it's copied, because I have spent a lot of time being frustrated by awful 3D interfaces. What makes 3D so hard? The biggest issue is that the interface (screen, mouse, touchscreen) is all 2D. Worse yet, it ...

Reframing Capitalism

Image
5 minute read. I was raised by back-to-the-land hippies, so I grew up with a pretty negative view of capitalism, but also with no clear idea of what the word meant. My parents were distrusting of rich people; a bias I still carry with me even as I'm becoming one. They considered debt to be evil; they never even had a mortgage, having bought five acres in the 1970s for $10,000 which they borrowed from my five-year-old brother's inheritance. They paid him back, though I have no idea if interest was involved. So anathema was debt that I honestly believed I couldn't go to college without a free-ride, since they had no money to send me. I managed to get enough scholarships from writing a dizzying array of application essays, but upon arrival I realized my stress was probably misplaced given everyone else had taken out student loans.  One of my closet friends in college had the opposite upbringing, where his family not only discussed investment at the dinner table, but played Mon...