Long short-term memory

·

3 min read

Well, here it goes! This is (hopefully) the first entry of many in my new blog.

Howdy, World!

The post's title, Long Short-Term Memory, is—of course—a type of neural network, but it's also a play on a theme from a book I've been reading called "Make It Stick."

The book aims to challenge conventional notions about learning and studying—read, reread, repeat, forget. The authors present insights into how learning actually works, debunking popular but less effective practices that I grew up with, which often "feel" good and offer the comforting illusion of mastery. There's a fair amount about active retrieval and other approaches toward creating more durable memories.

I'm neutral about the book's scientific references, but the authors present their ideas clearly without the exaggerated claims typical of some popular non-fiction and self-improvement promises of authors on the bro podcast circuit. The book's critique of traditional methods in learning and teaching, while seemingly heterodox and unintuitive, actually resonates with my own experiences and those I've observed in my students. I plan to delve deeper into this topic in future posts, so stay tuned!

I myself am currently trying to make quite a few things "stick" as I'm studying for a couple of AWS certifications. It so happened that I was going through types of neural networks with an eye toward some of the retrieval practice tips when LSTM came up, and it struck me that I'm trying to make my short-term memory "longer" (thanks for indulging me).

I have a great opportunity through a company I teach for, which has a partnership providing me with free AWS training and discounted exams. I'm excited about possibly teaching this material one day since I find cloud computing so darned interesting but I'm also hoping to transition into a more cloud-heavy data engineer role.

For those who want specifics, I'm aiming to acquire the newly launched AWS Certified Data Engineer - Associate, along with the AWS Certified Machine Learning - Specialty certifications. I have already passed the DVA-C02 and the SAA-C03.

The value of cloud certifications is a hotly debated topic. Some (often paper tigers) view them as shortcuts to high-paying jobs, while others dismiss their value entirely. My perspective, informed by both the structured learning they provide and recruiters' insights on their value in standing out as a job candidate, falls in the middle. Although a certificate alone may not guarantee success or the acquisition of in-depth skills, it signifies a dedication to ongoing education and indicates a foundational level of expertise.

Certification exams can lead to a focus on short-term cramming, where the goal is merely passing the test, often at the cost of deeper learning. This approach results in superficial knowledge that is quickly forgotten and the skills that are supposed to undergird the topic knowledge are not developed.

In my experience as a bootcamp instructor and a long-time STEM educator, I've observed students who are desperate for a certificate, even resorting to dishonest means, yet unwilling to engage deeply with the material beyond minimal passing criteria. Surprisingly, some would even abandon their course of study if deemed ineligible certificate even if they still had access to all of the learning resources that they had long since paid for. As an instructor, I'm critical of the trend to value credentials above true understanding; yet I sometimes catch myself leaning towards this approach as a learner. It's wrong! And I know it, but it's comforting to drill flashcards, practice exams, and test tips.

So, I'm here to introduce myself and I'm also publicly reaffirming my commitment to using techniques like interleaving, spaced retrieval, elaboration, and reflection from "Make It Stick" to make my learning more lasting and impactful. But even more importantly, I want to go beyond trivia and certifications to actively build applications. This means embracing uncomfortable challenges and working through errors that aren't easily solved.

I hope to have news of passing these exams soon enough but I I really want to work toward a deeper mastery. That's gonna be a while!

comments appreciated