Meet JPL Interns | December 18, 2018
From Struggling in School to ‘Killing It at NASA,’ a VR Dream Come True
Until she discovered game development, Michelle Vo’s daydreams were a problem. She couldn’t focus in her computer science classes. Her grades were dipping. She wondered whether she was cut out to be a programmer or for school at all. So she took a break to make something just for fun, a self-help game. And help her, it did. Now focusing on virtual and augmented reality, Vo is back at school, studying not just computer science, but also cognitive science, linguistics and digital humanities. It’s a lot, but to create a virtual world, she says one has to first understand how people navigate the real one. This summer, at NASA’s Jet Propulsion Laboratory, the UCLA student applied her talents to VR and AR experiences that help scientists explore a totally different world, Mars. While Vo’s tendency to daydream hasn’t gone away, she now knows how to use the distractions for good; she turns them into VR inspiration.
What are you working on at JPL?
I worked on this project called OnSight, which just won NASA Software of the Year! I also worked on another project for the InSight Mars lander mission. Honestly, it’s been such a dream come true to intern here. I actually used to struggle a lot with school because I would often get caught up in my own daydreams. However, I’m really glad I found a unique career path in VR where I can turn those dreams into something useful.
That's so great that you were able to channel your daydreams in that way. How did you go from struggling in school to doing VR?
When I first tried on a VR headset, I was like, "This is the future. I need to do whatever I can to learn about this." I decided to study computer science, but it was easy to get lost and fall behind in a large classroom environment. Not a lot of people know this, but I was on academic probation for a while. Looking back, I think my shyness held me back from asking for the help that I needed.
When I took a break from school, I decided I wanted to try making a game. I wanted to do something just for fun, and I was determined to fix my bad habits. So with some friends, I created a self-help game at AthenaHacks, a women’s hackathon. For 24 hours, I was just immersed in my work. I had never felt that way about anything in my life, where I was just zoned in, in my own world, building something I loved. And that's when I realized, I think it's game development. I think this is what I want.
So I spent the year teaching myself [game development], and I got a lot more comfortable using the Unity game engine. I went on to attend Make School’s VR Summer Academy in San Francisco. That smaller learning environment opened up the world for me. It boosted my confidence more than anything to have the support I needed. I was like, "Maybe my grades aren’t so great, but I know how to build VR applications – and the world needs VR right now.”
So when I went back to my university, I thought, "I'll try again. I'm going to go back to computer science.” And so far so good. I'm into my fourth year at UCLA studying cognitive science, linguistics, computer science and digital humanities. It sounds like a lot, but they're all related in the sense that they're all connected to VR. To me, VR is mainly a study of the mind and how we perceive reality. It’s not just about game development; you also need to understand human behavior to create good user-friendly VR.
So going back to your JPL internship, how are you using your VR skills to help scientists and engineers?
Michelle Vo poses for a photo with InSight Testbed Lead, Marleen Sundgaard. Image courtesy Michelle Vo | + Expand image
I’m interning in the Ops Lab, and the project I've been working on primarily is called OnSight. OnSight uses Microsoft’s HoloLens [mixed-reality software] to simulate walking on Mars. Mars scientists use it to collaborate with each other. We had “Meet on Mars” this morning, actually. On certain days, Mars scientists will put on their headsets and hang out virtually on Mars. They see each other. They talk. They look at Mars rocks and take notes. It's based on images from the Curiosity Mars rover. We converted those images to 3-D models to create the virtual terrain, so through VR, we can simulate walking on Mars without being there.
For a few weeks, I worked on another project with the InSight Mars lander mission. We took the terrain model that's generated from images of [the landing site] and made it so the team could see that terrain on top of their testbed [at JPL] with a HoloLens. For them, that's important because they're trying to recreate the terrain to … Wait, I recorded this.
[Michelle quickly scans through the photo library on her phone and pulls up a video she recorded from JPL’s In-Situ Instruments Laboratory. Pranay Mishra, a testbed engineer for the InSight mission, stands in a simulated Mars landscape next to a working model of the lander and explains:]
“When InSight reaches Mars, we're going to get images of the terrain that we land on. The instruments will be deployed to that terrain, so we will want to practice those deployments in the testbed. One of the biggest things that affects our deployment ability is the terrain. If the terrain is tilted or there are rocks in certain spots, that all has a strong effect on our deployment accuracy. To practice it here, we want the terrain in the testbed to match the terrain on Mars. The only things we can view from Mars are the images that we get back [from the lander]. We want to put those into the HoloLens so that we can start terraforming, or “marsforming,” the testbed terrain to match the terrain on Mars. That way, we can maybe get a rough idea of what the deployment would look like on Mars by practicing it on Earth.”
Michelle Vo stands in the InSight testbed at JPL with testbed engineers Drew Penrod (left) and Pranay Mishra (right). Image courtesy Michelle Vo | + Expand image
They already gave us photos of Mars, which they turned into a 3D model. I created an AR project, where you look through the HoloLens – looking at the real world – and the 3D model is superimposed on the testbed. So the [testbed team] will shovel through and shape the terrain to match what it’s like on Mars, at InSight’s landing site.
Did you know that this was an area that you could work in at JPL before interning here?
OnSight was a well known project in the VR/AR space, since it was the first project to use the Microsoft Hololens. I remember being excited to see a panel on the project at the VRLA conference. So when I finally got on board with the team, I was ecstatic. I also realized that there’s room for improvement, and that’s OK. That’s why I'm here as an intern; I can bring in a fresh look.One of the things I did on this project was incorporate physical controllers. My critique when I first started was, "This interface is a bit tricky to use," and if it's challenging for me to use as a millenial, how is this going to be usable for people of all ages? I try to think in terms of accessibility for everybody. Through lots of testing, I realized that people need to be touching things, physical things. That's what OnSight lacked, a physical controller. There were a lot of things that I experimented with, and eventually, it came down to a keyboard that allows you to manipulate the simulated Mars rovers. So now with OnSight, you can drive the [simulated] rovers around with a keyboard controller and possibly in the future, type notes within the application. Previously, you had to tap into the air to use an AR keyboard, and that's not intuitive. I believe we still need to touch the physical world.
How has this project compared with other ones that you've done elsewhere?
I felt really in my element. And for the first time ever, the imposter-syndrome voice went away. I felt like I could just be myself and actually have a voice to contribute. You know, I might be small, I might be the shortest one, but I'm mighty. It’s been such a positive and supportive environment. I've had an incredible internship and learned so much.
What has been the most unique experience that you've had at JPL?
Working in the Ops Lab has been such a unique experience. Every day, we’re tinkering with cutting-edge technology in AR and VR. I am so thankful to have my mentors, Victor Luo and Parker Abercrombie, who give me the support and guidance I need to grow and learn. Outside of the Ops Lab, I also had the unique opportunity to meet astronaut Kate Rubins and talk about VR with her. I had lunch with NASA Administrator Jim Bridenstine when he visited JPL. And working with the InSight mission and Marleen Sundgaard, the mission’s testbed lead, was especially cool. I can't believe I was able to use my skills for something the Mars InSight mission needed. Being able to say that is something I'm really proud of. And seeing how far I came, from knowing nothing to being here, makes me feel happy. If I can transform, anyone can do this too, if they choose to work hard, follow their own path and see it in themselves to take a risk.
What advice do you have for others looking to follow your path?
Listen to your gut. Your gut knows. It’s easy to feel discouraged when learning something new, but trust me, you’re not alone. You’ve always got to stay optimistic about finding a solution. I've always been someone who has experimented with a lot of things, and I think learning is something you should definitely experiment with. If the classroom setting is not for you, try teaching yourself, try a bootcamp, try asking a friend – just any alternative. There is nothing wrong with carving your own path when it comes to your education. Everyone’s at their own pace, just don’t give up!
My biggest inspiration is the future. I think about it on a daily basis. I know I have a very cheery, idealistic view on life, but I think, "What's wrong with that?" as long as you can bring it back to reality.
Speaking of that, what is your ultimate dream for your career and your future?
I was raised in the Bay Area, and I grew up in Santa Clara so the tech culture of Silicon Valley was inescapable. I love Silicon Valley, but there is still a huge homelessness issue. I’ve always thought, “We have the brightest engineers and scientists doing the most amazing, crazy things, yet we still can't alleviate homelessness.” Everybody deserves a place to sleep and shower. People need to have their basic needs met. I’d love to see some sort of VR wellness center that could help people train for a job, overcome fears and treat mental health.
That's my idealistic dream, but back to present-day dreams: I'm actually doing a 180. I'm leaving tech for a little bit, and I’m taking Fall quarter off. I'll start back at UCLA in January, but I'm taking a leave to explore being an artist. I'm writing a science-fiction play about Vietnamese-American culture. I was inspired by my experience here at JPL. I feel really optimistic about the future of technology, which is funny because science fiction usually likes to depict tech as something crazy, like an apocalypse or the world crashing down. But I'm like, “Vietnamese people survived an actual war, and they’re still here.” For my parents and grandparents, their country as they knew it came crashing down on them when they were just about my age. They escaped Vietnam by boat and faced many hardships as immigrants who came to America penniless and without knowing English. For them to have survived all of that and sacrificed so much to make it possible for me to be here is incredible. I think it’s a testament to how, despite the worst things, there's always good that continues. I’m so grateful and thankful for my family. I wouldn’t be here living my dream without them, and I want to create a play about that.
It's funny. Before I used to be so shy, so shy. I used to be that one kid who would never talk to anybody. So it's kind of nice to see what happens when the introvert comes out of her shell. And this is what happens. All of this. [Laughs.]
Explore JPL’s summer and year-round internship programs and apply at: https://www.jpl.nasa.gov/edu/intern
The laboratory’s STEM internship and fellowship programs are managed by the JPL Education Office. Extending the NASA Office of Education’s reach, JPL Education seeks to create the next generation of scientists, engineers, technologists and space explorers by supporting educators and bringing the excitement of NASA missions and science to learners of all ages.
TAGS: Women in STEM, Higher Education, College, Students, STEM, VR, AR, Technology, Mars, InSight, Curiosity, Women in STEM, Asian Pacific American Heritage Month, Women at NASA
