{"id":22587,"date":"2021-10-14T15:55:19","date_gmt":"2021-10-14T20:55:19","guid":{"rendered":"https:\/\/blogs.und.edu\/und-today\/?p=22587"},"modified":"2021-10-27T14:52:31","modified_gmt":"2021-10-27T19:52:31","slug":"a-r-in-the-o-r","status":"publish","type":"post","link":"https:\/\/blogs.und.edu\/und-today\/2021\/10\/a-r-in-the-o-r\/","title":{"rendered":"A.R. in the O.R."},"content":{"rendered":"

UND\u2019s departments of Surgery and Computer Science team up to explore augmented reality technology in the operating room<\/strong><\/p>\n

\"\"
Image courtesy of UND School of Medicine & Health Sciences.<\/figcaption><\/figure>\n

\u201cIt\u2019s not like changing the alternator in your car where you can easily reference the repair manual or a technical read-out in the moment,\u201d explained Dr. Stefan Johnson of teaching surgery to medical students and residents. \u201cWe\u2019re still teaching with a mentor and pointing out things with a forceps or surgical instrument and saying \u2018cut here\u2019 or \u2018watch me do this and then you repeat the maneuver.\u2019\u201d<\/p>\n

Laparoscopy and robotics notwithstanding, this is how surgical training has been done for centuries, said Johnson.<\/p>\n

Thanks to a partnership between the UND\u2019s School of Medicine & Health Sciences (SMHS) Department of Surgery and the School of Electrical Engineering and Computer Sciences (SEECS) within the UND College of Engineering and Mines, though, this age-old method of surgical education is getting an update.<\/p>\n

Over the past eighteen months, faculty from the two UND teams have been helping the Surgery Residency Program that Johnson directs experiment with augmented reality (AR) technology in the surgical suite.<\/p>\n

\"\"
Image courtesy of UND School of Medicine & Health Sciences.<\/figcaption><\/figure>\n

Not quite virtual reality, the AR concept uses enhanced glasses that allow for supplemental images or videos to overlay what the physician sees in the operating room (OR). These images or videos can be anything, Johnson said, from radiological images like X-rays or CT scans to patients\u2019 vital signs, instructional videos, and even pages from the surgery textbook, all passed in front of surgeons\u2019 field of vision.<\/p>\n

UND leading the world<\/h2>\n

\u201cSo, in the old days, residents would essentially practice on cadavers and patients\u2014they didn\u2019t have much choice,\u201d continued Johnson, who explained that where patient safety is concerned, the real OR is hardly the place for cumbersome, and potentially unclean, medical gear, textbooks, or video monitors. \u201cBut this technology has potential to bring better knowledge into the education environment, and for clinical use in general, safely.\u201d<\/p>\n

The AR glasses concept was developed by former SMHS clinical professor of surgery Mark Jensen, M.D., who helped UND secure a $20,000 National Institutes of Health SHARPhub grant to study the concept. Although he retired before the grant period ended, Jensen said the fact that nothing has, to date, been published in the medical literature on AR in the surgical suite means UND has an opportunity to be a world-leader.<\/p>\n

Enter Ron Marsh, Ph.D., professor in the SEECS who knows Jensen from their mutual interest in ham radio and asked Jensen how his team could help.<\/p>\n

\u201cI have a student doing research in virtual reality,\u201d said Marsh whose team is handling the software side of the project. \u201cWe looked at some of the different glasses and settled on the set that we\u2019re using now. Then, we were in contact with the manufacturer and discovered that they had developed a Zoom application that works on these glasses. The Zoom capability gives us everything we want, so we basically we took over figuring out how you get the AR part to work from the technical standpoint.\u201d<\/p>\n

\"\"
Image courtesy of UND School of Medicine & Health Sciences.<\/figcaption><\/figure>\n

If the software and wireless connectivity issues can be ironed out, said Marsh, this relatively inexpensive technology \u2013 $500 per pair of glasses \u2013 could radically improve the practice of not only clinical surgery but rural medicine.<\/p>\n

\u201cLet\u2019s say you\u2019re a doctor in Cando, which means you\u2019re maybe not a trauma surgeon,\u201d Marsh mused. \u201cAnd somebody\u2019s brought in who\u2019s critically injured. Now Cando is pretty rural. If they have a pair of these glasses, and the trauma center in Fargo has a pair of glasses, with Zoom in these glasses the two providers can connect and the doc in Cando can look down at the patient \u2013 there\u2019s a camera in the glasses \u2013 and the surgeon in Fargo could literally see what his colleagues see.\u201d<\/p>\n

Lifesaving technology<\/h2>\n

In effect, said Marsh, the \u201cactive\u201d space on the AR lenses would allow the surgeon in Fargo to advise the physician in Cando by writing or mapping out, with a stylus, instructions on the Cando physician\u2019s field of vision in real-time \u2013 cut here, suture there \u2013 from Fargo.<\/p>\n

\u201cIf you\u2019re in the military or maybe with first responders in rural areas, it gives you a truly interactive telemedicine for these emergency surgery situations,\u201d said Marsh. \u201cThis should be really exciting, because in traumatic situations I think this could save lives.\u201d<\/p>\n

Before such technology is deployed in the field, though, Johnson said that his vision is to get to a point where preceptors can provide such real-time instructions and feedback to learners through the glasses in the educational setting.<\/p>\n

\u201cIt\u2019s wide open,\u201d Johnson continued. \u201cYou could do this in the anatomy lab, maybe put images from the surgery textbook into the glasses as students practice these operations on cadavers. You couldn\u2019t do that in a sterile OR. We can call up any image we want in the glasses.\u201d<\/p>\n

And with UND leading the way, operating rooms across the region may be able to do just that.<\/p>\n

\u201cWe now have capabilities of creating 3D reconstructions of imaging from CT scans that detail anatomical relationships of blood vessels and the location of tumors,\u201d added Dr. Sabha Ganai, an associate professor of surgery for the SMHS who specializes in surgical oncology, hepatobiliary surgery, and endocrine surgery at Sanford Health in Fargo, N.D. \u201cWhat is nice about AR glasses is it allows us the ability to superimpose the visualization of prior imaging and real time ultrasounds to help guide doing complex therapies like microwave ablations. We currently have to turn our head while we are working, but the future is an integration of our actions with what we see ahead of us.\u201d<\/p>\n

About the author<\/strong><\/p>\n

\"\"
Brian James Schill<\/figcaption><\/figure>\n

Brian James Schill is the assistant director of the Office of Alumni and Community Relations at the University of North Dakota School of Medicine & Health Sciences.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

UND\u2019s departments of surgery and computer science team up to explore augmented reality technology in the operating room<\/p>\n","protected":false},"author":24,"featured_media":22588,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[3],"tags":[22],"class_list":["post-22587","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-research","tag-med"],"acf":[],"yoast_head":"\nA.R. in the O.R. - UND Today<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blogs.und.edu\/und-today\/2021\/10\/a-r-in-the-o-r\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"A.R. in the O.R. - UND Today\" \/>\n<meta property=\"og:description\" content=\"UND\u2019s departments of surgery and computer science team up to explore augmented reality technology in the operating room\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blogs.und.edu\/und-today\/2021\/10\/a-r-in-the-o-r\/\" \/>\n<meta property=\"og:site_name\" content=\"UND Today\" \/>\n<meta property=\"article:published_time\" content=\"2021-10-14T20:55:19+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-10-27T19:52:31+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/blogs.und.edu\/und-today\/\/srv\/htdocs\/wp-content\/uploads\/sites\/7\/2021\/10\/anatomy-lab-overhead-small-web.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"800\" \/>\n\t<meta property=\"og:image:height\" content=\"475\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"UND Today\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"UND Today\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/blogs.und.edu\\\/und-today\\\/2021\\\/10\\\/a-r-in-the-o-r\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blogs.und.edu\\\/und-today\\\/2021\\\/10\\\/a-r-in-the-o-r\\\/\"},\"author\":{\"name\":\"UND Today\",\"@id\":\"https:\\\/\\\/blogs.und.edu\\\/und-today\\\/#\\\/schema\\\/person\\\/6d75904e56fd4224cbe50dab6857dc00\"},\"headline\":\"A.R. in the O.R.\",\"datePublished\":\"2021-10-14T20:55:19+00:00\",\"dateModified\":\"2021-10-27T19:52:31+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/blogs.und.edu\\\/und-today\\\/2021\\\/10\\\/a-r-in-the-o-r\\\/\"},\"wordCount\":1043,\"image\":{\"@id\":\"https:\\\/\\\/blogs.und.edu\\\/und-today\\\/2021\\\/10\\\/a-r-in-the-o-r\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/blogs.und.edu\\\/und-today\\\/wp-content\\\/uploads\\\/sites\\\/7\\\/2021\\\/10\\\/anatomy-lab-overhead-small-web.jpg\",\"keywords\":[\"School of Medicine & Health Sciences\"],\"articleSection\":[\"Research\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/blogs.und.edu\\\/und-today\\\/2021\\\/10\\\/a-r-in-the-o-r\\\/\",\"url\":\"https:\\\/\\\/blogs.und.edu\\\/und-today\\\/2021\\\/10\\\/a-r-in-the-o-r\\\/\",\"name\":\"A.R. in the O.R. - UND Today\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blogs.und.edu\\\/und-today\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/blogs.und.edu\\\/und-today\\\/2021\\\/10\\\/a-r-in-the-o-r\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/blogs.und.edu\\\/und-today\\\/2021\\\/10\\\/a-r-in-the-o-r\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/blogs.und.edu\\\/und-today\\\/wp-content\\\/uploads\\\/sites\\\/7\\\/2021\\\/10\\\/anatomy-lab-overhead-small-web.jpg\",\"datePublished\":\"2021-10-14T20:55:19+00:00\",\"dateModified\":\"2021-10-27T19:52:31+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/blogs.und.edu\\\/und-today\\\/#\\\/schema\\\/person\\\/6d75904e56fd4224cbe50dab6857dc00\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/blogs.und.edu\\\/und-today\\\/2021\\\/10\\\/a-r-in-the-o-r\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/blogs.und.edu\\\/und-today\\\/2021\\\/10\\\/a-r-in-the-o-r\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/blogs.und.edu\\\/und-today\\\/2021\\\/10\\\/a-r-in-the-o-r\\\/#primaryimage\",\"url\":\"https:\\\/\\\/blogs.und.edu\\\/und-today\\\/wp-content\\\/uploads\\\/sites\\\/7\\\/2021\\\/10\\\/anatomy-lab-overhead-small-web.jpg\",\"contentUrl\":\"https:\\\/\\\/blogs.und.edu\\\/und-today\\\/wp-content\\\/uploads\\\/sites\\\/7\\\/2021\\\/10\\\/anatomy-lab-overhead-small-web.jpg\",\"width\":800,\"height\":475,\"caption\":\"Image courtesy of UND School of Medicine & Health Sciences.\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/blogs.und.edu\\\/und-today\\\/2021\\\/10\\\/a-r-in-the-o-r\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/blogs.und.edu\\\/und-today\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"A.R. in the O.R.\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/blogs.und.edu\\\/und-today\\\/#website\",\"url\":\"https:\\\/\\\/blogs.und.edu\\\/und-today\\\/\",\"name\":\"UND Today\",\"description\":\"University of North Dakota\u2019s Official News Source\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/blogs.und.edu\\\/und-today\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/blogs.und.edu\\\/und-today\\\/#\\\/schema\\\/person\\\/6d75904e56fd4224cbe50dab6857dc00\",\"name\":\"UND Today\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/9eee324a1176bbe1585f420813fecf8c433577d6e5e906a3084e0b264e5796b3?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/9eee324a1176bbe1585f420813fecf8c433577d6e5e906a3084e0b264e5796b3?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/9eee324a1176bbe1585f420813fecf8c433577d6e5e906a3084e0b264e5796b3?s=96&d=mm&r=g\",\"caption\":\"UND Today\"},\"url\":\"https:\\\/\\\/blogs.und.edu\\\/und-today\\\/author\\\/und-today\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"A.R. in the O.R. - UND Today","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blogs.und.edu\/und-today\/2021\/10\/a-r-in-the-o-r\/","og_locale":"en_US","og_type":"article","og_title":"A.R. in the O.R. - UND Today","og_description":"UND\u2019s departments of surgery and computer science team up to explore augmented reality technology in the operating room","og_url":"https:\/\/blogs.und.edu\/und-today\/2021\/10\/a-r-in-the-o-r\/","og_site_name":"UND Today","article_published_time":"2021-10-14T20:55:19+00:00","article_modified_time":"2021-10-27T19:52:31+00:00","og_image":[{"width":800,"height":475,"url":"https:\/\/blogs.und.edu\/und-today\/\/srv\/htdocs\/wp-content\/uploads\/sites\/7\/2021\/10\/anatomy-lab-overhead-small-web.jpg","type":"image\/jpeg"}],"author":"UND Today","twitter_card":"summary_large_image","twitter_misc":{"Written by":"UND Today","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/blogs.und.edu\/und-today\/2021\/10\/a-r-in-the-o-r\/#article","isPartOf":{"@id":"https:\/\/blogs.und.edu\/und-today\/2021\/10\/a-r-in-the-o-r\/"},"author":{"name":"UND Today","@id":"https:\/\/blogs.und.edu\/und-today\/#\/schema\/person\/6d75904e56fd4224cbe50dab6857dc00"},"headline":"A.R. in the O.R.","datePublished":"2021-10-14T20:55:19+00:00","dateModified":"2021-10-27T19:52:31+00:00","mainEntityOfPage":{"@id":"https:\/\/blogs.und.edu\/und-today\/2021\/10\/a-r-in-the-o-r\/"},"wordCount":1043,"image":{"@id":"https:\/\/blogs.und.edu\/und-today\/2021\/10\/a-r-in-the-o-r\/#primaryimage"},"thumbnailUrl":"https:\/\/blogs.und.edu\/und-today\/wp-content\/uploads\/sites\/7\/2021\/10\/anatomy-lab-overhead-small-web.jpg","keywords":["School of Medicine & Health Sciences"],"articleSection":["Research"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/blogs.und.edu\/und-today\/2021\/10\/a-r-in-the-o-r\/","url":"https:\/\/blogs.und.edu\/und-today\/2021\/10\/a-r-in-the-o-r\/","name":"A.R. in the O.R. - UND Today","isPartOf":{"@id":"https:\/\/blogs.und.edu\/und-today\/#website"},"primaryImageOfPage":{"@id":"https:\/\/blogs.und.edu\/und-today\/2021\/10\/a-r-in-the-o-r\/#primaryimage"},"image":{"@id":"https:\/\/blogs.und.edu\/und-today\/2021\/10\/a-r-in-the-o-r\/#primaryimage"},"thumbnailUrl":"https:\/\/blogs.und.edu\/und-today\/wp-content\/uploads\/sites\/7\/2021\/10\/anatomy-lab-overhead-small-web.jpg","datePublished":"2021-10-14T20:55:19+00:00","dateModified":"2021-10-27T19:52:31+00:00","author":{"@id":"https:\/\/blogs.und.edu\/und-today\/#\/schema\/person\/6d75904e56fd4224cbe50dab6857dc00"},"breadcrumb":{"@id":"https:\/\/blogs.und.edu\/und-today\/2021\/10\/a-r-in-the-o-r\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blogs.und.edu\/und-today\/2021\/10\/a-r-in-the-o-r\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blogs.und.edu\/und-today\/2021\/10\/a-r-in-the-o-r\/#primaryimage","url":"https:\/\/blogs.und.edu\/und-today\/wp-content\/uploads\/sites\/7\/2021\/10\/anatomy-lab-overhead-small-web.jpg","contentUrl":"https:\/\/blogs.und.edu\/und-today\/wp-content\/uploads\/sites\/7\/2021\/10\/anatomy-lab-overhead-small-web.jpg","width":800,"height":475,"caption":"Image courtesy of UND School of Medicine & Health Sciences."},{"@type":"BreadcrumbList","@id":"https:\/\/blogs.und.edu\/und-today\/2021\/10\/a-r-in-the-o-r\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blogs.und.edu\/und-today\/"},{"@type":"ListItem","position":2,"name":"A.R. in the O.R."}]},{"@type":"WebSite","@id":"https:\/\/blogs.und.edu\/und-today\/#website","url":"https:\/\/blogs.und.edu\/und-today\/","name":"UND Today","description":"University of North Dakota\u2019s Official News Source","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blogs.und.edu\/und-today\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/blogs.und.edu\/und-today\/#\/schema\/person\/6d75904e56fd4224cbe50dab6857dc00","name":"UND Today","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/9eee324a1176bbe1585f420813fecf8c433577d6e5e906a3084e0b264e5796b3?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/9eee324a1176bbe1585f420813fecf8c433577d6e5e906a3084e0b264e5796b3?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/9eee324a1176bbe1585f420813fecf8c433577d6e5e906a3084e0b264e5796b3?s=96&d=mm&r=g","caption":"UND Today"},"url":"https:\/\/blogs.und.edu\/und-today\/author\/und-today\/"}]}},"_links":{"self":[{"href":"https:\/\/blogs.und.edu\/und-today\/wp-json\/wp\/v2\/posts\/22587","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.und.edu\/und-today\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.und.edu\/und-today\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.und.edu\/und-today\/wp-json\/wp\/v2\/users\/24"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.und.edu\/und-today\/wp-json\/wp\/v2\/comments?post=22587"}],"version-history":[{"count":0,"href":"https:\/\/blogs.und.edu\/und-today\/wp-json\/wp\/v2\/posts\/22587\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blogs.und.edu\/und-today\/wp-json\/wp\/v2\/media\/22588"}],"wp:attachment":[{"href":"https:\/\/blogs.und.edu\/und-today\/wp-json\/wp\/v2\/media?parent=22587"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.und.edu\/und-today\/wp-json\/wp\/v2\/categories?post=22587"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.und.edu\/und-today\/wp-json\/wp\/v2\/tags?post=22587"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}