Skip to main content

Digital Twin Simulation and Autonomous System Verification

We build environments where verification is possible without the physical thing: replacing hardware with virtual prototypes, tying scattered components into a single simulation, and connecting manufacturing data to analysis models.

Background

A distributed embedded system can pass component-level verification and still fail at integration. Each node runs in its own process or on its own device, so their time references differ, and which node's event happened first changes from run to run. Once a defect has been observed, if the same ordering cannot be reproduced there is no way to confirm it was fixed.

Unmanned aerial vehicles and autonomous systems add the physical environment on top of that. A real flight is expensive to fail, and the same conditions cannot be recreated on demand.

Manufacturing brings the opposite problem. Data accumulates but is not connected to analysis models, so there is no way to examine a design other than building prototypes repeatedly.

Approach

Replacing Hardware with Virtual Prototypes

Hardware components such as sensors and actuators are built as virtual prototypes and attached to the real code. UBINOS embedded software was verified by running it on a PC-based code simulator. We also studied how to measure code coverage while a simulation is running, and how to handle environments like the Internet of Things where nodes are scattered and coverage is hard to collect in one place.

Distributed Integrated Simulation and Time Synchronization

Scattered code and model components are tied together through a message broker and run as one simulation. We implemented this as a ZeroMQ-based cooperative simulation framework, and secured reproducibility with relative time synchronisation that matches event order rather than absolute clocks. We also built an IoT interaction testing environment over an HLA-RTI interface.

UAV Flight Testing

Flight test scenarios and profiles are generated to create repeatable conditions. Flight logs are fed back as input and replayed in a simulator, while the parts where the sensor readings themselves are unstable, such as altitude hold and indoor positioning, are handled with correction algorithms based on accelerometers and inertial navigation.

Self-Organizing Software Platforms

An environment where many devices form a group on their own carries the same distributed simulation problem described above. At the Center for Self-Organizing Software Platform (CSOS) we handled the virtual-prototype-based embedded software development environment, which led on to an embedded software platform for self-organizing information appliances and to swarm cognitive middleware.

Virtual Verification Platforms Combining Data and CAE

For textile materials and composite structures we build virtual verification platforms that connect manufacturing data to AI models and CAE analysis. The aim is to standardise the verification procedure so design candidates can be filtered before a prototype is made. We also work on problems where data quality decides the outcome, such as predicting tensile strength and elongation of biodegradable fibres and 2D image-based virtual try-on.

Selected Records

The list below is a selection. Some records sit on the boundary between areas, so it is not exhaustive; the full list is in the Archive. Titles and author names are kept in their original language.

  • 드레스 특성 클러스터별 검증을 통한 재학습 기반 가상 착의 모델PhD Thesis

    서정민

    경북대학교, 2024

    Full text
  • A Study on the Improvement of Complex Characteristics of Virtual Try-on Based on 2D Image by Convergence of Fashion and Artificial IntelligenceDomestic Journal

    Jung Min Seo, Woo Jin Lee

    The Korean Society of Science & Art, Vol. 40, No. 4, pp. 193-203, 2022-9-30

    DOI
  • 데이터 불균형과 측정 오차를 고려한 생분해성 섬유 인장 강신도 예측 모델 개발Domestic Journal

    박세찬, 김덕엽, 서강복, 이우진

    정보처리학회논문지. 소프트웨어 및 데이터공학, Vol. 11, No. 12, pp. 489-498, 2022-12

    DOI
  • 로그기반의 드론 시뮬레이션 장치 및 방법Patent GrantedDomestic

    이권철, 김덕엽, 서강복, 이우진

    Granted 10-2187315 (2020-12-07)

    Full text
  • 무인 비행체의 비행 테스트 시나리오를 생성하는 장치 및 방법Patent GrantedDomestic

    이성희, 김덕엽, 이우진

    Granted 10-2110147 (2020-05-13)

    Full text
  • 무인 비행체의 비행 테스트 프로파일을 통한 테스트 기법Patent GrantedDomestic

    이성희, 김덕엽, 이우진, 윤보람

    Granted 10-2093734 (2020-03-26)

    Full text
  • 실내 측위 장치 및 방법Patent GrantedDomestic

    이성희, 김덕엽, 이우진, 김용덕

    Granted 10-2025638 (2019-12-13)

    Full text
  • 드론의 비행 안정화를 위한 고도 보정 및 제어 알고리즘 개발MS Thesis

    윤보람

    경북대학교, 2018

    Full text
  • 드론의 고도 측정 장치 및 방법Patent GrantedDomestic

    김덕엽, 윤보람, 이성희, 이우진

    Granted 10-1910741 (2018-10-22)

    Full text
  • 순서기반의 시간 동기화 기법Patent GrantedDomestic

    이성희, 이우진

    Granted 10-1903860 (2018-10-02)

    Full text
  • Relative Time Synchronization of Distributed Applications for Software-in-the-Loop SimulationInternational Conference

    Sunghee Lee, Bueng Il Hwang, Kang-Bok Seo, Woo Jin Lee

    pp. 753-756, 2016-8

    DOI
  • 분산 임베디드 시스템의 통합 시뮬레이션을 위한 메시지 브로커 장치 및 이의 동작 방법Patent GrantedDomestic

    김지훈, 이우진

    Granted 10-1644751 (2016-08-01)

    Full text
  • Design of ZeroMQ-Based Cooperative Simulation Framework for Distributed Code and Model ComponentsInternational Journal

    the Department of Computer Science and Engineering, Kyungpook National University, Republic of Korea, Sunghee Lee, Heungjun Park, the Department of Computer Science and Engineering, Kyungpook National University, Republic of Korea, Woo Jin Lee, the Department of Computer Science and Engineering, Kyungpook National University, Republic of Korea

    International Journal of Future Computer and Communication, Vol. 4, No. 4, pp. 258-261, 2015

    DOI
  • 분산 코드 시뮬레이션을 위한 메세지 브로커 개발MS Thesis

    김지훈

    경북대학교, 2015

    Full text
  • Development of a PC-Based Code Simulator for Verifying Ubiquitous Embedded SoftwareInternational ConferenceCounted as journal

    Sooyong Jeong, Sunghee Lee, Woo Jin Lee

    pp. 587-594, 2014

    DOI
  • Development of SWF Based Virtual Prototyping Framework for Simulating Ubiquitous SystemsInternational ConferenceCounted as journal

    Soo Young Jang, Jihun Kim, Woo Jin Lee

    pp. 557-565, 2014

    DOI
  • 임베디드 시스템의 SWF 기반 가상 프로토타이핑 프레임워크 개발MS Thesis

    장수영

    경북대학교, 2014

    Full text
  • 임베디드 소프트웨어 테스팅을 위한 시뮬레이션 기반의 코드 커버리지 측정 방법Domestic Conference

    정수용, 이승민, 이우진

    2014 대한임베디드공학회 추계학술대회, pp. 476-479, 2014-11

    Full text
  • HLA-RTI 기반의 사물인터넷 상호작용 테스팅 환경 구축을 위한 RTI 인터페이스 설계Domestic Conference

    백태산, 박흥준, 이우진

    2014년 한국정보과학회 학술심포지움논문집, 2014-11

  • A Method of Test Coverage Measurement Based on BitTorrent for Internet of Things EnvironmentDomestic Journal

    Hodong Ryu, Woo Jin Lee

    KIPS Transactions on Computer and Communication Systems, Vol. 3, No. 10, pp. 365-370, 2014-10-31

    DOI
  • VIRTUAL SIMULATION DEVICE AND VIRTUAL SIMULATION SYSTEM INCLUDING THE SAME, AND VIRTUAL SIMULATION METHODPatent FiledInternational

    장수영, 이우진

    Filed 14/019,705 (2013-11-27), US

    Full text
  • 디지털 전환 대응 데이터, AI, CAE 기반 섬유 신소재 및 복합구조체 개발지원 가상검증 플랫폼 구축Research Project

    2022-07-01 ~ 2026-12-31

  • 경북대학교 자율군집소프트웨어연구센터Research Project

    2018-05 ~ 2027-02

  • 군집성 인지 미들웨어 개발Research Project

    2017-09-01 ~ 2018-05-31, 한국연구재단, 연구책임자, KRW 88220K

  • 섬유복합구조체 가상공학플랫폼 구축Research Project

    2017-06 ~ 2022-03

  • 자율비행 드론을 위한 지상제어시스템 개발Research Project

    2016-11-01 ~ 2017-10-31, 중소기업기술정보진흥원, 연구책임자, KRW 40000K

  • 가상화 기반 분산 임베디드 소프트웨어 시뮬레이션 및 상호작용 테스트 기술Research Project

    2014-11-01 ~ 2017-04-30, 한국연구재단, 연구책임자, KRW 25330K

  • 자율군집 소프트웨어 연구센터(CSOS) VP기반 임베디드 SW 개발 환경Research Project

    2011-12 ~ , 한국산업기술평가관리원, 참여연구원

  • 자율군집을 지원하는 웰빙형 정보기기 내장 소프트웨어 플랫폼 개발Research Project

    2011-11 ~ 2016-08