The paper deals with processing data obtained using nailfold high-speed videocapillaroscopy. To detect the red blood cells velocity two approaches are used. The deterministic approach is based on pixel intensities analysis for object detection and calculation of the displacement and velocity of red blood cells in a capillary. The obtained data formulate targets for the second approach. The stochastic approach is based on a sequence of artificial neural networks. The semantic segmentation network UNet is used for capillary detection. Then, the classification network GoogLeNet or ResNet is used as a feature extractor to convert masked video frames to a sequence of feature vectors. And finally, the long short-term memory network is used to approximate the red blood cells velocity. The results demonstrated that the accuracy of the mean velocity approximation in the time range of several seconds is up to 0.96. But the accuracy at each specific time moment is less accurate. So, the proposed algorithm allows the determination of the RBCs mean velocity but it doesn't allow determination of the RBCs pulsations accurate enough.
|Journal||Progress in Biomedical Optics and Imaging - Proceedings of SPIE|
|Publication status||Published - 29 Apr 2022|
|Event||Saratov Fall Meeting 2021: Computational Biophysics and Nanobiophotonics - Saratov, Russian Federation|
Duration: 27 Sep 2021 → 1 Oct 2021
Bibliographical noteCopyright 2022 SPIE. One print or electronic copy may be made for personal use only. Systematic reproduction, duplication of any material in this paper for a fee or for commercial purposes, or modification of the content of the paper are prohibited.
The is work is funded by the Russian Science Foundation under the grant No 20-79-00332.
- deep learning
- feature extraction
- red blood cells
- semantic segmentation
- transfer learning