Читать книгу Handbook of Intelligent Computing and Optimization for Sustainable Development - Группа авторов - Страница 91

In this chapter, a robust framework for the detection of garments of interest is proposed. By using a suitable background subtraction algorithm in conjunction with a person detection framework, the foreground information comprising of the garments is obtained. The application of individual color masks and morphological operations is used to obtain garment regions, which could contain multiple detected contours within the same garment. A garment linking process is utilized to link contours belonging to the same garment, thereby obtaining the active garments. The active garments that the customers find interesting, referred to as garments of interest, are obtained by utilizing a confidence score metric. This confidence score is calculated by finding the Euclidean distance between a customer’s wrist landmarks and an active garment and using the area of the active garment in the foreground of the video frames during sales interactions.

The framework was tested on a surveillance video dataset obtained from CCTV footage of an Indian garment store and was found to be effective as demonstrated by the high precision and recall values for the detection of active garments and the competence of confidence threshold in filtering garments of interest from the collection of active garments. Furthermore, the framework successfully tracked the duration for which a customer was interested in a specific garment of interest.

Additionally, we believe that a cogent extension in the future could be to utilize the posture of the head in addition to the line of sight information to improve the determination of the garments of interest for a given customer. Furthermore, visual customer demographics information can be determined from the person masks obtained to filter the garments of interest of different customer groups, enabling us to perform market segmentation. In supplement to the suggested improvements, a mapping between a given customer and the sales merchant can be established in order to determine the collection of garments of interest that are not always adjacent to the wrists of the customer in consideration.