Ensuring worker safety in construction remains a persistent challenge due to dynamic environments, diverse project types, and resource-intensive traditional monitoring approaches. Emerging digital technologies offer opportunities to enhance safety oversight by enabling real-time data collection, automated detection, and systematic reporting. However, practical adoption requires clarity on which activities should be prioritized for automation and how safety data should be structured for effective use at management levels. This study proposes a framework for digital worker safety monitoring that addresses these needs through three main contributions. First, two categories of monitoring activities were defined: worker safety compliance (W1) and worker health monitoring (W2), with five specific sub-activities identified through literature review and expert interviews. Second, expert workshops and structured ranking revealed that W1 activities, such as restricted-area access control, and equipment–worker distance monitoring, hold higher priority for digitalization compared to W2 activities, which remain context-dependent and technologically less mature. Third, a reference data schema was developed to guide standardized data collection and integration across four layers: site components, activity records, safety management, and project management. The proposed framework contributes to the digital transformation of construction safety management by clarifying activity priorities and providing a robust foundation for system implementation.