Skip to main content
Download PDF

Implementation of an internet-based stress management program in micro- and small-sized enterprises: a study protocol for a pre-post feasibility study of the effectiveness-implementation hybrid type 2 trial

Pilot and Feasibility Studies volume 10, Article number: 56 (2024) Cite this article

Abstract

Background

Although internet-based stress management programs are proven effective in improving mental health among workers, micro- and small-sized enterprises (MSEs), lacking in occupational healthcare services, face challenges implementing them. To address this gap, this study will develop the program with stakeholders at MSEs to aim for real-world implementation.

Objectives

This paper describes a study protocol for a pre-post feasibility study of an effectiveness-implementation hybrid type 2 trial of text-based internet-based programs (“WellBe-LINE”) in MSEs with less than 50 employees. This feasibility study primarily aims to evaluate trial methods for future effectiveness-implementation hybrid type 2 trials.

Methods

For this study protocol, an internet- and text-based self-care intervention program using the LINE app (a popular message tool in Japan) will be prepared according to evidence-based psychoeducational topics. Based on our online survey findings, personalized algorithms will be implemented according to employees’ gender, age, and psychological distress levels. A personalized program using a popular pre-existing text app is expected to reduce employees’ burdens and be attractive to them, resulting in successful implementation outcomes and mental health benefits. A pre-post design feasibility study will be conducted on ten companies to evaluate trial methods (e.g., recruitment and procedures). The primary outcome will involve individual-level penetration, defined as the proportion of the number of employees who register for the program divided by the total number of invited employees at the company. The progression criterion to go next trial specifies that more than 50% of the recruited companies obtain 60% individual penetration, which is set based on the findings of the prior survey of employees at MSEs and of interviews of stakeholders involved in this study, and will be measured by LINE system. Finally, acceptability, appropriateness, and feasibility will be measured using internet-based questionnaires and interviews.

Discussion

This pre-post feasibility study for future effectiveness-implementation hybrid type 2 trials will provide in-depth knowledge about the successful implementation of text-based, semi-personalized, self-care mental health interventions in real-world settings using both quantitative and qualitative data.

Conclusions

This feasibility study will help validate the effectiveness of text-based interventions using a widely used social networking service (SNS) tool for employees in MSEs.

Trial registration

UMIN clinical trial registration, UMIN000046960. Registered on February 21, 2022.

https://center6.umin.ac.jp/cgi-open-bin/ctr/ctr_view.cgi?recptno=R000053570

Peer Review reports

Contributions to the literature

  • Internet-based mental health interventions in micro- and small-sized enterprises have not been implemented yet.

  • This feasibility study plans to test the implementation strategies to achieve high penetration in employees.

  • This study can provide insights into occupational health implementation in a disadvantaged context.

Background

Worldwide, mental health problems in the workplace impact individual health-related disability and productivity loss [1, 2]. Micro-, small-, or medium-sized enterprises (MSMEs) are important targets for mental health interventions [3] as they represent about 90% of businesses and more than 50% of employment worldwide [4]. However, MSMEs, especially micro- and small-sized enterprises (MSEs) with fewer than 50 employees, are less likely to implement health promotion programs because of limited resources, such as cost, access, and time [5]. Thus, offering evidence-based programs alone may not be valuable for employees. While implementing the primary prevention of mental health in MSMEs is challenging [3], preventive interventions for mental health is generally more effective when used by a large population [6]. Therefore, increasing the adoption and penetration (reach) of health promotion program is  the key objective. To achieve high penetration, interventions and strategies specific for MSEs must consider implementation barriers.

Previous studies have identified barriers to the implementation of mental and health interventions in small companies [7,8,9,10,11,12]: low leadership engagement of employers [7], lack of knowledge about the impact on business [8], limited resources [9, 12], limited time and money [11], regulations (no legal requirement) [12], lack of understanding on the necessity of the interventions, and suboptimal approach [10]. Additionally, job-related stressors between small and large companies varied [13]. In small companies, poor psychosocial factors at work and poor communication are strongly associated with job stress [13]. Therefore, personalized intervention content and specific delivery strategies to overcome organizational barriers in MSEs are needed.

Internet-based interventions are potential options to solve problems of implementing mental health interventions in MSEs, considering high ownership rate of smartphone in Japan. Internet-based intervention is feasible, cost-effective, and accessible [14,15,16], meeting the needs and addressing the low resource (i.e., limited time and money, lack of human resource and occupational health services) at MSEs. A comparison of face-to-face and internet-based interventions revealed no differences in their effectiveness in treating common mental disorders [17, 18]. Even text message-delivered interventions have been proven to be effective for stress management [19]. Including the occupational health settings, the effectiveness of the internet-based interventions without a face-to-face component has been shown in meta-analysis [15, 16].

Moreover, tailoring (or personalizing) messages in internet-based interventions proves even more effective in stimulating changes in health behavior [20]. Internet-based and personalized text message interventions may thus be suitable for improving the acceptance of employees, leading to successful implementation in MSEs. Low-intensity programs can alleviate the burden on workers, and personalized online programs with ease can effectively address stigma at MSEs. Additionally, programs presented in easily understandable language address a wide variety of employees’ knowledge about mental health, resulting in acceptability. Acceptability, appropriateness, and feasibility have been suggested as important implementation aspects of mental health interventions [21,22,23,24]. However, few studies have not been conducted yet examined the effectiveness and implementation outcomes of internet-based interventions for MSEs without some recent protocols [25, 26]. Therefore, methods to improve implementation outcomes (i.e., implementation strategy) should be developed and examined.

As MSME managers have little motivation to implement the program [5, 7], a specific implementation strategy personalized to the context should be adopted. According to the Expert Recommendations for Implementing Change (ERIC), educating stakeholders (employees, employers/managers, and recruiters) is a possible strategy if leadership engagement can be a barrier in the context [27, 28].

Informing employers about the importance of preventive measures in mental health and effective procedures for introducing the program to employees may increase their adoption. However, no study has investigated the effect of internet-based interventions on MSEs with such implementation strategies (i.e., educating employers). Previous implementation research for mental health interventions using the internet or technologies suggested the negative attitude of stakeholders (and, particularly, the users) for internet-based interventions (more preference for face-to-face) [29, 30] and require education for providers [31]

Hybrid-type designed studies can be conducted between effectiveness studies and implementation research [32]. The hybrid type 2 design can be used to test the effectiveness in general practice settings without controlling/ensuring delivery of the intervention and implementation process [32]. Moreover, feasibility and pilot studies [33] can help build and test effective implementation strategies by addressing uncertainties around design and methods and identifying potential causal mechanisms [34]. According to the CONSORT 2010 statement: extension to randomized pilot and feasibility trials, pilot or feasibility studies should have clear criteria for deciding whether to progress to the next full trial [35, 36]. Because there are still many uncertainties in MSEs settings and less evidence is available in implementation research, a pilot feasibility study is important to obtain insights about how we should act in the next stage.

Aims and objectives

This pre-post feasibility study on a future effectiveness-implementation hybrid type 2 trial aims to evaluate the implementation trial procedures of text-based online programs in micro- and small-sized enterprises with less than 50 employees.

The objectives of this feasibility study, in preparation for a future trial, are as follows:

  1. 1.

    To evaluate the feasibility of trial methods (e.g., recruitment, and procedures) and strategies by setting individual-level penetration as an indicator of successful implementation (primary outcome).

  2. 2.

    To evaluate the barriers and facilitators at MSEs to increase individual-level penetration for revising the strategies.

  3. 3.

    To evaluate the acceptability, appropriateness, and feasibility of the program among recruiters, employers/managers, and users.

  4. 4.

    To evaluate the fidelity and cost of delivering the program to employees among recruiters and employers/managers.

  5. 5.

    To ensure no harm on psychological distress of the users.

Methods/design

Program outline of “WellBe-LINE”

The text-based self-care intervention program “WellBe-LINE,” which is customed for employees in MSEs, will be set in the LINE app (commonly used SNS chat tool in Asian countries) based on evidence-based psychological contents. One text message will be sent once per week and includes a website link (URL) for more information. Figure 1 presents an outlook on the message. The portal website (https://wellbeing-kokoro.com/) contains more than 100 articles on mental health, comprising topics about problem solving [37], acceptance and commitment therapy [38], self-compassion [39], sleep hygiene [40], cognitive behavioral therapy for insomnia [41], and physical activity [42]. Figure 2 presents the procedures for starting the program and the intervention schedules.

Fig. 1
figure 1

Outlook of “WellBe-LINE”

Full size image
Fig. 2
figure 2

Procedures of starting “WellBe-LINE” and schedule of the intervention

Full size image

Personalization

A systematic review found that personalization is a key characteristic that promotes attractiveness and acceptability of mobile health interventions [43], through reducing end-users’ acquisition costs. Since lack of awareness of mental health is one of the challenges at MSEs [44], personalization potentially lowers the hurdles to use the program. Personalizing programs are effective at creating changes in health behavior [20], maximizing effectiveness despite the low intensity of the program. We provide 16 scenarios according to the 16 groups (gender × four age categories × psychological distress [K6 ≥ 5, or K6 < 5]) by screening check when participants started the program. Supplementary File 1 presents detailed information about the personalized program. “WellBe-LINE” provides messages in order of rank, from highest to low (week 1 to 8). Supplementary File 2 reports the final personalized scenario for the 16 groups. The efficacy of the “WellBe-LINE” itself has not been examined.

Study design

In the feasibility study, a one-repeated-measure (pre-post) design will be used. Measurements will be taken at baseline (pre) and 8 weeks afterwards (post). Data collected will then be used to further refine the intervention, recruitment, procedures, strategy for disseminating, and power of a subsequent cluster RCT, which is a hybrid type 2 trial. This study protocol was approved by the Research Ethics Committee of the Graduate School of Medicine, Faculty of Medicine, University of Tokyo (2021190NI-(1)). The trial registration is available elsewhere (UMIN000046960).

Participants

At the organizational level, companies with fewer than 50 employees will be recruited. At the individual level, employees over 18 years old will be recruited, regardless of their employment contract (e.g., part time). As this study examines the implementation of preventive programs for all employees, no further exclusion criteria are needed. Individuals not using LINE, without intentions to use LINE, or without devices will not be potential participants, while they will be informed about this research.

Recruitment and procedure

To activate MSEs’ employers/managers, we will use a pre-existing trustful pipe with the MSEs. Five licensed social insurance consultants (recruiters), who are patient public involvement (PPI) members, recruited MSEs that they had a relationship with. Recruiters provide the research information and invitation to demo program (short version of “WellBe-LINE” which finishes in 1 week). If the invited company is interested in participating in the research, the recruiter will provide contact information for researchers. The researchers will then coordinate with the employers/managers on the date of the online meeting (described in the next paragraph).

After the meeting, researchers provide one poster and one original clear file for each employee. Using a template, researchers will also e-mail employees to invite employees to participate in the program. The researcher will provide one “code” for each company. Employers/managers inform employees about the present research by the way they fit the company (e.g., e-mail, posters, and other ways of appealing them). Employees who participate in the program must enter the code after registering for the program via their personal LINE account. Research details will then be explained on the LINE chat, and they will provide their concert by pushing the button to start answering the baseline survey. Employees select their sex and age categories. They also answer six questions about psychological distress (measured by K6). The program automatically recognizes their characteristics (sex × age × distress [5 + high or low]) and starts the program. Employees informed the sensitive information (i.e., the private account information of LINE, psychological distress) will be securely handled by The University of Tokyo under ethical approval and will not be disclosed to the company they are employed through the announcement from the employers/managers and the printed paper material (poster). This study will include individuals with exceeding psychological distress threshold; however, it is justified following two aspects: (i) the program serves as a universal prevention and (ii) high scores of psychological distress are not the same as the psychiatric disorders, instead the reducing the scores is worth in primary preventive interventions.

Online meeting with employers/managers (implementation strategy)

Licensed social insurance recruiters engage in the recruitment process to motivate relevant employers and managers to participate in the study. After obtaining agreement, researchers will provide 30–45 min of online semi-structured lectures (meetings) with employers and managers via zoom to determine the situation at the company and provide knowledge about behavioral changes and an effective way to invite employees for participation and attain high penetration. A previous qualitative study suggested that fundamental factors influencing the implementation of workplace health promotion in SMSEs entail the leadership engagement of employers [7]. Table 1 presents and justifies the contents of the semi-structured lecture with implementation strategy specification guidelines introduced by Proctor et al. [45] for each component. Semi-structured lectures will then be conducted using Microsoft PowerPoint. Psychological techniques for engaging employees are based on classical behavioral psychology related to motivation theory [46,47,48,49] and processing fluency related to health information [50].

Table 1 Specification of the implementation strategy per Proctor et al.’s framework (reference [44])
Full size table

Measurements

Outcomes will be measured using online self-report questionnaires and interviews with participants (employees), employers/managers, and licensed social insurance consultants (recruiters). Table 2 presents outcomes measured for each stakeholder.

Table 2 Quantitative measures, stakeholders, questionnaire assessment points, system detection, and interviews
Full size table

Implementation outcome

  • Penetration (primary)

Individual-level penetration is calculated as the proportion of the number of employees who register for the program divided by the total number of employees at the company. The progression criterion [35] is that over 50% of the recruited companies obtain 60% individual-level adoption. The rationale for setting this goal is that from the results of an online survey of 1000 employees at MSEs, we asked the question, “If the company you work for provided you with information about the program registering as a friend on LINE regarding information useful for mental health and work, would you be willing to do so?” Specifically, 44.8% of the respondents answered “Yes or “Fairly agree” to the question. For the second question, “Please select one app or social networking site that you are most likely to use (or most prefer) when receiving mental health or work-related information.” Meanwhile, 35% of the respondents answered “do not want to receive such self-care information.” From these results, it is assumed that the estimated participation ratio would be 45–65% and that 60% of the company’s own employees would be registered as friends on LINE, which would be considered a high level of penetration at the individual level. If we do not achieve the progression criteria, the entire process and delivery of the program will be revised based on the findings of the present feasibility study.

  • Fidelity of implementation strategies

The implementation strategy of online semi-structured lecture aims to increase the target action of that employers/managers of MSEs announce the intervention “WellBe-LINE” for employees in an effective manner to encourage them to participate as much as possible (Table 1). To assess the fidelity of this strategy, we will conduct interviews with employers/managers about whether they invite employees following the contents of the lecture (Yes/No).

  • Cost of implementation strategies

Cost will be assessed through questionnaires with employers/managers. The time spent on program delivery will be assessed.

  • Acceptability, appropriateness, and feasibility of the program

Acceptability, appropriateness, and feasibility will be measured using questionnaires and interviews with employees (users) and employers/managers. Implementation outcome scales for digital mental health (iOSDMH) will be used in a questionnaire to assess three domains of implementation outcomes [24]. The iOSDMH has three versions (i.e., users, providers, managers, and policymakers). The items of the iOSMDH were developed through a literature review, and the outcome was organized according to Proctor’s implementation outcomes [22]. The response options include a 4-point rating for users and 5-point rating for providers and for managers or policy makers, with the added option of “Don’t know.” In this study protocol, employees will then be asked to use iOSDMH for users and employers/managers by iOSDMH for providers. If employers and managers (or people who are concerned and provide the program in the company) are clearly separated, iOSDMH will be used by managers, policymakers, and providers, respectively.

Health outcome

  • Users’ psychological distress

Psychological distress will be measured using K6 (Kessler 6) [51, 52]. Respondents will be asked to report how frequently they had experienced the following six symptoms in the past 4 weeks: felt nervous, hopeless, restless or fidgety, worthless, depressed, and felt that everything was an effort. Response options include “none of the time,” “a little of the time,” “some of the time,” “most of the time,” and “all of the time. Scores range from 0 to 24. The Japanese version of the K6 exhibits good reliability and validity [53]. K6 works well as the CIDI Short Form in identifying cases of clinically significant mental disorders [52]. Scores over 5 are judged as having moderate psychological distress and can be used as a cutoff point for high or low distress [54, 55]. Reduction of the scores of psychological distress is a commonly used outcome in preventive interventions in the mental health field because it leads to reducing the risk of incidence of psychiatric disease [56].

  • Work performance (HPQ)

Work performance will be evaluated using one item of the WHO Health and Work Performance Questionnaire (HPQ) [57]. Participants will then be asked to rate their overall work performance over the past 4 weeks. Items are scored on a 10-point scale ranging from 0 (worst) to 10 (best), with high scores indicating good work performance. The Japanese version of the HPQ exhibits good reliability [58].

  • Work engagement (UWES-3)

In the ultra-short form of the Utrecht Work Engagement Scale, three items (UWES-3) will be used to assess work engagement [59]. The UWES-3 consists of three subscales (i.e., vigor, dedication, and absorption) with each of one item. The UWES-3 is a self-reported 7-point rating scale (0 = never; 6 = everyday). The mean score of the three UWES subscales, and total score is computed by adding the scores and dividing the sum by the number of items in each subscale. The Japanese version of the UWES-3 exhibits good reliability and validity [60].

  • Job satisfaction

Job satisfaction will be measured using one item from the Brief Job Stress Questionnaire (BJSQ) [61] on a 4-point Likert scale. Higher scores indicated higher job satisfaction.

  • Euthymia

Euthymia is a transdiagnostic construct for well-being and represents psychological flexibility, a unifying outlook on life, and resistance to stress [62, 63]. The euthymia scale (ES) is a 10-item index with dichotomous options (False = 0; True = 1). This results in total scores ranging from 0 to 10, indicating better euthymic state for higher scores. The Japanese version of the ES has high concurrent validity and sensitivity as a clinimetric scale [64].

Process outcome

  • Block rate

LINE accounts can reject or “block” contact from other accounts. We will assess this rate of blocking by system detection.

  • Uncomfortable experience/harms

Uncomfortable experience/harm will be assessed using five items from the iOSDMH [24]. Time consumption, mental symptoms, induced dangerous experiences regarding safety, physical symptoms, and excessive pressure on regular learning will be measured for employees (users) in the questionnaire. Employers/managers and recruiters will be asked to rate the following item: “This program does not result in negative side effects (e.g., physical or psychological symptoms).” The response options are 4-point rating scales for users and 5-point rating scales for providers (managers or policy makers), with the added option of “Don’t know.”

  • Adherence (completion rate)

Whether employees read or engaged with messages could not be accurately detected in LINE owing to technical limitations. Instead, we asked employees to answer four questions related to adherence in the follow-up survey: “How many times did you read the LINE message?” “How many times did you visit the website?” “Did you visit other websites when you received a notification on LINE?” and “Did you read other related articles in the website?”.

Analysis

Sample size

As this is a feasibility study, a formal sample size calculation is not required [35], but we set the target sample size to maximum of 10 companies (200 employees), giving the variety of characteristics of the MSEs. We discussed with stakeholders, who collaborate the next definitive trial, about that this size is enough to proceed to it and agreed. This study protocol also aims to inform sample size in our future definitive trial, while the effect size estimates of feasibility study can be deviated [65]. This study protocol will support our decision to proceed to the next large trial and will be utilized for our revisions to the program and implementation strategy.

The criteria for success of feasibility

This study aims to test a set of feasibility objectives [36] (i.e., trial methods and implementation strategies (online training)). Testing the feasibility is ensured about whether the strategy works for behavioral changes of employers and providers and to improve the targeted primary implementation outcome (penetration). The decision about to proceed the next trial will be made based on the criteria of success of feasibility (i.e., the primary implementation outcome: penetration), which more than half of the participated company achieve 60% of the company’s own employee’s registration to the program. See the section of penetration (primary) in details.

Analysis of other quantitative data

Health outcomes will be evaluated using a paired t-test between pre-(T1) and post-intervention (T2) according to protocol. The effect sizes and 95% CIs will be calculated using Cohen’s d only for those who completed the post-intervention questionnaire. For subgroup analysis, we will conduct the same analysis in the subgroup divided by program completion (completer/non-completer) and satisfaction (satisfied/unsatisfied). Statistical significance will be defined as P < 0.05. IBM SPSS Statistics® version 28 will be used for all analyses.

Analysis of qualitative data

Semi-structured interviews for stakeholders will be conducted after interventions and will be transcribed at the same time during interviews without audio-recording to make the setting secure to talk about negative matters. The interview data will be used to evaluate the barriers and facilitators to provide the program to employees at their worksite and to evaluate the impact of the implementation strategy (i.e., online meetings with employers/managers) on penetration. These evaluations will be used to develop further strategies in the next trial. To determine the barriers and facilitators, descriptive data from the interview will be summarized and informed by the Consolidated Framework for Implementation Research (CFIR) [66]. One interviewer will categorize the description, and all interviewers will confirm its relevance. The priority of the determinants to be addressed in the next trial will be decided by voting and rating. If it is needed, program adaptation and developing new implementation strategies will be followed. In that case, alternative implementation strategies will be developed referring ERIC [28] and following implementation mapping [67]. We will describe the process and experience of making decisions for future cluster RCT.

Patient and public involvement (PPI)

PPI facilitates enhanced quality, appropriateness of research, and development of user-friendly research materials [68]. In our study, seven PPI partners knew about the real context of MSEs: four licensed social insurance consultants, one occupational health physician who provided services in MSEs, one employer in MSEs (one of co-authors, HT), and one manager in the Tokyo Chamber of Commerce and Industry who organized the “Health and Productivity Management.” These PPI partners have participated in all research stages, including the program development, user-relevant research questions, user-friendly materials, more appropriate recruitment strategies for studies, discussion of the interpretation of data, and dissemination of study results. The PPI process is described based on the PPI handbook and reporting checklists [69, 70].

Discussion

This study protocol paper aims to evaluate implementation outcomes via the “WellBe-LINE” in MSEs with less than 50 employees. “WellBe-LINE” is a text-based, semi-personalized, self-care mental health intervention program through the LINE app. The program sends messages with content considered effective at preventing mental issues [37,38,39,40,41,42]. This pre-post feasibility study for future effectiveness-implementation hybrid type 2 trials will provide in-depth knowledge about the successful implementation of self-care interventions in real-world settings using both quantitative and qualitative data. Any adverse events and/or unsuccessful procedures will be utilized to identify alternative strategies before proceeding to the next full trial. No digital mental health intervention specifically for MSEs has not been successfully implemented yet. Thus, the present feasibility study should provide new insights to the both field of occupational health and implementation science.

This study protocol will apply the specific implementation strategy wherein researchers meet with employers/managers online for 30–45 min to encourage them to invite employees to participate in the “WellBe-LINE” Program. This strategy is based on previous findings of leadership engagement being a considerable barrier in the health program implementation [7]. Furthermore, PPI partners who engaged in all research stages will provide essential suggestions in implementation, leading to a positive impact on field-specific studies [68].

Limitation

This study protocol has several limitations. First, the sample size may not be adequate to detect significant effectiveness in reducing psychological distress owing to the pilot nature of this study. Second, this study protocol lacks a control group; the true impact of the implementation strategy can only be determined in the next step. Third, generalizability of the study findings is limited owing to its challenges in the recruitment process. As with the definitive trial, only the MSEs which have high interests in health promotion can be the potential participants through the current recruitment process. Future studies could engage and recruit MSEs with low interests in health promotion may be required in studies with another research focus. Fourth, individual-level penetration may be affected by personal beliefs about mental health issues in the workplace (e.g., social desirability [71], fear of stigmatizations [72], concerns about negative impact at the workplace [73]). Thus, factors not related to the implementation strategy can be considered if the outcomes are evaluated. Fifth, digital interventions risk marginalizing vulnerable groups, such as people with difficulty using devices or without internet access. Ensuring the opportunity to provide the program for all employees is essential in future consideration. Sixth, we will not provide any additional supports to participants with high psychological distress since it is justified under the aim of primary prevention and the contents are relevant to reduce distress, but there still be a potential risk to make conditions worse. Seventh, this feasibility study will collect many exploratory items from participants to utilize the findings in future implementation research. Still, it may cause participants’ burden, resulting in the response bias. Although authors limit the items to as few, the potential burden should be acknowledged. Eighth, fidelity of implementation strategies is evaluated using one simple question, instead of using systematic approach, such as a checklist. Other actions of employers/managers to be achieved through the online lecture should be defined after this feasibility trial to develop a checklist.

Conclusion

MSEs are less likely to implement health promotion programs worldwide, although many employees work there. The low-cost and easy-to-access self-care program “WellBe-LINE” targeted specifically at the needs of MSEs can be a solution, despite its low intensity, if the penetration of employees is applicable. The wide range of evaluations proposed in this study protocol will provide valuable suggestions for implementing preventive health promotion measures in MSEs. Additionally, the study findings can be potentially applied to the program concept and strategies in similarly disadvantaged and marginalized settings, resulting in the promotion of health equity.

Availability of data and materials

The data related to the present study protocol are available from the corresponding author, KI, upon reasonable request.

Abbreviations

BJSQ:

Brief Job Stress Questionnaire

MSEs:

Micro-, small-sized enterprises

MSMEs:

Micro-, small-, or medium-sized enterprises

PPI:

Patient and public involvement

References

  1. Cotton P, Hart PM. Occupational wellbeing and performance: a review of organisational health research. Aust Psychol. 2003;38(2):118–27.

    Article  Google Scholar 

  2. Organization WH. Mental Health in the Workplace 2019. Available from: https://www.who.int/mental_health/in_the_workplace/en/.

  3. Hogg B, Medina JC, Gardoki-Souto I, Serbanescu I, Moreno-Alcazar A, Cerga-Pashoja A, et al. Workplace interventions to reduce depression and anxiety in small and medium-sized enterprises: a systematic review. J Affect Disord. 2021;290:378–86.

    Article  PubMed  Google Scholar 

  4. Bank TW. Small and Medium Enterprises (SMEs) Finance 2022. Available from: https://www.worldbank.org/en/topic/smefinance.

  5. McCoy K, Stinson K, Scott K, Tenney L, Newman LS. Health promotion in small business: a systematic review of factors influencing adoption and effectiveness of worksite wellness programs. J Occup Environ Med. 2014;56(6):579–87.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Arango C, Díaz-Caneja CM, McGorry PD, Rapoport J, Sommer IE, Vorstman JA, et al. Preventive strategies for mental health. Lancet Psychiatry. 2018;5(7):591–604.

    Article  PubMed  Google Scholar 

  7. Saito J, Odawara M, Takahashi H, Fujimori M, Yaguchi-Saito A, Inoue M, et al. Barriers and facilitative factors in the implementation of workplace health promotion activities in small and medium-sized enterprises: a qualitative study. Implement Sci Commun. 2022;3(1):23.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Hughes MC, Patrick DL, Hannon PA, Harris JR, Ghosh DL. Understanding the decision-making process for health promotion programming at small to midsized businesses. Health Promot Pract. 2009;12(4):512–21.

    Article  PubMed  Google Scholar 

  9. Hannon PA, Garson G, Harris JR, Hammerback K, Sopher CJ, Clegg-Thorp C. Workplace health promotion implementation, readiness, and capacity among midsize employers in low-wage industries: a national survey. J Occup Environ Med. 2012;54(11):1337–43.

  10. Pavlista V, Angerer P, Diebig M. Barriers and drivers of psychosocial risk assessments in German micro and small-sized enterprises: a qualitative study with owners and managers. BMC Public Health. 2021;21(1):1376.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Taylor A, Pilkington R, Montgomerie A, Feist H. The role of business size in assessing the uptake of health promoting workplace initiatives in Australia. BMC Public Health. 2016;16(1):1–8.

    Article  Google Scholar 

  12. Masi D, Cagno E. Barriers to OHS interventions in small and medium-sized enterprises. Saf Sci. 2015;71:226–41.

    Article  Google Scholar 

  13. Lai Y, Saridakis G, Blackburn R. Job stress in the United Kingdom: are small and medium-sized enterprises and large enterprises different? Stress Health. 2015;31(3):222–35.

    Article  PubMed  Google Scholar 

  14. Heber E, Ebert DD, Lehr D, Cuijpers P, Berking M, Nobis S, et al. The benefit of web- and computer-based interventions for stress: a systematic review and meta-analysis. J Med Internet Res. 2017;19(2):e32.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Carolan S, Harris PR, Cavanagh K. Improving employee well-being and effectiveness: systematic review and meta-analysis of web-based psychological interventions delivered in the workplace. J Med Internet Res. 2017;19(7):e271.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Stratton E, Lampit A, Choi I, Calvo RA, Harvey SB, Glozier N. Effectiveness of eHealth interventions for reducing mental health conditions in employees: a systematic review and meta-analysis. PloS one. 2017;12(12):e0189904.

  17. Barak A, Hen L, Boniel-Nissim M, Shapira NA. A comprehensive review and a meta-analysis of the effectiveness of internet-based psychotherapeutic interventions. J Technol Human Serv. 2008;26(2–4):109–60.

    Article  Google Scholar 

  18. Cuijpers P, Donker T, van Straten A, Li J, Andersson G. Is guided self-help as effective as face-to-face psychotherapy for depression and anxiety disorders? A systematic review and meta-analysis of comparative outcome studies. Psychol Med. 2010;40(12):1943–57.

    Article  CAS  PubMed  Google Scholar 

  19. Berrouiguet S, Baca-García E, Brandt S, Walter M, Courtet P. Fundamentals for future mobile-health (mHealth): a systematic review of mobile phone and web-based text messaging in mental health. J Med Internet Res. 2016;18(6):e135.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Noar SM, Benac CN, Harris MS. Does tailoring matter? Meta-analytic review of tailored print health behavior change interventions. Psychol Bull. 2007;133(4):673–93.

    Article  PubMed  Google Scholar 

  21. Vis C, Mol M, Kleiboer A, Bührmann L, Finch T, Smit J, et al. Improving implementation of eMental health for mood disorders in routine practice: systematic review of barriers and facilitating factors. JMIR Ment Health. 2018;5(1):e20.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38(2):65–76.

    Article  PubMed  Google Scholar 

  23. Weiner BJ, Lewis CC, Stanick C, Powell BJ, Dorsey CN, Clary AS, et al. Psychometric assessment of three newly developed implementation outcome measures. Implement Sci. 2017;12(1):108.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Sasaki N, Obikane E, Vedanthan R, Imamura K, Cuijpers P, Shimazu T, et al. Implementation outcome scales for digital mental health (iOSDMH): scale development and cross-sectional study. JMIR Form Res. 2021;5(11):e24332.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Arensman E, O'Connor C, Leduc C, Griffin E, Cully G, Ni Dhalaigh D, et al. Mental health promotion and intervention in occupational settings: protocol for a pilot study of the MENTUPP Intervention. Int J Environ Res Public Health. 2022;19(2):947.

  26. Engels M, Boss L, Engels J, Kuhlmann R, Kuske J, Lepper S, et al. Facilitating stress prevention in micro and small-sized enterprises: protocol for a mixed method study to evaluate the effectiveness and implementation process of targeted web-based interventions. BMC Public Health. 2022;22(1):591.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Waltz TJ, Powell BJ, Fernández ME, Abadie B, Damschroder LJ. Choosing implementation strategies to address contextual barriers: diversity in recommendations and future directions. Implement Sci. 2019;14(1):42.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Waltz TJ, Powell BJ, Matthieu MM, Damschroder LJ, Chinman MJ, Smith JL, et al. Use of concept mapping to characterize relationships among implementation strategies and assess their feasibility and importance: results from the Expert Recommendations for Implementing Change (ERIC) study. Implement Sci. 2015;10:109.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Topooco N, Riper H, Araya R, Berking M, Brunn M, Chevreul K, et al. Attitudes towards digital treatment for depression: a European stakeholder survey. Internet Interv. 2017;8:1–9.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Mohr DC, Siddique J, Ho J, Duffecy J, Jin L, Fokuo JK. Interest in behavioral and psychological treatments delivered face-to-face, by telephone, and by internet. Ann Behav Med. 2010;40(1):89–98.

    Article  PubMed  Google Scholar 

  31. Andersson G, Titov N, Dear BF, Rozental A, Carlbring P. Internet-delivered psychological treatments: from innovation to implementation. World Psychiatry. 2019;18(1):20–8.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217–26.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Eldridge SM, Lancaster GA, Campbell MJ, Thabane L, Hopewell S, Coleman CL, et al. Defining feasibility and pilot studies in preparation for randomised controlled trials: development of a conceptual framework. PLoS ONE. 2016;11(3):e0150205.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Pearson N, Naylor PJ, Ashe MC, Fernandez M, Yoong SL, Wolfenden L. Guidance for conducting feasibility and pilot studies for implementation trials. Pilot Feasibility Stud. 2020;6(1):167.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Eldridge SM, Chan CL, Campbell MJ, Bond CM, Hopewell S, Thabane L, et al. CONSORT 2010 statement: extension to randomised pilot and feasibility trials. Pilot Feasib Stud. 2016;2(1):64.

    Article  Google Scholar 

  36. Thabane L, Lancaster G. A guide to the reporting of protocols of pilot and feasibility trials. Pilot Feasib Stud. 2019;5(1):37.

    Article  Google Scholar 

  37. D’zurilla TJ, Goldfried MR. Problem solving and behavior modification. J Abnormal Psychol. 1971;78(1):107.

    Article  Google Scholar 

  38. Hayes SC, Levin ME, Plumb-Vilardaga J, Villatte JL, Pistorello J. Acceptance and commitment therapy and contextual behavioral science: examining the progress of a distinctive model of behavioral and cognitive therapy. Behav Ther. 2013;44(2):180–98.

    Article  PubMed  Google Scholar 

  39. Neff K. Self-compassion: The proven power of being kind to yourself: Harper Collins. 2011.

  40. Hauri P. Current concepts: the sleep disorders. Kalamazoo, MI: The Upjohn Company; 1977.

    Google Scholar 

  41. Cheng SK, Dizon J. Computerised cognitive behavioural therapy for insomnia: a systematic review and meta-analysis. Psychother Psychosom. 2012;81(4):206–16.

    Article  PubMed  Google Scholar 

  42. Mammen G, Faulkner G. Physical activity and the prevention of depression: a systematic review of prospective studies. Am J Prev Med. 2013;45(5):649–57.

    Article  PubMed  Google Scholar 

  43. Wang C, Qi H. Influencing factors of acceptance and use behavior of mobile health application users: systematic review. Healthcare (Basel, Switzerland). 2021;9(3):357.

  44. Benning FE, van Oostrom SH, van Nassau F, Schaap R, Anema JR, Proper KI. The implementation of preventive health measures in small- and medium-sized enterprises—a combined quantitative/qualitative study of its determinants from the perspective of enterprise representatives. Int J Environ Res Public Health. 2022;19(7):3904.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013;8:139.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Bandura A. Self-efficacy: toward a unifying theory of behavioral change. Psychol Rev. 1977;84(2):191.

    Article  CAS  PubMed  Google Scholar 

  47. Atkinson JW. An introduction to motivation. 1964.

    Google Scholar 

  48. Deci EL, Cascio WF, Krusell J. Cognitive evaluation theory and some comments on the Calder and Staw critique. 1975.

    Book  Google Scholar 

  49. Ryan RM, Deci EL. Overview of self-determination theory: an organismic dialectical perspective. Handbook Self-determination Res. 2002;2:3–33.

    Google Scholar 

  50. Okuhara T, Ishikawa H, Goto E, Okada M, Kato M, Kiuchi T. Processing fluency effect of a leaflet for breast and cervical cancer screening: a randomized controlled study in Japan. Psychol Health Med. 2018;23(10):1250–60.

    Article  PubMed  Google Scholar 

  51. Kessler RC, Andrews G, Colpe LJ, Hiripi E, Mroczek DK, Normand SL, et al. Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol Med. 2002;32(6):959–76.

    Article  CAS  PubMed  Google Scholar 

  52. Kessler RC, Barker PR, Colpe LJ, Epstein JF, Gfroerer JC, Hiripi E, et al. Screening for serious mental illness in the general population. Arch Gen Psychiatry. 2003;60(2):184–9.

    Article  PubMed  Google Scholar 

  53. Sakurai K, Nishi A, Kondo K, Yanagida K, Kawakami N. Screening performance of K6/K10 and other screening instruments for mood and anxiety disorders in Japan. Psychiatry Clin Neurosci. 2011;65(5):434–41.

    Article  PubMed  Google Scholar 

  54. Prochaska JJ, Sung HY, Max W, Shi Y, Ong M. Validity study of the K6 scale as a measure of moderate mental distress based on mental health treatment need and utilization. Int J Methods Psychiatr Res. 2012;21(2):88–97.

    Article  PubMed  PubMed Central  Google Scholar 

  55. Nishi D, Imamura K, Watanabe K, Ishikawa H, Tachimori H, Takeshima T, et al. Psychological distress with and without a history of depression: results from the World Mental Health Japan 2nd Survey (WMHJ2). J Affect Disord. 2020;265:545–51.

    Article  PubMed  Google Scholar 

  56. Singh V, Kumar A, Gupta S. Mental Health Prevention and Promotion-A Narrative Review. Front Psych. 2022;13:898009.

    Article  Google Scholar 

  57. Kessler RC, Barber C, Beck A, Berglund P, Cleary PD, McKenas D, et al. The world health organization health and work performance questionnaire (HPQ). J Occup Environ Med. 2003;45(2):156–74.

    Article  PubMed  Google Scholar 

  58. Kawakami N, Inoue A, Tsuchiya M, Watanabe K, Imamura K, Iida M, et al. Construct validity and test-retest reliability of the World Mental Health Japan version of the World Health Organization Health and Work Performance Questionnaire Short Version: a preliminary study. Ind Health. 2020;58(4):375–87.

  59. Schaufeli WB, Salanova M, González-Romá V, Bakker AB. The measurement of engagement and burnout: a two sample confirmatory factor analytic approach. J Happiness Stud. 2002;3(1):71–92.

    Article  Google Scholar 

  60. Schaufeli WB, Shimazu A, Hakanen J, Salanova M, De Witte H. An ultra-short measure for work engagement: the UWES-3 validation across five countries. 2017.

    Google Scholar 

  61. Shimomitsu T, Ohno H, Maruta T, Tanigawa T. Investigation research report concerning prevention of disease related to work in 1997 the Ministry of Labor: III Stress measurement research group report. Tokyo: Tokyo Medical University; 2000. p. 101–69.

    Google Scholar 

  62. Fava GA, Bech P. The concept of euthymia. Psychother Psychosom. 2016;85(1):1–5.

    Article  PubMed  Google Scholar 

  63. Fava GA, Guidi J. The pursuit of euthymia. World Psychiatry. 2020;19(1):40–50.

    Article  PubMed  PubMed Central  Google Scholar 

  64. Sasaki N, Carrozzino D, Nishi D. Sensitivity and concurrent validity of the Japanese version of the Euthymia scale: a clinimetric analysis. BMC Psychiatry. 2021;21(1):482.

    Article  PubMed  PubMed Central  Google Scholar 

  65. Kistin C, Silverstein M. Pilot studies: a critical but potentially misused component of interventional research. JAMA. 2015;314(15):1561–2.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  66. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.

    Article  PubMed  PubMed Central  Google Scholar 

  67. Fernandez ME, Ten Hoor GA, van Lieshout S, Rodriguez SA, Beidas RS, Parcel G, et al. Implementation mapping: using intervention mapping to develop implementation strategies. Front Public Health. 2019;7:158.

    Article  PubMed  PubMed Central  Google Scholar 

  68. Brett J, Staniszewska S, Mockford C, Herron-Marx S, Hughes J, Tysall C, et al. Mapping the impact of patient and public involvement on health and social care research: a systematic review. Health Expect. 2014;17(5):637–50.

    Article  PubMed  Google Scholar 

  69. (NIHR) NIfHR. Patient and public involvement in health and social care research: handbook for researchers 2019. Available from: https://www.rds-london.nihr.ac.uk/resources/#public-involvement.

  70. Staniszewska S, Brett J, Simera I, Seers K, Mockford C, Goodlad S, et al. GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research. BMJ (Clinical research ed). 2017;358:j3453.

    Article  CAS  PubMed  Google Scholar 

  71. Podsakoff PM, Organ DW. Self-reports in organizational research: problems and prospects. J Manag. 1986;12(4):531–44.

    Google Scholar 

  72. Wheat K, Brohan E, Henderson C, Thornicroft G. Mental illness and the workplace: conceal or reveal? J R Soc Med. 2010;103(3):83–6.

    Article  PubMed  PubMed Central  Google Scholar 

  73. Jones AM. Disclosure of mental illness in the workplace: a literature review. Am J Psychiatr Rehabil. 2011;14(3):212–29.

    Article  Google Scholar 

Download references

Acknowledgements

This study protocol was supported by the National Center Consortium in Implementation Science for Health Equity (N-EQUITY) funded by the Japan Health Research Promotion Bureau (JH) Research Fund (2019-(1)-4) and JH Project Fund (JHP2022-J-02).

Funding

This work was supported by a work-related diseases clinical research grant 2020 (200401–01) and JSPS KAKENHI Grant Number JP22K03168. Sponsors had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Author information

Authors and Affiliations

  1. Department of Mental Health, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan

    Natsu Sasaki, Hajime Takeno, Sayaka Ogawa & Kotaro Imamura

  2. Division of Behavioral Sciences, National Cancer Center Institute for Cancer Control, National Cancer Center, Tokyo, Japan

    Taichi Shimazu

  3. Department of Psychiatric Nursing, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan

    Utako Sawada

  4. Department of Public Health, Kitasato University School of Medicine, Sagamihara, Japan

    Akizumi Tsutsumi

  5. Department of Digital Mental Health, Graduate School of Medicine, The University of Tokyo, 7-3-1, Hongo, Bunkyo-Ku, Tokyo, 113-8655, Japan

    Kotaro Imamura

Authors
  1. Natsu Sasaki
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Taichi Shimazu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hajime Takeno
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sayaka Ogawa
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Utako Sawada
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Akizumi Tsutsumi
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Kotaro Imamura
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

KI was in charge of this study protocol, supervised the process, and provided his expert opinion. AT provided expert suggestions regarding the study concept as a supervisor. NS and KI organized the study design. SO and US supported the study management. HT analyzed the pilot data and created an algorithm for the program. Collaborator TS provided his expert opinion from the viewpoint of implementation science and ensured that questions related to the accuracy or integrity of any part of the work were appropriately investigated and resolved. NS and KI wrote the first draft of the manuscript, and all the other authors critically revised the manuscript. All the authors approved the final version of the manuscript.

Corresponding author

Correspondence to Kotaro Imamura.

Ethics declarations

Ethics approval and consent to participate

This study protocol was approved by the Research Ethics Committee of the Graduate School of Medicine/Faculty of Medicine, The University of Tokyo, No.2021190NI-(1).

Consent for publication

Not applicable.

Competing interests

NS reports personal fees from Medilio Inc. outside the submitted work.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Supplementary files 1 and 2.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sasaki, N., Shimazu, T., Takeno, H. et al. Implementation of an internet-based stress management program in micro- and small-sized enterprises: a study protocol for a pre-post feasibility study of the effectiveness-implementation hybrid type 2 trial. Pilot Feasibility Stud 10, 56 (2024). https://doi.org/10.1186/s40814-024-01481-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40814-024-01481-9

Keywords

Pilot and Feasibility Studies

ISSN: 2055-5784