Research papers

← vista completa

Cultural adaptation and reliability of the instrument Five-part questionnaire on hypermobility to the Peruvian context

Adaptación cultural y confiabilidad del instrumento Five-part questionnaire on hypermobility al contexto peruano

Abstract

Introduction For the diagnosis of joint hypermobility, the Beighton test is commonly used; this requires a professional for the physical examination. The "Five- part questionnaire on hypermobility" is a self- administered tool that allows early identification of joint hypermobility.

Objective To carry out the cultural adaptation and test- retest reliability of the "Five- part questionnaire on hypermobility" to the Peruvian context through translation into spanish, linguistic adaptation, and verification of test- retest reliability in students from 13 to 17 years of age and teachers/ad-ministrators from 24 to 60 years of age.

Methods A translation and back- translation were performed with two translators and two back- translators, followed by a linguistic adaptation with ten experts. Once the adapted version of the question-naire was obtained, a comprehensibility analysis was carried out with 50 subjects. Finally, test- retest reliability was estimated in two groups: adolescents aged 13 to 17 and adults aged 24 to 60.

Results The translated version of the questionnaire was obtained and underwent a linguistic adaptation process in which ten experts performed a concordance analysis (Aiken's V coefficient = 1), and a comprehensibility analysis with a scale of zero to ten obtained an average of ten points. Subsequently, this version was back- translated and checked against the original. In the reliability analysis, the results of the test- retest application found high reliability between the total score of both applications for both the group of 65 adults (Kappa 0.795; 95% CI: 0.777 to 0.819) and the group of 71 adolescents (Kappa 0.946; 95% CI: 0.908 to 0.982).

Conclusions The translated instrument "Five- part questionnaire (5pq) on hypermobility" was adapted to the Peruvian cultural context, and high reliability was found for the study groups 13 to 17 years and 24 to 60 years. Concurrent validation is recommended to consider its application in clinical and research settings.

Main messages

  • The assessment of joint hyperlaxity is mainly performed by physical examination. A validated questionnaire has been developed in several languages, useful for screening this condition, but a translated or adapted version to the Peruvian context has not been found.
  • This study achieved an adequate translation, linguistic adaptation, and back-translation of the questionnaire. In addition, high reliability was observed in applying the test-retest in the study population.
  • This study has identified limitations centered on selection biases in those populations with linguistic and cultural variations from different regions of Peru or native populations whose second language is Spanish are not represented.

Introduction

Hyperlaxity is a hereditary disorder of the connective tissue, in which collagen is the affected component, increasing the elasticity of this tissue [1,2,3]. This alteration may be asymptomatic [4,5,6,7,8], but one or more joints may exceed the limit of the normal range of motion. On the other hand, there is symptomatic hyperlaxity [4,5,9,10], commonly known as joint hyperlaxity syndrome, in which, in addition to the excessive range of motion, other criteria are added: increased skin elasticity, weakness of support structures of internal organs [1,6,11], presence of pain and instability [4,12,13], frequent sprains or dislocations [14,15,16], and bleeding [17], among others.

The prevalence of hyperlaxity ranges from 10 to 20% in the western population, being more frequent in women; 1.2 times more than in men [18]. Similarly, studies conducted on children and adults between five and forty-five years of age in Peru showed that more than 50% of children under eight years of age suffered from joint hyperlaxity, being more frequent in women [19].

A physical examination of the person is required for diagnosing this pathology, and the Beighton test is commonly used as a clinical criterion [20,21]. This tool evaluates five joints with nine items, being positive if four to nine points are obtained [22]. It is also widely used by specialists due to its simplicity and ability to be used in large groups of people [18].

Although the Beighton scale is a valid and reliable instrument for diagnosing hyperlaxity [23,24], it is not suitable for self-assessment as it requires a physical examination by a healthcare professional. Additionally, it does not include common sites of hypermobility [2]. For this reason, in 2003, Grahame and Hakin presented the "Five-part questionnaire to identify the presence of generalized joint hypermobility". This questionnaire has five checklist items (yes, no) to identify current or past signs of hyperlaxity. The final score of the questionnaire is obtained from the sum of each item’s score, being that each item is one point (yes: one, no: zero). Likewise, the category of hypermobility is determined by a final score greater than or equal to two points; thus, suggested as "hypermobile". The Grahame and Hakin questionnaire presents a sensitivity of 75 to 85% and a specificity of 89% in the original english version [18,25], the brazilian version obtained a sensitivity of 70.9% and a specificity of 77.4% [2]. The reliability for the swedish version for all items had an intraclass test-retest correlation coefficient of 0.92 [20]. Data from both versions were validated concurrently with the gold standard "Beighton test". Currently, there is no spanish version adapted to the Peruvian context.

The objective of this research was to translate into spanish, linguistically adapt and verify the test-retest reliability of the "Five-part questionnaire" in students aged 13 to 17 years and teachers/administrators aged 24 to 60 years.

Methods

The study was carried out in three stages:

  1. Translation and back-translation, which looked for a spanish version equivalent to the english one.

  2. Linguistic adaptation: the purpose was to verify whether the language was adapted to the targeted population. These first two stages were carried out by referencing a proposed guideline widely used internationally [26].

  3. Evaluation of test-retest reliability to assess the temporal stability of the instrument using a two-stage application of the questionnaire (test-retest) and to compare concordance between the results of the two applications.

In order to carry out the study, authorization for the use of the instrument was requested through communication with one of the main authors, Dr. Alan Hakim, a rheumatologist and professor at the Platinum Medical Center Wellington Hospital in London, who gave authorization for the use of the questionnaire in the development of this research.

The translation and back-translation process began with the transcription into spanish by two translators. A third translator was asked to mediate if no agreement was reached. Once the final version of the translation process of the study instrument was obtained, the linguistic adaptation was carried out by analyzing the semantic equivalence to the Peruvian population, carried out by a group of spanish-speaking experts. This process was carried out under expert judgment. In this process, ten experts were selected amongst education and health professionals who met the pre-established criteria: to be a university professional in health sciences and, to be a university professional in education sciences, for the health expert and the education expert, respectively. As general criteria for both experts, they were required to have at least five years of work experience in the educational or health field, as appropriate, at least five years of experience working with school populations (basic secondary education), and to have postgraduate studies at the specialty, masters, or higher level.

The experts had to evaluate each item of the questionnaire and reach a consensus on whether the language and terminology were understandable, objective, and adequate for the targeted population without generating confusion or ambiguity in the terms. The evaluation of each item by each specialist was rated using the Likert scale (1: total disagreement, 2: disagreement, 3: neutral, 4: agreement, 5: total agreement) and the comprehensibility scale from 0 (not understandable) to 10 points (very understandable). The next step was to ratify and make the relevant corrections and recommendations, among which it was proposed to include images to better describe the questions in the questionnaire.

Once the translated version was obtained, the phase of back-translation into the original language (english) was carried out by two back-translators, who would determine the approval of the similarity of both versions. In case of disagreement, a third translator would be asked to settle the dispute.

Once the final adapted version of the questionnaire had been prepared, a comprehensibility analysis was carried out on 50 people (ten people per item) from the population to be investigated to verify whether the appropriate interpretation of each question was achieved. For this purpose, the questionnaire tailored by the experts was used, asking them at the end of each item, "Did you have any difficulty in understanding the question and/or image?" with yes/no answer options and a space to identify the difficulty encountered. As a result, acceptance was obtained from all 50 participants, so we proceeded to perform the reliability analysis.

For the final step, the reliability analysis of the instrument, two population strata were considered, the first made up of schoolchildren and the second of teachers and administrators of an educational institution.

The inclusion criteria for the group of schoolchildren were: age between 13 and 17 years, students enrolled in the 2021 school year at the secondary level, informed consent, and assent.

For the group of adults: age between 24 and 60 years, being active teachers or administrators, and presenting informed consent.

The exclusion criteria were: previous medical diagnosis of diseases such as quadriplegia, hemiplegia, diplegia, arthrosis, and dislocations of less than six months.

A sample size calculation was performed to estimate the number of people needed to verify the test-retest reliability of the "Five-part questionnaire on hypermobility - Peruvian version", using Cohen’s Kappa coefficient [27]. Considering the following parameters: Cohen’s Kappa coefficient to detect 0.48 [2], 95% CI, and 90% power. The result was a minimum sample size of 62 subjects per group (62 students and 62 teachers/administrators). The sampling was non-probabilistic consecutive by invitation, i.e., all students and teachers of the institution were invited to participate. Only those who decided to participate and met the inclusion parameters were considered in the research.

Regarding the reliability analysis of the questionnaire, we used the final version adapted using the Google Forms survey format, which included consent for the adult group and informed assent for the adolescent group. In addition, general data were collected, including information on gender, age, education, cultural identification, and background. The time between the test and retest was seven days for each population group.

To perform the data analysis and to obtain expert agreement, we used the online Aiken’s V coefficient calculator from Psychometricians.com [28]. A database was previously obtained in Microsoft Excel for comprehensibility and reliability analysis. This information was examined using STATA 16 statistical software (Stata Corp-Texas). The descriptive analysis of the sociodemographic characteristics of the sample of adults and adolescents was evaluated by test-retest. For the categorical variables, we used frequencies and percentages; for the numerical variables, mean and standard deviations or median and interquartile ranges, according to the distribution of the variables in question.

The Aiken V coefficient was used for the inter-judge agreement analysis, the mean and standard deviation for the comprehensibility analysis, and Cohen’s Kappa coefficient for the test-retest reliability analysis for each item. The overall score was obtained from the sum of each participant’s answers in the questionnaire; the category of "hypermobile" was given if a score greater than or equal to two was achieved in the questionnaire.

The research project was approved before data collection by the Research Ethics Committee of the Faculty of Health Sciences of the Universidad Peruana de Ciencias Aplicadas (FCS-CEI/144-03-21). The participants in this study were informed about the objective of this research. Likewise, in the group of underage students, they presented the informed consent signed by their parents or legal guardians, together with an informed consent form. Informed consent was required for the participation of teachers in this study. All information provided by the participants was kept in complete confidentiality. In addition, participants were free to withdraw from the study if they wished to do so.

Results

The direct translation from english to spanish was carried out by two Peruvian translators whose native language is spanish. Both translators were certified in english, one of them a physician and the other with extensive experience in research work. Secondly, we reconciled the versions with both translators without success. Therefore, a third translator was summoned, with whom both translations were synthesized, obtaining the final translated version. Thirdly, the back-translation (from spanish to english) was carried out. Two native english-speaking translators carried out this phase with a mastery of spanish; additionally, one of them knew medical terminology. Subsequently, the final version in english, obtained from the synthesis of both translations, was prepared for the cultural adaptation process (Table 1). This final version was then compared to the original version of the study questionnaire, which was approved by the back-translators.

Structure of the "Five-part questionnaire" (5-PQ) of the translated version adapted to the Peruvian context.
View table

For the last questionnaire evaluation, experts were summoned through meetings via the ZOOM© platform. In this meeting, experts agreed on the need for a cultural adaptation by including images to complement the questions. The final version using images can be viewed at the following link: https://doi.org/10.6084/m9.figshare.19086743.v1; the latter obtained unanimous approval from the experts. The level of agreement of the experts for the semantic and cultural adaptation was made by calculating the Aiken V coefficient. This coefficient compared the initial translated version and the adapted version, corroborating that the concordance (linguistic accuracy, objectivity, and adequate vocabulary) and comprehensibility in the final format of the adapted version were approved by the experts (Table 2).

Expert evaluation of the linguistic adaptation and comprehensibility of the "Short Questionnaire - 5PQ spanish version" (n = 10).
View table

Secondarily, a comprehensibility analysis was applied to the targeted populations. Fifty subjects of both sexes participated 22 schoolchildren between 14 and 17 years of age and 28 adults between 18 and 62. All participants responded that they understood the items and images of the questionnaire (Aiken’s V = 1); no problem or reason for difficulty in understanding any item of the questionnaire was reported.

Finally, for the test-retest reliability analysis, a total of 141 people were included in the study: 71 belonged to the adolescent group and 70 subjects to the adult group, from which five adults were excluded since they had a history of arthritis. The adolescent group comprised 37 males (52.1%) and 34 females (47.9%). The mean age was 14.7 years, with the group aged 16 to 17 being the most represented; 66.2% culturally identified themselves as mestizo. In the adult group, 69.2% of the participants were female, while 30.8% were male, of whom 80.0% regarded themselves as mestizos. The most frequent age group was 41 to 60 years old. In both groups, all of them were spanish native speakers (Table 3).

Sociodemographic characteristics of the adults and adolescents evaluated by test-retest.
View table

The comparison of the test-retest items was performed using Cohen’s Kappa coefficient. We observed that in each question of the questionnaire, there was a high and very high concordance between the answers of both tests (p < 0.0001) (Table 4).

Test-retest reliability of the "Short Questionnaire - 5PQ spanish version".
View table

Discussion

Since the creation of the Five-part questionnaire on hypermobility in English by Hakim AJ and Grahame R., which aims to synthesize Beighton’s questionnaire to detect the presence of suggestive signs of joint hypermobility [25], it has been translated into two languages: portuguese [2] and swedish [20]. The portuguese translation and adaptation [2] involved a scientific translator and four Brazilian rheumatologists with official english language certification. Subsequently, the five versions obtained were discussed until a consensus was reached on the final portuguese version. The consensus version was back-translated by two scientific translators, one of whom was a native english speaker and the other non-native. The original and translated versions were compared, showing high similarity. Subsequently, it was applied to a pilot group, which suggested that images should be added to the five questions for a better understanding.

On the other hand, the translation of the questionnaire into Swedish [20] consisted of two translators, one with knowledge of medical terminology and the other a Native American fluent in Swedish. Both discussed and agreed on the final version of the swedish translation. In the back-translation phase, two professional native english translators presented the back-translated version from swedish. Both versions were compared, showing a lack of equivalence to the term "double articulation"; however, it was considered an informal term with no implications on the interpretation and understanding of each item.

In contrast, in this study, translating the spanish version into the Peruvian context involved two native Peruvian translators with english language certification; additionally, one knew medical terminology. Subsequently, both versions were agreed upon, and a third translator was used to reconcile both translations. The cultural adaptation phase followed this, carried out by ten experts, and the final version of the questionnaire showed high concordance (Aiken’s V = 1) and comprehensibility for each item. Finally, the back-translation phase was carried out by two translators: one a native Canadian and the second a Native American, who agreed that both back-translated versions were similar to the original version of the questionnaire.

In this study, the instrument’s reliability translated and adapted to the Peruvian context in the adolescent and adult population was confirmed. All items corresponding to the questionnaire showed high test-retest reliability.

In the validation and reliability study of the self-assessment questionnaire under study, applied in the Swedish adult population, substantial and almost perfect reliability was found in four of the five questions according to the Kappa coefficient: item 1 (0.9), item 2 (0.8), item 3 (1.0), item 4 (not applicable) and item 5 (0.7), thus demonstrating the degree of reliability of the questionnaire [20]. For its part, the translation and validation study of the Brazilian 5-question short questionnaire obtained the following Kappa values: 1 (0.6), 2 (0.7), and 3 (0.7), while a moderate agreement was observed for questions 4 (0.6) and 5 (0.5), demonstrating overall good to moderate reliability [2].

Likewise, our research had similar results to the articles mentioned above. Using Cohen’s Kappa, high and very high statistically significant values were obtained, which estimate the reliability of each questionnaire item in the Peruvian context. It is therefore recommended to perform concurrent validation of this self-applicable questionnaire, which will allow its use at the clinical level and for the early detection of hyperlaxity.

The study has identified limitations centered on selection biases in those populations with linguistic and cultural variations from different regions of Peru or native people whose second language is spanish are not represented, for which specific reliability studies are suggested. Something similar occurred with the adolescents who presented hypermobility: they had a higher rate of acceptance to the study than those who did not present this condition. Likewise, concerning age, subjects between 18 and 23 years of age have not been included in the reliability analysis, although we would not expect to find differences. In addition, it is suggested that an internal consistency analysis be carried out to verify the correlation between the instrument items.

Conclusions

We carried out the translation and back-translation of the spanish version of the "Five-part questionnaire on hypermobility" for the Peruvian population, showing an adequate semantic equivalence in both translations. Likewise, it was observed that the cultural adaptation carried out by a group of expert judges presented an excellent evaluation in the concordance and comprehensibility index. Similarly, it proved to be comprehensible in a sample of 50 subjects.

In the reliability phase, it was observed that the test-retest application showed a high level of reliability. Therefore, it is reported that the study instrument in spanish adapted for the Peruvian population is a reliable tool for detecting joint hyperlaxity. Still, it requires concurrent validation with the Beighton test.