Recommendation

Developmental Coordination Disorder Diagnosis as Part of Evolving Self-Concepts

ORCID_LOGO based on reviews by Moin Syed, Gill Waters and Catherine Purcell
A recommendation of:
toto

Through the lens of Developmental Coordination Disorder (DCD): experiences of a late diagnosis

Abstract

EN
AR
ES
FR
HI
JA
PT
RU
ZH-CN
Submission: posted 11 January 2022
Recommendation: posted 02 August 2022, validated 05 August 2022
Cite this recommendation as:
Karhulahti, V. (2022) Developmental Coordination Disorder Diagnosis as Part of Evolving Self-Concepts. Peer Community in Registered Reports, . https://rr.peercommunityin.org/articles/rec?id=156

Recommendation

Although developmental coordination disorder (DCD) is a common neurodevelopmental disorder with an estimated prevalence of up to 6% in children (APA, 2013), many DCD diagnoses are not made before late adulthood. Receiving a neurodevelopmental disorder diagnosis has been found adding to people’s self-concepts, for instance, with autism spectrum disorder (Tan, 2018), but it is not well known if and how such events unfold in late DCD diagnoses. In this Stage 1 Registered Report, Topor et al. (2022) present a careful plan to qualitatively investigate the lived experiences of individuals with a late DCD diagnosis in order to map out the variety of emotional responses to diagnoses and their effects on self-concepts.

Topor et al. (2022) will carry out 10–15 semi-structured interviews with participants who received a DCD diagnosis at the age of 30 or after. They commit to realist epistemology when utilizing thematic analysis; namely, instructions have been preregistered for two separate analysts who will code the transcript data independently. At the same time, the methodology involves reflexive components. The authors have prepared strong positionality statements through which their analyses will be carried out with post-analysis reflections to be written at Stage 2. The coding process will explicitly involve a data analysis log that pursues interpretive transparency. The data and materials will be shared, which adds to the work's value in the context of open qualitative psychology in general.   
 
The study will help us better understand the process of receiving (late) DCD diagnoses and, specifically, how the emotional aftermath is potentially related to one’s evolving self-concept. In addition to making a clear contribution to cumulative scientific knowledge, the findings can be useful for professionals working with DCD-diagnosed individuals as well as for the development of related support services. The Registered Report format allowed the research design to be reviewed in three rounds before data collection. Initially, three experts representing developmental psychology and DCD reviewed the Stage 1 manuscript, after which the recommender carried out two iterations with further requested revisions. This was followed by in-principle acceptance.
 
URL to the preregistered Stage 1 protocol: https://osf.io/67h3f
 
Level of bias control achieved: Level 6. No part of the data or evidence that will be used to answer the research question yet exists and no part will be generated until after IPA. 
 
List of eligible PCI RR-friendly journals:
 
 
References
 
1. APA (2013) Diagnostic and statistical manual of mental disorders, 5th ed, American Psychiatric Association, Washington, DC.

2. Tan, C. D. (2018). “I'm a normal autistic person, not an abnormal neurotypical”: Autism Spectrum Disorder diagnosis as biographical illumination.” Social Science & Medicine, 197, 161-167.
 
3. Topor, M., Armstrong, G., Gentle, J. (2022). Through the lens of Developmental Coordination Disorder (DCD): experiences of a late diagnosis, in principle acceptance of Version 4 by Peer Community in Registered Reports. https://osf.io/67h3f
Conflict of interest:
The recommender in charge of the evaluation of the article and the reviewers declared that they have no conflict of interest (as defined in the code of conduct of PCI) with the authors or with the content of the article.

Evaluation round #3

DOI or URL of the report: https://osf.io/sbxqd/

Version of the report: V3

Author's Reply, 02 Aug 2022

Download author's reply Download tracked changes file

Dear Matti, 

Thank you very much for providing further instructions for improving the paper. 

I attach our response to your comments as well as a clean manuscript as requested.

The same version of the manuscript with tracked changes can be found on the OSF: https://osf.io/sbxqd (currently V4). 

Best wishes, 

Marta Topor

Gemma Armstrong

Judith Gentle

 

 

Decision by ORCID_LOGO, posted 22 Jul 2022

Dear Marta Topor and co-authors,
 
Thank you for submitting the revised Stage 1 with careful changes. This version is now very close to in-principle acceptance, thus I invite you to format the next version as “clean” with a separate document attached to show track changes. I have a few final comments for your consideration, most of which are very minor, but worth addressing now because after Stage 1 this part of the manuscript will be locked.
 
- You have chosen codebook TA to accommodate a realist epistemology with a reflexive approach -- this is good choice. As one more clarification, I would ask you to add an explicit note regarding *how* the codebook will be applied. As Braun & Clarke (2022, p. 7) point out, the codebook philosophy encompasses numerous approaches like matrix, framework, network, and template analyses; are you committing to one of these? I am asking because in the response letter you refer to template analysis (King 2012), but this is not mentioned in the manuscript. I just want to double check to avoid misunderstandings at Stage 2. To be clear, you *don’t* have to commit to any of these existing approaches, but you can also follow your own codebook/instructions. In such case, I would kindly ask you to create tentative codebook/instructions for the two coders and add these as a supplement so that we have them registered at Stage 1. To give an example, in a recent template analysis study we preregistered the following instructions based on one guiding RQ for two coders: https://osf.io/umvsy Note that your instructions can be entirely different and you can recreate a codebook as you work, but having some formalized plan at Stage 1 will allow showing how/what changes occurred, if any (it already reads “coders will be instructed to identify codes…” but let’s make these instructions visible to reach the highest levels of transparency!).
- Minor comment: Your QH1 states: “Participants who received a late DCD diagnosis will have different feelings towards this experience depending on how much time has passed…” This is good, but how will you tackle these temporal differences in practice? For instance, will each participant’s current state be situated in Murphy and LeVer’s stage model of ADHD? I note this because I’ve once had an RQ like this and found it very difficult to analyze/report in practice. If I may suggest (ignore this in case it doesn’t feel right), one part of the codebook/instructions, if you decide to have that, could be to instruct the coders to evaluate which stage/s (a–f) the participant represents, assuming the stage model of ADHD applies here. [You may skip this entire comment if you’re confident that your analysis will produce results that address the temporal dimension without further additions]
- Minor comment: you’re using the words “self-identity”, “self-concept” and “self-perception” on several occasions in the manuscript. Please double check if all these terms are intentionally used with separate meanings or could one be dropped to increase consistency? (I’m recalling Roy Baumeister’s lengthy review “The Self” from 1998 -- again, you can rebut this comment in case all three terms are intentional and needed).
- Minor comment: I would encourage to rephrase this part -- “themes should emerge from the participants own words rather than the researchers’ preconceptions and beliefs” (351). You can keep it as is, but consider e.g., “To investigate the participants’ experiences through their own words, a semantic-realist approach to the data is justified” (for a more neutral tone)
- This last comment does not entail any action from your part at the moment, but with reference to earlier reviewer feedback, please allow me to remind to explicitly communicate at Stage 2, in the Discussion or other section, how the results will guide practitioners. This is promised twice, but not yet explained *how* (it's ok as long as it becomes clear at Stage 2).
 
Please do not hesitate to contact me for any questions in case some of the above feedback is unclear. I look forward writing an IPA for the next version!
 
Veli-Matti Karhulahti


Evaluation round #2

DOI or URL of the report: https://osf.io/sbxqd/

Version of the report: V2

Author's Reply, 21 Jul 2022

Download author's reply

Dear Matti, 

It has taken us a while but we have now prepared a revised version of the manuscript which has been uploaded to the OSF: https://osf.io/sbxqd 
The new changes are in red font. 

I also attach a document with our responses to your comments. 

 

Thank you again for all your guidance in this process, we really appreciate it! 

 

Marta Topor, Gemma Armstrong and Judith Gentle

Decision by ORCID_LOGO, posted 05 Apr 2022

Dear Marta Topor and co-authors,
 
Thank you for submitting the revised Stage 1 version of your manuscript. I have reviewed the revised manuscript file as well as the responses to the reviewer feedback, based on which I did not consider it necessary to initiate a new round of external reviews. However, I personally made note of points that are necessary to revise before IPA. I start with minor points. 
 
1. Line 102: “However, within the RR context, hypotheses are normally discussed as *quantitative* hypotheses” --> I recommend using the term “testable” instead of “quantitative,” as the idea of non-testing is most important in the present context, I believe. 
2. Line 108: the reference to our work here is incorrect; we have two Stage 1 RRs in the PCI and the qualitative one is “Phenomenological Strands for Gaming Disorder and Esports Play: A Qualitative Registered Report”
3. Line 132: I like the new RQ2 and I agree the link to RQ1 is now clearer. Yet to make it even more explicit, I suggest integrating the link to emotional findings, e.g. along the following lines: “How does self-identity change following the emotional events of a late DCD diagnosis…”
4. You have now justified the use of OSF for data sharing, which is totally ok. Nevertheless, please allow me to add a bit of context, which was perhaps the intention of the reviewer but was left unspecified. Sharing qualitative health data can be difficult and comes with unique risks; anonymizing human experiences takes a lot of time and requires carefully assessing the risk-benefit ratio i.e., what parts of the text should be shared for the data to be useful for other researchers and what should be erased to protect the participants. Due to these challenges, it is common that expert repositories are collaborated with so that they can assist with de-identification and, as is often the case, control data access so that only people with scientific interests can reuse the data. These services are not provided by the OSF. Naturally, you have the full right to share the data via OSF following the ethical principles outlined, but do not hesitate to contact me if you wish to further discuss the plan for and potential issues related to data sharing.
5. You are using the ADC as an inclusion criterion, which is ok. However, I am thinking, as you are also inquiring about official clinical diagnosis in the questionnaire, wouldn’t that be the gold standard? I.e., wouldn’t someone with an official diagnosis meet a sufficient alternative inclusion criterion, regardless of what their ADC score is? Of course, it’s likely that the participants meet both, but in case of false negative outcomes from ADC, it seems that a clinical diagnosis should suffice, too. What do you think?
6. Line 241: You mention “neurodevelopmental, neurodegenerative, or psychiatric” conditions as exclusion criteria but only survey about the first one (line 245). Unless otherwise justified, please remove neurodegenerative and psychiatric conditions as exclusion criteria (this would also help you to find participants, and as I see it, psychiatric conditions such depression are so common that there is no reason to exclude participants with them if they are willing to participate). 
 
Finally, I have three more general points that need attention. I try to be as clear as possible, so this takes a bit of explaining (apologies if I sound too instructive below, but I think these are discrepancies that could be criticized by future readers unless we clarify them here and now). 
 
- There’s a lot of conversation around Braun and Clarke’s TA across fields these days, and the authors themselves have been very actively reconceptualizing their method into “reflexive” TA – a position that was not clearly present in their 2006 paper yet (and this paper is the basis of your MS). In the 2006 paper, the authors indeed discuss many possible ways of doing (all kinds of) TA, including realist approaches, but in the more recent papers they have divided TA into “reliability”, “codebook” and “reflexive” schools (many of the which they do *not* represent -- historically, there are likely more than a hundred different types/schools of TA). In Braun and Clarke's view, the “reflexive” school (which they have now coined and represent explicitly) is strongly tied to researcher subjectivity instead of realist or (as they call it) neopositivist epistemologies that assume there to be one “real truth”. Therefore, as you since line 340 note that the study is based on realist epistemology and “real truth” but elsewhere mention that reflexive TA is followed, there seems to be a conflict between these positions (also recall that you dropped the second coder because in reflexive TA there isn’t necessarily one truth but both coders could’ve been correct!). In summary, it would seem logical for this study to be carried out with an epistemology that matches reflexive TA (of if not, *why* is realist epistemology more optimal for your RQs?). On the other hand, I wouldn’t want to enforce anyone to assume an epistemological position that they do not actually hold -- so I leave this comment to be discussed in your team (please also consider rephrasing “emerging” themes; in reflexive TA themes are constructed subjectively rather than them emerging objectively, see e.g., Braun and Clarke 2006; Table 2 point 15). Again, I am sorry to point at this issue in such detail, but as this is one of the first qualitative RRs in the world, I must ensure that these meta-scientific issues, which are very much discussed in the qualitative domain at the moment, are not left unresolved. For further reading, see e.g., 
 
Virginia Braun & Victoria Clarke (2019) Reflecting on reflexive thematic analysis, Qualitative Research in Sport, Exercise and Health, 11:4, 589-597, DOI: 10.1080/2159676X.2019.1628806
Virginia Braun & Victoria Clarke (2021) One size fits all? What counts as quality practice in (reflexive) thematic analysis?, Qualitative Research in Psychology, 18:3, 328-352, DOI: 10.1080/14780887.2020.1769238
 

(if you choose to stay with reflexive TA, please use "reflexive TA" systematically in the manuscript every time you refer to TA)


- Related to the above, about the sample size. In brief, I do not believe that N=5 would be enough for this TA study. In fact, this is also suggested by Braun and Clarke; I don’t have their 2013 book with the sample size discussion at hand, but they summarize the point online as follows: ”generally speaking 5 interviews (however long and detailed) is probably a bit too small for a TA. This is because TA focuses on the identification of patterns *across* data… 6-10 (rich and detailed) interviews [fit] for a small TA project e.g. UK undergraduate” (https://www.thematicanalysis.net/faqs/). To ensure the production of themes across data, I would suggest setting the minimum to 10 interviews (which is still not much for TA but could be sufficient, trusting on your team’s assessment). That is not to say that less data could not be informative at all; however, with less than 10 interviews other methods would be more suitable for analysis, such as interpretive phenomenological analysis or case study approaches. TA is not idiographic, i.e., not focused the analysis of individuals per se but rather the themes across individuals [on line 174 it is noted that “thematic analysis has an ideographic focus”, what does that mean and where does it come from?]
- Finally, regarding the use of inductive coding, please allow me to point at possible issues with this specific choice. I quote from Braun & Clarke 2006 again, as that is the method you've chosen: “Inductive analysis is therefore a process of coding the data without trying to fit it into a preexisting coding frame, or the researcher’s analytic preconceptions.” (83). While there are many ways of doing inductive coding, you currently highlight also working with strong analytic preconceptions, i.e. clear RQs with clear QHs: "Initial codes will be noted for ideas that fall in line with our hypotheses as well as novel insights specific to DCD." To be safely on the inductive side, I would suggest not involving your hypotheses in the coding. Coding through the RQs works well, but you might additionally wish to explain *how* the coder is instructed to interpret the data through the RQs? Do you trust their intuition, or will there be mutually agreed guidelines/limits regarding what counts as a reflection of RQ1-RQ2? 
 
I hope these comments will further help your team to make this as good study as possible. Needless to say, I can be contacted directly if some of the feedback is unclear or if you have concerns regarding how to solve some issues.
 
Best wishes,
Veli-Matti Karhulahti
 
 
 


Evaluation round #1

DOI or URL of the report: https://osf.io/sbxqd/

Author's Reply, 04 Apr 2022

Download author's reply Download tracked changes file

Dear Veli-Matti Karhulahti, 

We are grateful to you and the reviewers for providing very encouraging and useful feedback. 

We have now addressed all points raised. We attach a document where we address each comment point-by-point. 

The manuscript has been updated on the OSF and the current version is Version 2 (https://osf.io/sbxqd/). Throughout the manuscript, we highlighted in yellow where changes were made. 

Additional documents that were updated following feedback include the COREQ checklist (https://osf.io/g8cxd/) where all changes are also highlighted in yellow and the Demographic Questionnaire (https://osf.io/ep53y/) but in this case, we only added numbers to the questions.

One additional file has been added to the OSF repository in the "Study Materials" component. The file includes questions that will be asked during community feedback regarding the results of the study. It was an oversight that we did not add it to the repository/manuscript in the first place.

We are looking forward to hearing back.

Kind Regards, 

Marta Topor, Gemma Armstrong, and Judith Gentle

Decision by ORCID_LOGO, posted 26 Feb 2022

Dear Marta Topor and co-authors,
 
Thank you for submitting your Stage 1 manuscript. It is a great to pleasure to see more qualitative work choosing the RR format, and I am confident that this promising manuscript will pave the way for more such work in the future. I have now received all three reviews, collectively representing research expertise of qualitative methods, developmental psychology, and developmental coordination disorder. The reviews are very encouraging but also identify points that require revision. Below, I list some of my own feedback and selectively comment on the reviewers’ points to facilitate your revisions process as much as possible.
 
1. Most of the requested revisions concern the introduction. One reviewer is concerned whether the research questions are optimally constructed, and another reviewer suggests previous literature that should be taken into consideration to ensure the findings contribute to cumulative science. I agree and encourage you to reconsider the RQs after assessing 
 
a) what would be theoretical or other links between RQ1 and RQ2 (or alternatively justify why two not-so-strongly connected RQs need to be answered together), and 
b) how does the suggested literature affect (if it does) what you consider the most relevant RQs to ask at the current state of the field?
 
I will additionally comment briefly on the RQ2. With the premise that the condition has become part of the participants’ intrinsic self, as you meantion on page 5 with reference to biographical illumination theory, it would be good further specify what “through the lens” means in this context. For instance, although you address “past, present, and future” in RQ2, the following QH2 expects that “participants will present with both positive and negative accounts [of the impact].” Are you interested in how the chronology manifests (“past, present, and future” in RQ2), or about the types of impact of the diagnosis (“positive and negative accounts” in QH2)? You also mention positive and negative feelings in your QH1. Unless you are specifically interested in the positive/negative division, other concepts might better describe your predispositions. 
 
2. One reviewer also recommends merging the QHs in the rest of the text. I should disclose my own position here, as I am a co-author in the study which has previously used QHs, and I assume you are following that example. I will let you choose whether you wish to follow the reviewer’s advice, or if you wish to keep QHs. Both are viable options when well executed. Nevertheless, if you choose to the keep the QHs, please follow the reviewer’s advice and briefly explain to readers (who may not know how QHs work) that they will not be tested but they rather serve to disclose biases and preconceptions.
 
3. All three reviewers note that the sample size section needs work. First, instead of a hard sample size number, I believe a range works better in the RR format. One reviewer points out that N=15 is already a difficult-to-reach size considering that you exclude all participants with other diagnosis, whereas another reviewer is worried that N=15 might not be enough to answer your RQs properly. As reflexive thematic analysis does not operate with saturation, I suggest 
 
a) Choosing a minimum sample size that allows the study to be carried out and a maximum that would e.g., be defined by your resources.
b) Reflecting inside the team e.g., after each 5 interviews what the data tentatively feel like against the RQs, then choosing to stop/continue (you may create brief reflection documents of these steps), 
c) Include a small plan for alternatives, e.g., how would it affect your analysis if you cannot find as many participants as would be optimal but still meet the minimum sample size.
 
I also agree with one of the reviewers who would like the recruitment process to be elaborated. In what order will different recruitment locations be approached and how (most importantly, will potential participants be approached personally or do they contact you)? I can see some of these issues are noted in the COREQ list, but this information is critical enough to be included in the fixed Stage 1 main text. For the record, I also note that reflexive TA does not recommend COREQ, but I also believe any such checklist helps to transparently think about different aspects one's study, and there is no reason to change or remove COREQ. 
 
4. The last bigger topic is the method/analysis. You have chosen reflexive TA, which has a very strong non-positivist foundation. You have done an excellent job in opening your positionality via relevant statements, and you do clearly mention reflexivity as part of your work. However, there are some components in the plan that do not seem to fit reflexive TA. 
 
a) Reflexive TA generally does not recommend the use of multiple coders, as the related reliability checks and comparisons are considered positivistic and epistemologically problematic. That said, I am personally ok with you using of two coders, but with Braun & Clarke’s framework as a basis, you should rather explain, for instance, how the different outcomes of two coders are reported with respect to their two different perspectives instead of pursuing accurate interpretation via synthesis. To be clear, you can produce a synthesis, but in such case, you should explain how the diverse views manifest in it. From the point of reflexive TA, the different views of both coders can be accurate interpretations. Braun & Clarke have come to highlight these issues in several recent papers. For simplicity, I refer to their website which lists such references topic by topic:  https://www.thematicanalysis.net 
b) As the reviewers points out, there is lacking information regarding what type of reflexive TA you are planning to use. Even if you apply the 6-step process described in the original Braun & Clarke (2006), you need to make many decisions regarding the level of codes, deductive/inductive premises, and epistemology (e.g., my above note about merging two coder positions). At the same time, I feel it is important to stress that qualitative research always comes with flexibility and not all details can be perfectly planned and followed. I suggest you carefully plan within the team as many details as possible, and if you need to make changes at Stage 2, I will do my best to provide you with the required flexibility and we will simply document all changes transparently, when applicable. You do not have to be worried that you will be “locked” in your decisions, but I am confident that thinking about those decisions carefully beforehand will improve the study. 
c) One reviewer notes that the validity and reliability section does not include the latter, which is not entirely true as you do explain e.g., member checks (and I agree that your plan to do member checks by external community members is well suitable in this design). However, the reviewer is correct that if you wish to address reliability (which is not straightforward in reflexive TA), there are many options to do that and one of the reviewer’s own papers provides a good overview of the topic (Syed, M., & Nelson, S. C., 2015. Guidelines for establishing reliability when coding narrative data. Emerging Adulthood, 3.6, 375-387). From a reflexive TA viewpoint, perhaps the best approach would be to pursue negotiated consensus about what themes are most relevant to be reported as the results of this study. This would allow both coders to keep their unique epistemic positions (documented by their separate coding materials), but still make it visible how you end up reporting what you will. Related to this, the coders might wish to integrate their subjective reflections directly in the shared coding documents (analysis logs), which I believe would be more pragmatic for you to do and the readers to interpret, versus a general post-reflexivity statement. Again, both options are viable, and you may also stick with the latter if you prefer. 
 
5. Two smaller notes. 
 
a) You plan to collect a lot of information with the questionnaire, but as one reviewer comments, it is not clear how this information is utilized. I should also add that those data do not seem to be part of the data availability statement, so please clarify what role they have in the study. It is ok to collect such data e.g., for purposes beyond the present RR, but this should be explained. I also understand that some of the data may not be suitable for sharing, and you can state that explicitly in the data availability statement.
b) If you still plan to exclude participants with all other diagnoses except for DCD, please explain how the presence of those other diagnoses will be determined. For instance, the questionnaire seems to have multiple items, which may all yield data that could be a basis for exclusion. 
 
In addition to the above, please provide point-by-point responses to the reviewers’ respective feedback. Needless to say, if you disagree with some the requested revisions, you are free to justify alternative choices. Do not hesitate to contact me if something is unclear. I look forward to reading the next version, based on which I will see if another external review round is needed. I also remind that you have the option to start data collection before IPA by reducing bias control. 
 
Sincerely, 
Veli-Matti Karhulahti

Reviewed by ORCID_LOGO, 25 Feb 2022

PCI-RR-156

Through the lens of Developmental Coordination Disorder (DCD): experiences of a late diagnosis

Review completed by Moin Syed, University of Minnesota (intentionally signed)

Thank you for the opportunity to review this Stage 1 proposal. Upon being invited to review this paper, I informed the Editor that I do not have expertise on Developmental Coordination Disorder (or any other disorders, really), but that I could provide comments on the methods and the general structure of the proposal. Accordingly, I primarily do just that.

This proposal is promising but is in need of some major revisions to enhance clarity of the conceptualization and add details on the methodological and analytic plan.

The Introduction section may need a major overhaul to properly set up the study. The research questions are not very well-integrated, following from any kind of common conceptual or theoretical framework, so it is not clear why these two RQs, in particular, are important to address to meet the goals of the study. Indeed, the authors actually rely on two different theories to motivate each RQ, but there is no discussion of the compatibility of them or how they fit together.

Additionally, the authors will need to clarify what they mean by “qualitative hypotheses” and how these will be used, especially because they do not show up again in the Method or Analysis sections. My suggestion would be to drop this language all together, and elaborate on some of the rationale and expectations when providing support for selecting the RQs.

Because the Introduction is relatively brief and to the point (which is good), I recommend moving the RQs to the end of the Introduction, rather than having them embedded, to allow for a more robust conceptual discussion that can serve as the basis for the RQs. Indeed, there are several issues not discuss at all, such as what “late diagnosis” means and how it is defined (although this is elaborated in the Method), and how experience of DCD may be similar to that of ADHD and ASD. The RQs are not specific to DCD, per se, but are more general with respect to the diagnoses. That is fine, but the authors should be clear whether or not there is something specific about DCD here and how that informs the RQs.

My main concern with the methods is the sample size determination. This is, of course, quite difficult to do in qualitative research, but the authors largely justify their selection based on what past researchers have done. This is never a good idea, especially given the poor quality of a lot of past research. I think there should be a deeper discussion about the expected heterogeneity vis-à-vis the RQs and the expected theoretical claims that the observations may generalize to. For example, when examining emotional reactions, I am not so sure that 15 participants will provide you sufficient depth across the breadth of responses.

The major issue with the analysis plan is that the description of the thematic analysis if quite general. Thematic analysis involves specific steps and variations depending on the RQs and goals of the study, and these should be explained in detail. For example, the authors put forward to sets of RQs/QHs, but those are not mapped at all to the analytic approach. Will the same exact approach be used for both? What exactly will be driving the analysis? Will it be primarily semantic or latent? There is much more that can and should be detailed here.

Additionally, the authors state that, “In addition, by interpreting participants’ accounts of individual experiences, we will provide meaningful, synthesised information that can be applied in practice by professionals working with individuals with DCD.” This is all well and fine, but there was no clear RQ that pertained to this goal. Will this goal guide the analysis? If so, how?

The section on reliability and validity does not actually include any details about reliability. Certainly, there are a wide number of approaches to establishing reliability or consistency, without using quantitative indexes. In the supplemental checklist all that is says is, “30. Data and findings consistent. This will be ensured by having two raters analysing all of the data (GA and MT). In addition, JG will verify the findings by checking if quotations reflect the generated themes and subthemes.” What will you do with the two raters’ data? How will they be compared? Much more detail is needed here.

A couple of small points

“A total score of over 65 (and over 17 in section A reflecting the severity of DCD-related difficulties in childhood) will be required to participate in the study to ensure that the sample will be representative of individuals with DCD.” I am not sure how using a cutoff ensures representativeness.

“Participants will be asked to provide information about themselves including age, gender, occupation etc.” With Registered Reports, always err on the side of more detail, so using “etc.” is not sufficiently specific.

Again, I think this is a promising study and I appreciate that the authors are pursuing a Registered Report for their work. My comments are intended to help make the project the best that it can be, in shared pursuit.

Reviewed by , 20 Jan 2022

1A. The scientific validity of the research question(s). 

This proposed research will be investigating the impact of late diagnosis of Developmental Co-ordination Disorder (DCD). From a scientific perspective this proposal is justified by the existing research presented. The proposed research approach: to investigate the experiences of individuals who receive a DCD diagnosis in adulthood, could be answerable through the chosen qualitative approach. Thematic analysis will be suitable to carry out analysis of the interviews and should provide appropriate results. There are no ethical concerns regarding this proposed research.

 

1B. The logic, rationale, and plausibility of the proposed hypotheses, as applicable. 

This is a highly relevant topic area: there have recently been high profile and public discussions of the impact of late diagnoses of other neuro-developmental disorders. The research referred to supports the investigation of the experiences of individuals who receive a late diagnosis of a neuro-developmental disorder, and it is clear that there is a gap in the research when it comes to DCD. The research questions/qualitative hypotheses are appropriate and follow on from the justification. The proposed research is plausible and there are no concerns about the value of the investigation.

 

1C. The soundness and feasibility of the methodology and analysis pipeline (including statistical power analysis or alternative sampling plans where applicable). 

The methodology is justified and the analysis suitable. The sample size is appropriate, but the participant recruitment seems a little vague: it would be useful to know what specific social media support groups will be targeted and how they and the university campus/Dyspraxia Foundation will be approached. The inclusion and exclusion criteria are appropriate. It would be interesting to know whether there will be an upper age limit, and if not, whether those who are elderly would have very different experiences of a DCD diagnoses that those in their 30s. 

 

1D. Whether the clarity and degree of methodological detail is sufficient to closely replicate the proposed study procedures and analysis pipeline and to prevent undisclosed flexibility in the procedures and analyses. 

The detail in the methodology is extensive and there is little indication that there will be any difficulty in carrying out this study. The design of the proposed research is very precise. The procedure is very clear, and the community feedback aspect will undoubtedly be useful in ensuring accurate and appropriate analysis of the data.  

 

1E. Whether the authors have considered sufficient outcome-neutral conditions (e.g. absence of floor or ceiling effects; positive controls; other quality checks) for ensuring that the obtained results are able to test the stated hypotheses or answer the stated research question(s). 

As this is a qualitative research proposal, this aspect is not relevant.

Reviewed by , 17 Feb 2022

Thank you for submitting the study proposal titled 'Through the lens of Developmental Coordination Disorder (DCD): experiences of a late diagnosis' for review.

Overall, this study proposal intends to explore the emotional impact of receiving a DCD diagnosis in adulthood, and how receiving a diagnosis in adulthood influences participants perspectives of themselves, in the past present and future.

It is recommended that emotive language should be avoided throughout (for example ‘deep personal reflections’) as this is subjective and may be limited to some experiences. It also recommended that statements more accurately reflect reality for example, the suggestion that little is known about DCD would be more accurate within certain sectors compared to others where a lot is known. Related to this, there are some vagaries at times for example ‘in the system’, ‘later adulthood’ or ‘better support’ – it isn’t clear what system is being referred to or what later adulthood means or who should be providing better support. Better support also suggests an element of bias as there is an assumption that current support isn’t ‘better’.

In relation to the research questions, it feels inaccurate to state ‘…the moment…’ as retrospective accounts are being collected so it would be difficult for participants to describe how they felt at the exact ‘moment’ they received a diagnosis. On a related note, there are phrases included throughout which require clarification for example:

Line 5 – most common motor coordination difficulties needs re-phrasing for clarity

Line 32 – a definition of late diagnosis is needed

Line 118 – what is meant by ‘occupational and medical professionals’

Line 121 – what evidence is there that the OSF is the most appropriate platform for professionals working with adults with DCD to access

Line 142 – why is ‘name of university where a participant studied’ relevant

Line 175 – what good theoretical background 

Line 177 – it isn’t clear how the information power principle was used to arrive at a sample size of 15 participants

Line 221 – deductive or inductive thematic analysis and why

The methods section would benefit from some clarification in relation to how a diagnosis of DCD will be confirmed and why participants with co-occurring diagnoses will be excluded. It is very common by adulthood for adults with DCD to have multiple diagnoses and therefore it seems unfeasible to suggest that 15 adults with only a (late) DCD diagnosis will be recruited. Furthermore, it isn’t entirely clear how the demographic questionnaire and the semi-structured interview questions are directly related to the research questions. There appear to be questions included in both of these documents that appear to be irrelevant in the context of the aims / research questions of the study.

There are sections that would benefit from re-writing for clarity, for example section 2.4. procedure is currently difficult to follow. Also lines 247 - 250 require rephrasing for clarity.

The authors have suggested that there is no research exploring diagnostic pathways or diagnostic experiences of adults with DCD, this isn’t entirely accurate, please consider reviewing the literature thoroughly to identify relevant articles, for example:

Kirby, A., Sugden, D., & Purcell, C. (2014). Diagnosing developmental coordination disorders. Archives of disease in childhood, 99(3), 292-296.

Williams, N., Thomas, M., & Kirby, A. (2015). The lived experiences of female adults seeking a diagnosis of Developmental Coordination Disorder. The Dyspraxia Foundation Professional Journal, 13, 21-31.

Tal Saban, M., & Kirby, A. (2018). Adulthood in developmental coordination disorder (DCD): A review of current literature based on ICF perspective. Current Developmental Disorders Reports, 5(1), 9-17.

Barnett, A. L., Hill, E. L., Kirby, A., & Sugden, D. A. (2015). Adaptation and Extension of the European Recommendations (EACD) on Developmental Coordination Disorder (DCD) for the UK context. Physical & occupational therapy in pediatrics, 35(2), 103-115.

Hopefully, these recommendations are helpful.

User comments

No user comments yet