Feasibility surveys

We enhanced feasibility survey question scoring to support floating score assignment for numeric and percentage input survey questions.

Floating scale scoring

When you have the existing Feasibility Survey Manager permission, you can now optionally award score values to survey question responses based on a scale determined by how the response compares against all other inputted responses. These “Floating scale” scores apply only to textbox input questions with numeric and percentage inputs.

Question scoring drawer

We updated the question scoring drawer to include a new control where you specify “Defined range scoring” (existing functionality) or “Floating scale scoring” for the numeric or percentage input question. We also added helper text to define how to set up Floating scale scoring ranges. This text is:

“There are 4 percentile ranges in which the response to this question will be compared against other survey response submissions. Assign point values to each percentile range. Scores will be recalculated with each survey submission.

• The ranges must be non-zero numbers between 0 and 100

• The upper bound is inclusive (if the lower bound is 3 and upper 7 then the range will apply for any number less than or equal to 7 and greater than 3).
• All ranges must be defined.”

When you choose Floating scale scoring, the drawer displays four ranking inputs, each having its own score input. If the question isn’t marked as scored, the ranking input configuration is disabled, but it will persist any inputted criteria. Please note that marking a range as critical is not supported for Floating scale scoring.

When you set up Floating scale scoring:

• For textbox list questions and continuous sum questions, each row of the question is considered a separate textbox input question. For example, a textbox list question with three rows is considered three separate textbox input questions, and you can apply a floating score to each.
• For textbox grid questions (with numeric or percentage validation), each row:column pairing is considered a separate textbox input question.

Rescoring

We added a new Rescore button to the site grid menu on the Survey analysis tab. The button will be enabled when any survey in the study has a question configured for float scoring. When clicked, Oracle Site Select ranks survey responses to the question marked for a floating scale and applies the point value corresponding to the percentile ranking for the site’s question response. Each time an Oracle Site Select site grid user clicks the Rescore button, Floating scale scoring recalculates across every survey in the study.

IMPORTANT: We consider the latest responses to a survey with floating point questions when scoring the survey across all sites that have submitted it. If a study site has been reassigned to a new survey, the previous latest response submission of the survey with a floating point question will still be considered in the scoring of all surveys with that floating point question. This is regardless of the fact that the study site is no longer assigned to that survey with the floating point question.

For example, three sites submitted surveyA with floating question 1. Site2 is reassigned to a new survey. When you rescore the floating point questions, Oracle Site Select will pull in the response from all three sites for that floating point question.

We also added a warning message on the Survey analysis tab, Survey results modal that displays when a submitted survey has floating questions that have yet to be scored for the first time. The text of the warning message is: “This survey contains questions that score based on a floating point scale. These responses have not yet been scored. To score these responses please click the floating question rescore button on the site grid.”

Survey exports

We enhanced the survey configuration export to mark questions that use floating scale scoring. You’ll see the updates in the following export columns:

• Type: FLOAT
• Operator: Lists values of each float percentile
• Criteria/Range: Inputted values of each float percentile
• Score: Inputted score for that float range

For row and column scoring output, where float scoring is enabled for at least one question, the export will have a new “Float range scoring” worksheet at the end of the workbook. This new worksheet has the following columns:

• Survey name: the survey’s short name
• Question number: the parent question number if the question is in a list or grid
• Question: the text of the question where float scoring is enabled
• Range 1-4: the ranges inputted for each percentile
• Score 1-4: the inputted score value for the range

Note that Survey response exports are unchanged as a result of the float scoring enhancement. As they did previously, these reports export the point value assigned based on rank.