Report Builder and Instructions

In Report Builder, you have several tabs.

Administrators have 6 tabs, instructors have 3.

My Reports 

  • The My Reports page gives you a view of the Recent reports you’ve generated using Report Builder, a list of Saved Reports, and a list of Reports that have been created and shared with you by others. To view the report from this view, just click the title.  

Areas (Admin) 

  • The Areas page of Report Builder will allow you to build reports on specific areas of the University Hierarchy, if you have access to more than one. You can create comparison reports across departments. These comparison reports would only be meaningful if all departments are using the same questionnaire and rating scales, and as such will likely not be useful to many. The report generation options are similar to those below. 

Projects

  • To generate reports for entire projects at one time, click the Projects tab. This will allow you to create aggregate, detailed, and/or comparison values across entire Projects (all the classes and instructors included in each semester, evaluated with the same questionnaire). For instructors, this will include all the classes you taught in a given semester that were evaluated using the same questionnaire. For Administrators, this will include all courses and instructors within the entire project.  Click the Project icon below for specific instructions.

Courses

  • Click the Courses Icon below for specific instructions.

Instructors (Admin) 

  • Click the Instructors icon below for specific instructions.

Teaching Assistants (Admin) 

  • If a department were to send Course Evaluations using the Teaching Assistants roles, reports about those Teaching Assistants would be available here. There are currently no departments using Teaching Assistant roles. TAs and DIAs are being evaluated as “Instructors” rather than TAs in CES.  

Click the icon for specific instructions for using Report Builder.

Projects 

Generating a report in the Report Builder Projects tab: 

  1. Log into Course Evaluations and Surveys.

  1. Click results in the top menu.

  1. Select Report Builder.

  1. Click the projects tab at the top of the report builder.

  1. Select the project Type: Course Evaluation Project 

  1. Click inside the box for Course Evaluation project 

  1. Select your Projects. Projects are organized by semester and department. You can choose more than one, but comparison values may not be valuable across departments or questionnaires.  

  1. Select the Questions you’d like to see results from 

  2. You can look for specific questions, or choose select page at the bottom. 

    • NOTE: questions with like-answers will give better comparison data. 

  3. Click apply.

  4. Select your grouping: 

    • Project – Aggregate results for the whole project per question and overall.

    • Project / Instructor – Project results broken down by instructor.

    • Project / Course – Project results broken down by course section. 

  5. Select your question filters and benchmarks, if you’d like. These are ways to narrow down your results to find those students who marked a certain answer on a question, and read the comments from those students, for example.  There is no information in the system to use Metadata Filters at this time.

  6. Click run in the top left. 

    • NOTE: This may take time, depending on your parameters. If the report is not generated immediately, you’ll receive an email when it’s finished processing.  

  7. The results are displayed with “Question Results (#)” and “Aggregated Results (#)”. 

  8. Question Results have each question broken down, with statistics for each question. The (#) represents how many questions or lines of data appear on this page. 

  9. For reports over a single questionnaire, there will be as many lines as there are scored questions on the questionnaire. 

  10. For reports over more than one questionnaire, there will be as many lines as there are scored questions on BOTH questionnaires. 

  11. **For Administrators, you could have either of the above numbers, multiplied by as many instructors as are teaching the class. 

  12. Aggregated Results show the combined statistical information for ALL questions with like answers. It can’t aggregate questions whose answers don’t align, so while this (#) is usually very low, it could be more than 2 or 3, depending on question answers available for that question. 

  13. Many departments use “Strongly Agree – Strongly Disagree” scale, but if a question has a “Very High – Very Low” scale, the system can’t aggregate these questions. 

  14. You can choose to export these data to either Excel or PDF using the icons along the top of the report area. You can also save this report to generate again within the system. 

  15. If you’d like to change a parameter and update the results, click the filters button. 

Courses 

Generating a report in the Report Builder Courses tab: 

  1. Log into Course Evaluations and Surveys.

  1. Click results in the top menu.

  1. Select Report Builder.

  1. Click the courses tab.

  1. Click inside the box for Courses and select your courses. Click inside the box again to use the search fields at the top, then click search.

  2. Check the boxes next to the ones you’d like to compare and click apply.

  3. Select the questions you’d like to see results from.

  4. You can look for specific questions, or choose select page at the bottom. 

    • NOTE: questions with like-answers will give better comparison data. 

  5. Click apply 

  6. Determine how you’d like the data to be displayed in the “Grouping” area: 

    • Course will show each question’s results by course, so there will be two entries per question if you selected two courses. 

    • Course / Instructor (useful for Admins) will show each question’s results by course and instructor, so there will be one line per instructor who taught the course. 

    • Course / Project will display the results of every question in any project you’ve selected, grouped by project. 

  7. This runs a report of all questions responded to by students for all projects in which you were evaluated, even if the questions aren’t alike. This is the way you can find an “overall” average for courses NOT using the same questionnaire. 

  8. E.g., if you wanted an overall score combining your overall score for US1100 and the MATH class you teach, you can get that here. It may not be meaningful, but you can get it. You can also find an aggregate score from the SPI and your standard class. 

  9. Select your question filters and benchmarks, if you’d like. These are ways to narrow down your results to find those students who marked a certain answer on a question and read the comments from those students, for example.  

    • NOTE: There is no information in the system to use Metadata Filters at this time.

  10. Click run.

  11. The results are displayed with “Question Results (#)” and “Aggregated Results (#)”. 

  12. Question results have each question broken down, with statistics for each question. The (#) represents how many questions or lines of data appear on this page. 

  13. For reports over a single questionnaire, there will be as many lines as there are scored questions on the questionnaire. 

  14. For reports over more than one questionnaire, there will be as many lines as there are scored questions on BOTH questionnaires. 

  15. **For Administrators, you could have either of the above numbers, multiplied by as many instructors as are teaching the class. 

  16. Aggregated Results show the combined statistical information for ALL questions with like answers. It can’t aggregate questions whose answers don’t align, so while this (#) is usually very low, it could be more than 2 or 3, depending on question answers available for that question. 

  17. Many departments use the “Strongly Agree – Strongly Disagree” scale, but if a question has a “Very High – Very Low” scale, the system can’t aggregate these questions. 

  18. You can choose to export these data to either Excel or PDF using the icons along the top of the report area. You can also save this report to generate again within the system.

  19. If you’d like to change a parameter and update the results, click the filters button on the top left of the Report Builder.  

How to find an Aggregate Overall Score for more than one course 

This is best done on a computer, rather than a mobile device. 

If you’re looking for an average overall score for all scored questions on your evaluation for more than one course at a time, follow these steps: 

  1. Log into Course Evaluations and Surveys.

  1. Click results in the top menu.

  1. Select Report Builder.

  1. Click the courses tab.

  2. Click inside the box for courses.

  1. Select your courses, either by course code or by the project.

  1. Click search.

  1. Select the courses in question by checking the boxes next to them. (You can use “Select Page” at the bottom to select all.) 

  1. Click inside the Question box. 

  1. Select your questions by checking the boxes next to them. (You can use “Select Page” at the bottom to select all. Questions with like answers will be compared.) 

  1. Click apply. 

  1. Select course for your grouping:

    • Course will show each question’s results by course, so there will be two entries per question if you selected two courses. 

    • Course / Instructor (useful for Admins) will show each question’s results by course and instructor, so there will be one line per instructor who taught the course. 

    • Course / Project will display the results of every question in any project you’ve selected, grouped by project.

  2. This runs a report of all questions responded to by students for all projects in which you were evaluated, even if the questions aren’t alike. This is the way you can find an “overall” average for courses NOT using the same questionnaire. 

  3. E.g., if you wanted an overall score combining your overall score for US1100 and the MATH class you teach, you can get that here. It may not be meaningful, but you can get it. You can also find an aggregate score from the SPI and your standard class. 

  4. Scroll back to the top and click run. It may take a few minutes, depending on how much data you’re asking the system to combine. 

  5. The results are displayed with “Question Results (#)” and “Aggregated Results (#)”. 

  6. Question Results have each question broken down, with statistics for each question. The (#) represents how many questions or lines of data appear on this page.

  7. For reports over a single questionnaire, there will be as many lines as there are scored questions on the questionnaire. 

  8. For reports over more than one questionnaire, there will be as many lines as there are scored questions on BOTH questionnaires. 

  9. **For Administrators, you could have either of the above numbers, multiplied by as many instructors as are teaching the class. 

  10. Aggregated Results show the combined statistical information for ALL questions with like answers. It can’t aggregate questions whose answers don’t align, so while this (#) is usually very low, it could be more than 2 or 3, depending on question answers available for that question. 

  11. Many departments use the “Strongly Agree – Strongly Disagree” scale, but if a question has a “Very High – Very Low” scale, the system can’t aggregate these questions. 

  12. You can choose to export these data to either Excel or PDF using the icons along the top of the report area. You can also save this report to generate again within the system. 

  13. If you’d like to change a parameter and update the results, click the filters button on the top left of the Report Builder.  

Instructors (Admins only) 

Basic Instructions.

To create a custom report with multiple instructors.

Basic Instructions 

  1. Log into Course Evaluations and Surveys.
  2. Click results in the top menu.
  3. Select Report Builder.
  4. Click the instructor's tab at the top of the Report Builder. 
  5. Click in the box to search for the instructor(s) you’re generating a report on. You will see an instructor's name associated with a course. If you want all of the instructor's associated courses, select all of them. 
  6. Click apply. 
  7. Select the questions you’d like to examine. Use “Select Page” at the bottom of the box to select all. 
  8. Click apply. 
  9. Select your grouping. 
    Instructor 
    Instructor/Project 
    Instructor/Course 
    Instructor/Project/Course 
  10. Select any additional filters you’d like to use. Note that there is no data for Metadata Filters at this time. 
  11. Click run in the top left. 

    The results are displayed with “Question Results (#)” and “Aggregated Results (#)”. 
     
  12. You can choose to export these data to either Excel or PDF using the icons along the top of the report area. You can also save this report to generate again within the system. 

To create a custom report with multiple instructors 

You may want to create a custom report for a program director who is not the chair of a program, or a custom report narrowing down a set of instructors in your department 

Here's how: 

  1. Log into Course Evaluations and Surveys.
  2. Click results in the top menu.
  3. Select Report Builder.
  4. Click the instructor's tab.
  5. Select the project in the dropdown.
  6. Select the Instructor(s) and courses you wish to include.
  7. Click apply. 
  8. Then, select the questions (You can use “Select Page” at the bottom to select all of the questions) 
  9. Click apply. 

    On Grouping, you might want just Instructor or you might like the “Instructor/Course” – your choice. Maybe try both and see what makes the most sense. 

    Instructor will list results by instructor.

    Instructor/Course will list results by instructor, then course.
     
  10. Click run at the top.

    Question Results have each question broken down, with statistics for each question. The (#) represents how many questions or lines of data appear on this page. 

    For reports over a single questionnaire, there will be as many lines as there are scored questions on the questionnaire. 

    For reports over more than one questionnaire, there will be as many lines as there are scored questions on BOTH questionnaires. 

    **For Administrators, you could have either of the above numbers, multiplied by as many instructors as are teaching the class. 

    Aggregated Results show the combined statistical information for ALL questions with like answers. It can’t aggregate questions whose answers don’t align, so while this (#) is usually very low, it could be more than 2 or 3, depending on question answers available for that question. 

    Many departments use the “Strongly Agree – Strongly Disagree” scale, but if a question has a “Very High – Very Low” scale, the system can’t aggregate these questions. 
  11. Check and see if it’s what you want, then you can save. Once this is saved, you can Share it right there in the system using the NetID email address of the person you'd like to share it with.  

Instructor Means Reporting (Admins only) 

  1. Go to Course Evaluations and Surveys.

  1. Enter your NetID and password, and click log in. 

  1. If prompted, complete Duo authentication. 

  1. Click the results drop-down menu on the top bar. 

  1. Click Instructor Means Reporting. 

  1. Select a project. 

  1. Select at least one question in the questions area. Click select when you have finished selecting questions.  

    • NOTE: You can search for questions with the same verbiage, such as “instructor” or “course” by using the filter options at the bottom of the Questions menu. Type your filter term and click “Apply Filter,” then check the boxes next to the questions you’d like to include. 

  2. There are several other optional filters for your search: 

    • Instructor – you can choose a specific instructor or a set of instructors 

    • Course - you can select a specific course or a set of courses 

    • Where - you can set a parameter where the number of respondents or the average score is greater than, less than, or equal to a particular number.  

    • Group By - you can group the resulting list by course, instructor, instructor then project, or by department hierarchy, if you are an administrator for more than one department hierarchy.  

    • Add Benchmark - you can also choose to create a Benchmark average for the instructors selected through the previous parameters. This benchmark will show at the top of the results page.  

  3. Click search. 

  1. The results will show a list of the instructor, the course, response statistics, and an average score based on the parameters you selected. You can export this to PDF or Excel using the links at the top of the results.  

    • NOTE: clicking on a course name in the Results list will download a copy of the Detailed Report with Comments. The Average shown on the results page will only show the average of the questions you selected and thus may not match the benchmark scores on the downloaded report.