Modelo para avaliação de competências de estudantes de engenharia em fóruns on-line
Carregando...
Arquivos
Data
2019-06-18
Autores
Felício, Aline Cazarini
Título da Revista
ISSN da Revista
Título de Volume
Editor
Universidade Estadual Paulista (Unesp)
Resumo
O objetivo desta tese é propor um modelo para avaliar competências de estudantes de engenharia em fóruns de discussão on-line. O modelo inclui um instrumento de pontuação (rubrica) baseado na Taxonomia de Bloom para avaliação de Competências em disciplinas da engenharia. A revisão da literatura indicou oportunidades de pesquisa atendidas pelo modelo proposto, tais como, comparação de diferentes rubricas, aplicação da Taxonomia de Bloom em atividades colaborativas, bem como validade e confiabilidade de rubricas em diferentes contextos educacionais. O modelo de avaliação utiliza rubrica analítica, a qual fornece feedback específico para cada uma das competências avaliadas, de acordo com os níveis da Taxonomia de Bloom: lembrar, entender, aplicar, analisar, avaliar e criar. As competências avaliadas estão alinhadas com a Accreditation Board of Engineering and Techonology (ABET), World Economic Forum de 2015 e National Academy of Engineering, de forma a comtemplar complexidade e desafios do profissional do século XXI. A validação do modelo foi feita por meio de sua aplicação em instituições públicas de ensino superior (Escola de Engenharia de São Carlos (EESC), Instituto Federal de São Paulo (IFSP) e Universidade Federal de São Carlos (UFSCar)), o que envolveu 118 docentes especialistas de ensino a distância e 106 estudantes. Evidenciaram a validade e confiabilidade do modelo por meio dos coeficientes: Indice de Validade de Conteúdo (90%), Alfa de Cronbach (0,73), Porcentagem Absoluta (89,2%) e o Kappa de Fleiss (0,81). A discussão com os especialistas mostrou que o modelo contribui para orientação explícita aos docentes de como avaliar competências estudantis valorizadas no mercado de trabalho, tais como, solução de problemas, pensamento crítico e analítico, comunicação na forma escrita e criatividade.
The objective of this thesis is proposing a model to evaluate Engineering students’ competencies in on-line discussion forums. The model includes a grading tool (rubric), based on Bloom’s Taxonomy, for the evaluation of competencies in Engineering courses which stimulate logical thinking and decision making. The literature review revealed research possibilities about the proposed model use, such as the comparison of different rubrics, the application of Bloom’s Taxonomy in collaborative activities, and rubric validity and reliability in different educational contexts. The evaluation Model uses an analytic rubric, which provides a specific feedback for each of the evaluated competencies, according to the levels of Bloom’s Taxonomy: remembering, understanding, applying, analyzing, evaluating and creating. The evaluated competencies are relevant for the Accreditation Board of Engineering and Technology, 2015 World Economic Forum, and National Academy of Engineering, keeping in view the complexity and challenges of the 21st century professional.Validation of the model was done through its application in public universities (Escola de Engenharia de São Carlos (EESC), Instituto Federal de São Paulo (IFSP) e Universidade Federal de São Carlos (UFSCar)), with the collaboration of 118 distance education specialist teachers and 106 students. Validity and reliability of the Model was proved by the following coefficients: Content Validity Index (90%), Cronbach’s Alpha (0.73), Absolute Percentage (89.2%), and Fleiss’ kappa (0.81). Discussion with the specialists revealed that the Model contributes for the teachers’ explicit orientation to evaluate students’ competencies that are valued in the job market, such as problem solution, critical and analytical thinking, written communication and creativity.
The objective of this thesis is proposing a model to evaluate Engineering students’ competencies in on-line discussion forums. The model includes a grading tool (rubric), based on Bloom’s Taxonomy, for the evaluation of competencies in Engineering courses which stimulate logical thinking and decision making. The literature review revealed research possibilities about the proposed model use, such as the comparison of different rubrics, the application of Bloom’s Taxonomy in collaborative activities, and rubric validity and reliability in different educational contexts. The evaluation Model uses an analytic rubric, which provides a specific feedback for each of the evaluated competencies, according to the levels of Bloom’s Taxonomy: remembering, understanding, applying, analyzing, evaluating and creating. The evaluated competencies are relevant for the Accreditation Board of Engineering and Technology, 2015 World Economic Forum, and National Academy of Engineering, keeping in view the complexity and challenges of the 21st century professional.Validation of the model was done through its application in public universities (Escola de Engenharia de São Carlos (EESC), Instituto Federal de São Paulo (IFSP) e Universidade Federal de São Carlos (UFSCar)), with the collaboration of 118 distance education specialist teachers and 106 students. Validity and reliability of the Model was proved by the following coefficients: Content Validity Index (90%), Cronbach’s Alpha (0.73), Absolute Percentage (89.2%), and Fleiss’ kappa (0.81). Discussion with the specialists revealed that the Model contributes for the teachers’ explicit orientation to evaluate students’ competencies that are valued in the job market, such as problem solution, critical and analytical thinking, written communication and creativity.
Descrição
Palavras-chave
Rubrica, Fóruns de Discussão, Educação a Distância, Taxonomia de Bloom, Avaliação de Competências, Rubric, Discussion Forums, Distance Education, Bloom’s Taxonomy, Competency Assessment, Ensino à distância, Competências essenciais, Fórum (Debates)