Posts Tagged ‘Data Mining’

Learning analytics is the "crystallography" for educational research

March 24th, 2014 by Charles Xie
To celebrate 100 years of dazzling history of crystallography, the year of 2014 has been declared by UNESCO as the International Year of Crystallography. To this date, 29 Nobel Prizes have been awarded to scientific achievements related to crystallography. On March 7th, the Science Magazine honored crystallographers with a special issue.

Why is crystallography such a big deal? Because it enables scientists to "see" atoms and molecules and discover the molecular structures of substances. One of the most famous examples is the discovery of the DNA helix by Rosalind Franklin in 1952, followed by Crick, Watson, and Wilkins' double helix model. Enough ink has been spilled on the importance of this discovery.

Science fundamentally relies on techniques such as crystallography for detecting and visualizing invisible things. Educational research needs this kind of techniques, too, to decode students' minds that are opaque to researchers. Up to this point, educational researchers depend on methods such as pre/post-tests, observations, and interviews. But these traditional methods are either insufficient or inefficient for measuring learning in complex processes such as scientific inquiry and engineering design. To achieve a level of truly "no child left behind," we will need to develop a research technique that can monitor every student for every minute in the classroom.

Such a technique has to be based on an integrated informatics system that can engage students with meaningful learning tasks, tease out what are in their minds, and capture every bit of information that may be indicative of learning. This involves development in all areas of learning sciences, including technology, curriculum, pedagogy, and assessment. Eventually, what we have is a comprehensive set of data through which we will sift to find patterns of learning or evaluate the effectiveness of an intervention.

The whole process is not unlike crystallography. At the end, it is the learning analytics that concludes the research. Today we are seeing a lot of learner data, but we probably have no idea what they actually mean. We can either say there is no significance in those data and shrug off, or we can try to figure out the right kind of data analytics to decipher them. Which attitude to choose probably depends on which universe we live in. But the history of crystallography can give us a clue. It was Max von Laue who created the first X-ray diffraction pattern in 1912. He couldn't interpret it, however. It wasn't until William Henry Bragg and William Lawrence Bragg's groundbreaking work later in the same year that scientists became able to infer molecular structures from those patterns. In educational research, the equivalent of this is the learning analytics -- a critical piece that will give data meaning.

For more information, read my new article "Visualizing Student Learning."

The first paper on learning analytics for assessing engineering design?

January 30th, 2014 by Charles Xie
Figure 1
The International Journal of Engineering Education published our paper ("A Time Series Analysis Method for Assessing Engineering Design Processes Using a CAD Tool") on learning analytics and educational data mining for assessing student performance in complex engineering design projects. I believe this is the first time learning analytics was applied to the study of engineering design -- an extremely complicated process that is very difficult to assess using traditional methodologies because of its open-ended and practical nature.

Figure 2
This paper proposes a novel computational approach based on time series analysis to assess engineering design processes using our Energy3D CAD tool. To collect research data without disrupting a design learning process, design actions and artifacts are continuously logged as time series by the CAD tool behind the scenes, while students are working on an engineering design project such as a solar urban design challenge. These "atomically" fine-grained data can be used to reconstruct, visualize, and analyze the entire design process of a student with extremely high resolution. Results of a pilot study in a high school engineering class suggest that these data can be used to measure the level of student engagement, reveal the gender differences in design behaviors, and distinguish the iterative (Figure 1) and non-iterative (Figure 2) cycles in a design process.

From the perspective of engineering education, this paper contributes to the emerging fields of educational data mining and learning analytics that aim to expand evidence approaches for learning in a digital world. We are working on a series of papers to advance this research direction and expect to help with the "landscaping" of  those fields.