Archive | teaching RSS for this section

IT Merry-Go-Round

Long long ago, computers were big expensive machines lodged in climate-controlled rooms behind lock and key, access being held by the masters of the campus IT professionals. Users paid by the kilobyte, by the seconds of connect time, by the milliseconds of compute time. The gods of IT raked in money like casinos.

Then came the PC.  Within a few years, the IT department at MIT, for example, had collapsed from its previous lofty heights, discontinuing mainframes and reducing support staff to posting flyers around campus, offering services users were delighted to ignore. The totalitarian system was dead! Long live democracy!

Well, slowly but surely we’ve encouraged a new generation to take up the crown and beat us with the scepter of access until we bow down in homage to our noble masters. “The Cloud” is, in fact on most campuses, just the same mainframe.  Better OS, much better iron, but as campus IT has decided that mere users must be protected from the world beyond, they have leveraged the need for security from the broader internet into security for the denizens of the IT department. Despite, all to frequently, their staff being the source of the serious break-ins (in GG’s building, the two serious security lapses were both caused by mistakes made by IT professionals).

And yet it is even more insidious. Instructors are increasingly told to place their courses within course management systems, web-based monstrosities like Blackboard, Canvas, and Desire2Learn. These three (GG has had experience with all of them) are essentially interchangeable even as each is painful in its own way; their main advantage over just regular web pages is that intraclass materials are private and so protected information like grades and use of copyrighted materials can be freely placed online.  Yet, practically like clockwork, campus IT decides it is time to shift from one to the next.  Why? Usually some relatively trivial capability is trundled out to justify the move (Now on smartphones! Now with free-form answer quizzes! Now looks snazzier!)–despite the likelihood that the previous provider will match that new wrinkle within a year or two.  So faculty and teaching staff and students are forced to learn yet another way of doing the same damn thing, which means….time for our boys (and a few girls) in IT to collect paychecks running workshops on how to do things and building web pages on how things are different and, of course, spending months if not years first installing and then troubleshooting the new software and then migrating content over all while supporting the old system for a year or two longer than originally planned until it is now time to begin the process of investigating the latest iterations of such software, which inevitably leads to…moving to a new system!

Something similar goes on with email support, internet video conferencing, personnel management software and other computer-related interfaces. Non-IT administrators who in theory are riding herd on this are so divorced from both users and the technology that they lack the backbone to say “no, what we have will suffice.” It remains unclear if the disruption to instructors and students plays any role in the calculations made to justify these changes (it seems certain to be underestimated).

Of course campus IT is at increasing risk of being outsourced to companies like Microsoft and Google (indeed many functions already have).  It isn’t hard to predict that there will be a major scandal when a university’s “private” information somehow wanders off campus.  Watching all this can make a grumpy geophysicist who remembers the early days of the internet and the last gasps of the old IT mainframes dwell fondly on the memories of hope…

Assessing Assessors

Another facet of the “college isn’t really worth it” mindset has shown up in an op-ed by Molly Worthen in the New York Times. The op-ed itself complains that assessments of learning in colleges are, as implemented at present, a waste of time and effort. It is in the comments that you see a lot of people arguing quite strongly that some proof of learning is of value to those paying the bill. The irony is that these two sides are probably not disagreeing.

Years ago, the assessment was pretty obvious.  Got an “A” in a course–you demonstrated mastery of that subject.  Got an “F”? You didn’t. Note this didn’t necessarily measure learning in that class–if you waltzed in having already passed such a course elsewhere, you might have learned nothing, while the F student might have learned a lot relative to a poor base. While on occasion the instructor caught flack for doing a poor job, generally it was the student who discovered he or she was not up to the task. Read More…

The Impact of Student Teaching Evaluations

One of the frustrations students sometimes have is a feeling that their perception of the quality of instruction is ignored.  Some will complain that some faculty got a promotion or tenure or didn’t get fired despite getting a scathing review from students in some form of student review of a course (here at CU these are faculty course questionnaires, or FCQs, a term we’ll use as a stand-in for all the variants out there).

There is some truth to this.  Faculty at a tier 1 research university almost never are denied tenure because a course was poorly taught.  And unless it becomes a tradition, it will rarely affect a faculty member’s salary. Why is this?  After all, teaching is a significant part of the job. And so what impact, if any, do these surveys have?

The first problem is that things like FCQs are only one rather imperfect measure of quality of instruction. They are, for instance, easily manipulated by giving higher grades (the most sadistic trick is to give high grades on a midterm, then the FCQ is administered before the final, where the instructor lowers the boom). At CU these questionnaires are administered the last couple weeks of class, when students are most stressed about completing the course with a good grade, so how a course fits in with the general level of stress can color evaluations. Occasionally even the best instructor will get sideways with a class, perhaps for a joke that falls flat or because of some misbehavior from a student that leads to disharmony. Students’ self-perception of the fraction of material they have mastered fits into this. And for non-major courses, there is much less interest in mastering the material, so a poorly taught intro non-majors course might get high FCQs because it was easy (this is not as common for majors courses, where students tend to recognize that there is stuff they need to learn that didn’t get taught).

What FCQs don’t measure is how much students learned, and how capable they are of completing tasks taught in the course. It is possible to have an ambitious class get low FCQs despite students actually knowing more that those completing a less ambitious section of the same course. One approach to measure what students learned is a concept inventory: a set of questions, usually given at the start and end of a class, that reflects understanding of key concepts being taught in a class. If students don’t improve, poor teaching; if they do, better teaching.  These work really well in courses with very fixed academic goals, like intro math and physics, but creating such inventories is difficult and time consuming; courses like intro geology, which might have goals varying somewhat between instructors, can only give an incomplete picture of the success of instruction.

A more common attempt to gauge instruction quality is peer review–having other faculty come in and observe the class and, ideally, interview it. This is most common for pre-tenure professors where a lot of mentoring is possible. But your teaching might seem quite good to peers but lousy to students, and observing one or two classes will often only reveal the most flamboyant of transgressions.

Ideally you’d like to see what students retain 4 or 5 years after completing a course. This isn’t ever done.  GG’s one experience was encountering a student in a science museum who had taken his intro course.  Asking him if the course helped him at all working in a science museum, the answer was “No, not at all.” Evidently for that student, that course was a disaster.

So FCQs maybe aren’t a great measure of teaching, but then what good are they?

Read More…

College Changes

No, not changes to the college, changes by it. For years and years now, higher education has been viewed as the perverter of young minds even as it is lauded as the gateway to upward mobility. Although this is usually portrayed as fine upstanding youth becoming leftist socialists, some of us remember the preppie phase where leftist parents lamented the materialistic impulses of their college offspring.

Does this have any meaning? Is it that the teachers at colleges and universities are brainwashing students? Does this reflect a cocoon where disagreement with the party line is squashed?

Read More…

When did textbooks become disposable?

There are of course many divergences of current college students from GG’s time, but some continue to surprise a little.  One such is that it seems nearly all college students don’t keep their textbooks.

We aren’t talking about the texts from breadth requirement courses (though GG kept his texts from those too), we are talking about the textbooks used in upper division major courses. One might think that these could prove helpful references in professional life, but  many students sell their texts back to the bookstore.  The odd thing is that many students want a textbook when taking a class (GG had dropped requiring a text in a 1000-level class years ago and students kept asking for a text, so he listed readings to go with the web materials provided). Publishers have noticed and now offer “rental” versions of e-book versions of texts that self-destruct after the course is over; similarly, campus bookstores are now aggressively seeking and marketing used books (and harassing faculty to let them know of future text requirements so they can try to only repurchase the texts that they might need).

This has to be more than simple economics–yes, books can be expensive, but they are still a fraction of the cost of the course and can still provide education long after the course is completed. Is this a case of penny-wise and pound-foolish?  Or is it some feeling among modern students that the internet will always have what they need? Or that a textbook will go out of date in short order?

As a textbook coauthor (well, GG wrote software), GG is curious.  Declining sales of texts will mean there will be fewer texts going forward and they will cost more, which presumably will result in fewer sales (the textbook death spiral).

Students often wonder about the cost of textbooks (well, so do authors and professors, to be honest). In some ways this parallels the arguments over the value of academic journal publishers. Texts usually are reviewed (first as a proposal, again when nearly completed); they have copy editors and graphic designers to try and make the book pleasant to read.  And the potential financial reward for some flavors of text (mainly the intro texts–upper division geology texts are not huge money makers) encourages authors to work to make material more accessible and better illustrated than their own course notes. So there is real value added, though there is a question of that value versus the cost.

Maybe it is just that modern students are wiser.  Of the texts GG has saved, probably half have never been reopened and most of the rest just a couple more times. But there are a few that are now falling apart from repeated use.  Maybe modern students aren’t simply cheap, maybe they are better about divining which are those go-to books.

Do Profs Need AA Batteries?

No, not the kind that power a remote, anti-aircraft batteries, like those used to shoot down enemy fighters.  Why?  A story in Boulder’s Daily Camera describes the current crop of university students and their parents, referring to the parents as “stealth-fighter parents.” It is hard to know who comes off worse in this story. Let’s start with the parents, described thusly:

These so-called stealth-fighter parents don’t just hover, they are directly involved in their child’s life and schoolwork, even in college.

They are expert researchers and will show up to meetings with loads of data. They’ll dig deep into a professor’s background.

“That parent will know what your dissertation was and they’re going to call you out if something is wrong in the classroom with their child and expect you to fix it,” Gonzales said.

They’re less likely to argue with a professor for hours, and instead will find a loophole or confront that person’s supervisor.

Some of these parents will skip the discussion phase and take action immediately, such as filing a lawsuit or pulling their student out of school.

Dear stealth-fighter parents: do not try to pull this crap with GG. Any issues your progeny have with professors belong between the student and the professors.  You say you paid good money and so have a right to carp at professors? No, you made an investment in your kids–arguably you gave your kids the money.  They are the ones who have a right to carp at professors. You can try to prompt them with arguments and data, but you know what?Remember that your goal as a parent is to have your kids become self-sufficient adults. Just to be clear, GG is paying those same sky-high tuition bills for his kids and has not even thought of contacting a professor at those schools.

The good news is that GG has not seen a shred of this behavior. The only time GG has spoken with parents of students has been at commencement, and parents have uniformly been gracious and complementary.

OK, so that’s the parents.  Just how does this article describe the students?

[M]illennials and Generation Z students believe they are special and that their feelings matter above all else. They have increasingly short attention spans.

They have high levels of anxiety and depression, in part because their parents are always looking over their shoulders. They grew up in an era of terrorism and intense economic pressure, and have likely never experienced personal failure.

They’re entrepreneurial and grew up surrounded by ethnic and racial diversity. They’re narcissistic and tend to have an inflated sense of self.

And then there are the selfies, Snapchat stories and other means of getting immediate validation from friends and peers.

Wow.  This is how colleges and universities view their customers? And advice later is that we need to cater to them?

Well, maybe that isn’t quite the advice; maybe it is, this is what you have to work with. It isn’t entirely clear.

How many college students without military service have ever faced “personal failure”? Is that so new? High levels of anxiety is new?  (GG has had students in his office pleading that they “just can’t fail this course or will lose their scholarship/be kicked out of school/lose their visa” pretty continuously his whole career).

Some of this does resonate.  Students are disinclined to memorize anything; it takes real work to (1) convince them that some things are worth memorizing (not a lot, just some things) and (2) get them to demonstrate that they have memorized anything. There has been a steady drumbeat of requests for “how am I doing in this class”that maybe has increased over the past decade; it is hard to say. Student writings are often haphazard and loosely linked thoughts that border on stream-of-consciousness. Higher reasoning (indeed, the ability to make or attack a logically-based argument) seems to have lost out to simpleminded “gotcha” logic. But none of these have been large game-changers; students  have always been lacking in some ways and part of our job is to recognize deficiencies and develop strategies to correct them.

GG’s take is that these kinds of generational summaries are exaggerations–at least that is the hope.  Making such broad-brush stereotypes might insult some and suggest to others that they could behave differently and get away with it. For traditional students just coming from high school, college is and has been a place of transition from dependency to independence. The old saw is that respect is not given, it is earned, and college is a place to both learn how to earn respect and to succeed at it. Whining and letting others fight your battles does not earn respect. Parents should be there for emotional and often financial support, but they should not be students’ advocates in the school.

And students? Hey, it isn’t as bad as you think.  The unemployment rate for folks who get through college is under half that of those who never get a degree. Buck up, and work on clever retorts the next time somebody shatters your “special feelings.”

The Good Lecture…

G. K. Gilbert was arguably the best geologist America has produced.  He received a classical education rich in languages and math and physics but poorer in other sciences.  Much later, in advocating a particular style of intellectual attack suitable for geology, he reflected on college courses. “Gilbert [said] in an address, 20 years [after he graduated], that the important thing is to train scientists rather than to teach science, and that the ‘practical questions for the teacher are, whether it is possible by training to improve the guessing faculty, and if so, how it is to be done;’ thus implying not so much that, in his own experience, accurate observation is easy, but that successful guessing is difficult. It must also have been not his professor’s idea but Gilbert’s, prompted perhaps by a remembrance of an over-insistence on the names of things, that the content of a subject is often presented so abundantly in college teaching as to obstruct the communication of its essence, and that the teacher ‘might do better to contract the phenomenal and to enlarge the logical side of his subject, so as to dwell on the philosophy of the science rather than on its material.'” (Wm. Morris Davis, National Academy Memoir on Gilbert, 1928).

This comes up in part because of a recent New York Times op-ed in favor of lecturing that rather unfortunately seems to pit student-centered learning as practiced in the sciences against lecture-based learning in the humanities.  Molly Worthen, in this column, argues that “Lectures are essential for teaching the humanities’ most basic skills: comprehension and reasoning, skills whose value extends beyond the classroom to the essential demands of working life and citizenship.” One has to wonder, are these skills limited to the humanities?  Shouldn’t scientists also be learning how to comprehend and reason thoroughly?

Read More…