Sunday, October 25, 2009

Sucky Contests

Sometimes I wonder if math team is worth it. How does one get onto the teams that we send to Duke Math Meet, the Harvard-MIT Mathematics Tournament, the Princeton University Mathematics Competition, and the American Regions Mathematics League? Well you have to do well on contests given during eighth period. Fine, so what contests do we do? Well the main one that counts for these away contests (except for ARML) is the NYCIML: the New York City Interscholastic Mathematics League (Mandelbrot also counts, but occurs much less often). When I first joined math team, this was fine. Now I'm not so sure.

So what is wrong with NYCIML? For a large portion of the math team, absolutely nothing. However, for the people who actually have the potential to make our A team, there is a lot wrong with NYCIML. The biggest is that it is completely unrepresentative of the contests that they will have to face if they get selected for the team. For example, freshman year I qualified to be one of the members of TJ A at PUMaC. I got a 0 on number theory, what I considered at the time to be my best subject. That's right. I didn't get a single number theory question correct.

What went wrong? Well, it was a combination of PUMaC being crazy hard and a severe lack of preparation for that kind of math. To put it simply and bluntly, the contests that we do simply do not prepare people for contests, and they furthermore test for something completely different than what PUMaC and HMMT test for.

After three years of experience at PUMaC and HMMT, I think I have a good idea of what characteristics makes one successful at each of them. PUMaC rewards knowledge and an ability to work through standard computations, regardless of how ugly they get. Many PUMaC problems are not theoretically difficult, but finding the actual numerical answer is the bulk of the work. HMMT, on the other hand, focuses much more on problem solving. Most of their problems require little prior knowledge; almost everythign necessary can be derived on the spot. Some exceptions exist: the fact that has been used, for example. But by and large, HMMT is a contest based around how well you can handle things you've never seen before.

So what is NYCIML? NYCIML is just a hard math test. Practically everything can be seen instantly. There is no creativity involved. In fact, the last NYCIML this year essentially repeated two of the problems from the previous one. Contests that do that are generally bad. They become formulaic; anybody who has seen enough problems will do well, regardless of how good they are at math. As a result, for the people competing for the top spots on our math team, NYCIML is not about solving problems. It's about eliminating stupid mistakes. While I am all for stupid mistakes being considered in rankings, it should not be the determining factor as it is here.

This is why I wrote more than 50 problems over the summer. I wanted to create contests that would prepare the team for what they will face at PUMaC and HMMT. So far, the team has not met my expectations, but I believe that they will grow now that they have been faced with the challenge and the knowledge that there are three more to come. The biggest difference between the contest that I wrote and the NYCIMLs is the average. Out of 6 points, the NYCIML top 15 averages have been around 5. Out of 19, the top 15 average on my contest was a little over 6. What does this mean? It means that you have more than one route to victory. The first is to do the same thing as NYCIML: do the problems you know how to do and do them right. The problem is that I ramped the difficulty up quickly, so many of these people probably got a 4, or possibly a 2 because they still missed one of the first two problems (the contest was six problems weighted 2,2,3,3,4,5 respectively). The other method to victory is to be more ambitious, solving more problems, and then maybe you make a mistake or two that drops your score from 11 to 8. You'll still be ahead of most of the people. However, making a single mistake on a NYCIML costs you dearly, even if you know how to do all the problems.

At HMMT, the top score is not 50. If you know how to do all the problems, you will win, even if you make stupid mistakes. I speak from experience: On the 2009 Calculus test, I solved all 10 problems. I made some stupid errors on 9 and 10, dropping my score down to 35. As a result, I tied with Kee Young for first, but lost the tiebreaker. Regardless, the fact that I could make two mistakes and still tie for first demonstrates how different HMMT and NYCIML are. The two mistakes probably cost me the overall first place, but I was second, not eighth. One mistake is much more acceptable at HMMT than on NYCIML.

So why do we choose our team based mostly on a contest where problem solving is minimal? And why do we pass it off as good practice? It's good practice for most of the team, but not A team. But A team is the team that represents us at competitions, so it seems weird that we train the rest of the team more. Hopefully these performance contests will help jolt people into realization that being good at NYCIML does not mean that they will do well at every contest and will continue to work to improve in order to conquer the challenges I have given them.

The performance contest (to be done in 35 minutes):


And as an amusing sidenote:

5 comments:

  1. First, I'd like to point out that Duke and NYCIML have very similar difficulties, as well as the first 6 problems of the old ARML style. Having said that, I completely agree with everything said in this post.

    Another downfall in this system is that this partially ruins the effectiveness of our lectures. Most of our veteran lectures- or at least the good ones- should prepare you for Princeton (HMMT, as Brian said, requires very little prior knowledge), which in turn will make Duke and ARML seem easy. However, people come to the lecture, see that the topics and/or problems are hard, and say "I don't need to know this to qualify for A team," which is completely true.

    If NYCIMLs are so crappy, why do we continue to do them? Well, the short answer is the sponsors exist. It is tradition that we take NYCIMLs and use them for performance, and tradition is very important to them. We could easily have the senior officers write performance contests for the following year in their second semester. Besides the difficulty level, getting rid of the NYCIML also saves some money for Academic Boosters (unless the senior officers want to get paid...). But no, this just doesn't sit well with them, just as determining Princeton teams from the current year's rankings makes no sense at all to them (after 4 contests and a drop, only half of the top 8 non-seniors from arml are in the top 8 now).

    ReplyDelete
  2. It's funny hearing this from the HMMT-problem-writing side.

    Re: amusing sidenote:

    Dear ARML Coaches: Since October 10th, 2009, we have been experiencing difficulties with our website. Individuals have accessed our website and inserted code that is malicious in nature. This has caused difficulties with our scoring database. We have scanned our website and removed all references to this malicious code and are currently implementing measures to prevent this from happaning again in the future. For convenience, the text from the front page of our website has been provided below. We hope that the website will be fully functional by midweek (approx. October 29, 2009). If there are any questions or concerns, please contact Michael Curry directly at currymath@gmail.com. Thank you for your support and patience.

    ReplyDelete
  3. your firefox theme is yucky and wastes vertical space :P at least get rid of the useless bookmarks toolbar...

    on a side note, it would be quite amusing if you had TabRenamizer (ff addon) enabled with that many tabs. you shall be massively confuzzled unless you memorize the locations of your tabs XD

    /unhelpful comment :D

    ReplyDelete
  4. "I got a 0 on number theory, what I considered at the time to be my best subject. That's right. I didn't get a single number theory question correct."

    At PUMaC my junior year I got a 0 on combo (my "best" subject), and top 5 in NT.

    ReplyDelete
  5. you certainly did not get a 0 in number theory frosh year.

    Number Theory
    127010 Thomas Jefferson A 9 Brian Hamrick 17

    https://cgi.math.princeton.edu/mathclub/index.php/PUMaC_2006_Results

    and also mu B beat mu A XDDD ahh, how times change…

    ReplyDelete