Friday, September 25, 2020

On Nonacademic Jobs

 Yes, I know that most of you decided to get a PhD specifically because you had an academic career in mind. But keep in mind that while you were all exposed to academic careers to some degree while in college, you might not know about the many fulfilling jobs you might have (with that PhD in hand) in the private sector, government sector, etc. I will not tell you which is best for you, but I will tell you to seriously consider all of these options when sending out applications. Read about what everyday life looks like in the different types of jobs. Think about how to prepare for the job market if you're particularly excited about a nonacademic career.  

In this morning's blog entry, David Mackenzie points us to many different and useful resources focusing on jobs for development economists. Have a look here.

Thursday, September 17, 2020

Are You Really Controlling for that Variable?

Yes, we love RCTs and RDs (and maybe sometimes IVs and difs and difs, I guess), but remember the tried and true way to get at causal estimates is just to good old-fashioned control for omitted variables. From a "research is so cool" perspective, it's quite fascinating to see an estimate of interest drop suddenly in response to adding an important control variable. From an "I won't get this published unless I have those stars" perspective, you often hope this doesn't happen...and when is it least likely to happen? When you're sloppy in constructing those control variables or when the variables themselves only imperfectly measure the true omitted variable. 

So what happens when you add a variable measured with error as a control variable in your model? Supplysideliberal.com explains it all here with excellent intuition as well as matrix algebra! Who could ask for anything more. I've copy-pasted the important bit here: 

"Compare the coefficient estimates in a large-sample, ordinary-least-squares, multiple regression with (a) an accurately measured statistical control variable, (b) instead only that statistical control variable measured with error and (c) without the statistical control variable at all. Then all coefficient estimates with the statistical control variable measured with error (b) will be a weighted average of (a) the coefficient estimates with that statistical control variable measured accurately and (c) that statistical control variable excluded. The weight showing how far inclusion of the error-ridden statistical control variable moves the results toward what they would be with an accurate measure of that variable is equal to the fraction of signal in (signal + noise), where “signal” is the variance of the accurately measured control variable that is not explained by variables that were already in the regression, and “noise” is the variance of the measurement error."

But now for some practical advice from me: When you add an important control variable to your model, be sure to show its estimated coefficient in the table (vs. just having an X signifying that you controlled for it). Why? If you know that variable is an important omitted variable, but its estimated coefficient is close to zero and not statistically significant, the culprit may be measurement error. If that's the case, then we shouldn't be surprised that adding this poorly measured variable doesn't change the estimated coefficient of interest. On the other hand, if you can show that the control variable has its expected impact on the outcome AND it doesn't budge your estimate of the coefficient of interest, you're probably good!  

Conclusion 1: Minimize measurement error by coding carefully. 

Conclusion 2 (copied from the blog): "I strongly encourage everyone reading this to vigorously criticize any researcher who claims to be statistically controlling for something simply by putting a noisy proxy for that thing in a regression. This is wrong. Anyone doing it should be called out, so that we can get better statistical practice and get scientific activities to better serve our quest for the truth about how the world works."

Thursday, September 10, 2020

Bellemare's How to Write Applied Papers in Economics

I have blogged before about Marc Bellemare's advice on how to write an introduction, how to write a conclusion, how to write the parts in between. Well, he's now put it all together in one place and added some additional bells and whistles. You can see it all here

My advice: Read it from beginning to end now. Then, when you're actually writing an introduction, read the section on how to write an introduction again. Have it open while you actually write your introduction. When you have to decide where to send your "finished" paper, have another look at the section on where to send your paper. 

Writing a paper is hard. Any paper. Even a really bad paper. This handy guide simplifies the process so it becomes more doable for you. Maybe even better, your papers become more readable for your advisors, editors, referees, and just regular readers. 

Good luck!

Writing Gives Me Too Much Joy to Do It Professionally | by Ryan Fan |  Better Marketing | Medium