The Dog Ate/Scooped My Research: What scholarly research doesn’t need

In response to the article dated 23 August, 2010, wherein Patricia Cohen, New York Times, explains how Dan Cohen, George Mason University, considers current academic culture–literature, in particular–the “exclusive” domain of “the charmed circle of tenured academe” (Cohen, 2010). They crticize the dearth of individuals that have invested

I won an Amazon Kindle2 from the Springer booth at the Academy of Management Annual meeting 2010 in Montréal this August!

significant time and effort to develop disciplined higher order reasoning as a “monopoly that peer review has on admission to career-making journals.” The de-emphasis of prestige that I believe social media and revolutionary applications of it to research, such as Mendeley, has the power to encourage and the consequent emphasis on scholarliness and quality of research can improve integrity in science by raising expectations on all researchers to be familiar with research regardless of the Impact Factor of the journal it was published in.

Doing so would allow quality research to be published in a timely manner, quality assured by peer review, but eliminating “the dog ate my paper” as an excuse as well as the “dog published my paper” excuses that come free in the box with allowing submissions and revisions from everyone and their dogs. Just like so many other blogs, I launched mine (http://robincheung.info/mbalog/) without any more inspiration than the myriad other blogs launched by keen young MBA grads after reading that “the best thing you can do is start a blog (or video series or wiki or some other online channel)” (Scott, 2010). After deciding I had mastered half the art of optimizing blog readership, I though I should try the arguably-harder opposite goal of maximizing.

Now that I’ve spent time in the natural and social sciences, as a bank analyst and an academic, and don’t feel smarter or richer than anyone else in particular, I think my role is to spend the time and effort to explain some of the more advanced concepts that researchers and academics often base on actual stock prices, that practitioners and professionals don’t want to invest a little brain make think into for more consistent and defensible outcomes, and that everyone else thinks is either black magic or secret methods to exploit them. In a similar way, I feel that the NY Times article was written to persuade rather than to inform–to sell newspapers rather than solve a problem. It looks like a story a researcher’s topic, written by a journalist (in contrast to a researcher writing a phenomenology on sensationalism in journalism).

Even though I’ve barely crossed the starting line in my academic career, it is immediately clear that the NY Times article argues that the solution to the research-equivalent the square peg-round hole problem is to improve peg-squaring efficiency to reduce any delays during the stochastic peg-rounding process. Necessary specificity of research questions and their logical emergence from previous findings they tend to exhibit most often questions how effective the blinded review process is in ensuring reviewers treat both friends and competing researchers’ works the same.

In order to capitalize on popular perception of academics in their exclusive Ivory Towers and undermine the dogma that blinded peer review is needed to prevent application of theory to inappropriate situations (intentionally or unintentionally), using deprecated methodologies or analyses to support a researcher’s beliefs, data, or birthday wishes (see Flescihman, 1989) Patricia Cohen (2010) now “experts evaluate a submission, often under a veil of anonymity, can take months, even years” The reality is that academia does not at all need a greater abundance of scholarly publications but rather a systemic shift towards an equilibrium that rewards increased accountability, pursuit of truth over personal glory or this-worldly rewards (but not Weber’s all-holy this-worldly ascetism).

The union of a researcher’s familiarity with key researchers in their own field combined with caring enough to know what project their friends currently find more important than catching up over lunch–or even a phone call–notwithstanding, Cohen (2010) retains “anonymity” as a straw man argument intended only to support the generalization that this anonymity reduces accountability; by convention, I define the intersection of researchers whose papers make it to blinded review that believe anonymity is their paper’s saving grace( from a rival’s biased review) and the set of researchers that cannot reject the existence of Santa Claus at a non-neurotic significance level to be the null set.  Practical considerations and costs dictate each journals’ policies, but I know that the critical feedback for the few papers I have had the opportunity to review anonymously was forwarded to the authors to inform improvements to their paper.  My own comments were even rated for usefulness by the original authors in some cases.

Adoption of social media platform such as Mendeley will drive. It is true that some prestigious journals have rejection rates over 95% and equally true that some of these journals average 12 to 18 months–or longer–from the time a paper is accepted until it reaches the news stands (or doesn’t reach the news stands, in the case of any respectable journal). It is just as true that humans live to 120 years of age before dying of old age. What it is not is either “representative” or “ideal” Article turnaround times averaged three months for arbitrarily-selected journals published by Springer, a leading journal megapublisher that brings you such exciting leading edge scholarly publications such as “Annual Review of Gerontology and Geriatrics” and “International Review on Public and Nonprofit Marketing,” (although I did win an Amazon Kindle 2 eBook reader from filling out a comment card at their display booth a few weeks ago at the Academy of Management 2010 Annual Meeting in Montréal, my selection of Springer as an archetypal publisher was by no means influenced because they awarded me the awesome new ebook reader that is actually suitable for academic research and not just for reading novels; maybe someone will leverage the Mendeley public API and extend ebook readers beyond simply a way to carry around more articles).

F-test Fisher-Snecdor distribution describing elements of variation; used in basic statistical tests, such as ANOVA

Without even looking for a brand new ISSN number, there are already myriad scholarly journals struggling that have competent editors, astute methodologists that will call you if you try to use a pairwise t-test when there is no good reason not to use an ANOVA Levene’s test, or that you did know using ANOVA would avoid amplifying Type I error from pairwise t-tests, but you forgot if the null hypothesis in Levene’s test was that population variances were homo- or heterogeneous and flipped a coin for your post hoc. There are many competent reviewers who will critically review your study’s insightful correlation of psychopathology to the Big Five personality traits, diligently-assessed through a rigorous administration of MBTI MMPI, and NEO-PI (clearly supported by a citation in the Harvand Journal of Psychology, one of the myriad+1 peer-reviewed journals that now exist; somehow the hypothetical Institutional Review Board didn’t find that undue burden on test subjects I guess), in accordance with the Protection of Human Research Participants principles attested by the free NIH certification, to matched samples (of size calculated using the appropriate sample size calculation for the anticipated tests using G*Power 3) of 18- and 19-year-old Form 5 exchange students from Hong Kong, all of whom gave informed consent. Just the same, methodologists might enquiry how you’ve considered “regression to the mean” in your design–psychopathology itself being defined by abnormal behaviours and that you anticipate would be reflected in abnormal scores. And psychologists who took more than introductory elective I took in undergrad might point out that different cultures may systemically personality traits differently to the population used to norm reference the tests.

As early as 1996, libraries hoped electronic journals (in development since 1976) would be able to mitigate the huge acquisition and maintenance costs of traditional paper-bound scholarly journals (Harter, 1996). First Mondayirb is a “peer reviewed” journal that has been openly accessible on the Internet since 1996 that states its articles are reviewed by “at least three reviewers for originality and timeliness in the context of related research” (First Monday Editorial Policies, 2010), but whether reviewers critique validity, methodology, or theoretical framework was not as clear. One recent ethnographic examination of scientists that use blogs in a scholarly context, acknolwedged that blogs may not be appropriate in all situations, but since “the aim of this article is to study the motivations of researchers that keep a blog, and because of this point of departure, the critical or problematic aspects of blogging were not main topics” (Kjellberg, 2010). Although I may be a fledgling researcher myself and appreciate the higher order reasoning practice required to deduce specific examples of “problematic aspects,” I would prefer if the author could delineate some prototypical cases to ensure I internalize a model of blogging congruent with the author’s. I have encountered one of these “problematic aspects” in my own blog; in response to a recent blog post pointing out that activists are no less guilty of manipulating the truth than the corporations they decry, I was asked by the author to pretend there was never any attempt to manipulate readers because they had erased whole portions of their post to which I objected. The author clearly intended to leverage complex-sounding scientific terms to incite fear in the public of such as compounds as “calcium carbonate (chalk)” (Cheung, 2010).

I’m not sure whether the original intent to use readers’ ignorance of scientific terminology for everyday compounds or the attempt to cover up the attempt was the greater disservice. Nevertheless, even if the focus of the article were to explore how certain scientists used blogs in a scholarly context, I would prefer the author at least delineate what advantages and disadvantages blogs had that made them worth investigating, if not evaluating each blog against a set of strengths and weaknesses.

One of the strengths I’ve come to appreciate of Walden’s doctoral programme is the redesigned research theory

The efficient frontier, where CAL is the capital allocation line.

and design courses that gives a structured “big picture” introduction to research design. Beginning with epistemology and ontology, students are encouraged to make sure they are asking research questions that are not only socially-relevant and that are appropriately-, but not arbitrarily-,specific; whether paid by accountability-demanding tax-payers or investors that nod when you ask if they’re sure they know what a Venn Diagram is and then equally frenetically point to the area outside the only circle (these must be the same kids that keep telling us to “think outside the box”) in Figure 1 that Markowitz (1952) explains contains the set of “attainable E, V combinations,” you’ll inevitably have to say why out of you, Johnny, and Sarah, the only sensible strategy at the arcade is to give you the whole roll; it would be an epic waste of quarters any other way–without all of them, none of you has a chance at HI SCORE–durr.

As clear as it should be to any disciplined scientist–natural or social–that the invention of a teleportation machine would be unscientific, but the commercial application of it would be reckless, the distinction between a foray into a literature gap that yielded a commercially-successful innovation and a wholly-reckless unscientific guess that happened to function and may or may not eventually tear the universe a new black hole is frustratingly academic to investors, executives, and the teleportation market segment alike; furthermore, it would reinforce the common notion that academia does not pertain to real life. To the teleporting public, the warning against commercialization of a poorly-elucidated phenomenon makes less sense than why they should have to remember to apply Bessel’s correction (N-1) as the denominator for Sample Standard Deviation when simply dividing by N works (and makes more sense!) for Population Standard Deviation. And isn’t the sample supposed to be “representative” of the population, anyway??

References:

Cheung, R. (2010). The doGkins delusion: Deceived disciples. Retrieved 29 August, 2010 from http://robincheung.info/mbalog/2010/08/02/the-dogkins-delusion/

Cohen, P. (2010, August 24). Scholars test web alternative to peer review.  The New York Times. p. A1 Retrieved 29 August, 2010 from http://www.nytimes.com/2010/08/24/arts/24peer.html

Fleischmann, M.  (1989). Electrochemically induced nuclear fusion of deuterium.  Journal of Electroanalytical Chemistry 261 (2A): 301–308, doi:10.1016/0022-0728(89)80006-3

First Monday. (2010). Editorial policies: Peer review process. Retrieved 29 August, 2010 from http://firstmonday.org/htbin/cgiwrap/bin/ojs/index.php/fm/about/editorialPolicies#peerReviewProcess

Harter, S.P. (1996). Electronic journals and scholarly communication: a citation and reference study. Information Research. 2(1). Retrieved 29 August, 2010 from http://informationr.net/ir/2-1/paper9a.html

Kjellberg, S. (2010). I am a blogging researcher: Motivations for blogging in a scholarly context. First Monday. 15(8) Retrieved 29 August, 2010 from http://firstmonday.org/htbin/cgiwrap/bin/ojs/index.php/fm/article/view/2962/2580

Markowitz, H. (1952). Portfolio selection. Journal of Finance, 7(1), 77-91. Retrieved from Business Source Alumni Edition database. Scott, D. (2010). Job search advice for university students and recent graduates. Retrieved 29 August, 2010 from http://www.webinknow.com/2010/06/job-search-advice-for-university-students-and-recent-graduates.html

Scholars Test Web Alternative to Peer Review

Lies, Damn Lies, and Statistics III: Statistics Canada International Methodology Symposium 2010

Those of you familiar with my recalcitrant non-conforming ways but also know that I am loathe to reject any traditionally-accepted theory without first striving to gain a mastery ofStatistics Canada 2010 International Methodology Symposiumit will appreciate, then, my plans to attend the 2010 Statistics Canada International Methodology Symposium, from October 26 to 29, 2010, in my hometown (well, from the time I moved to my first “big city” from small-town Ontario in Grade 5 till I completed my BSc Hons. at Carleton).

I’m currently in Orillia to spend the day with my daughter so this will be a brief post that I’ll follow up on later, but the following are the highlights from the symposium; there’s still time to register!  Those in research as well as practical research, such as marketing research, will find great benefit and value in the programme:

Social Statistics: The Interplay among Censuses, Surveys and Administrative Data

Early Bird Registration until September 17th

Statistics Canada’s 2010 International Methodology Symposium will take place at the Crowne Plaza Hotel in Ottawa (located in the heart of downtown Ottawa) from October 26-29, 2010.

The Symposium is entitled “Social Statistics: The Interplay among Censuses, Surveys and Administrative Data”. Members of the statistical community, such as those from private organizations, governments, or universities, are invited to attend, particularly if they have a special interest in statistical or methodological issues resulting from the use of multiple sources of data (censuses, sample surveys or administrative data).

Symposium highlights are:

One full-day of workshops on Tuesday, October 26th

a) Record Linkage Methods (Karla Fox and Lori Stratychuk from Statistics Canada)

b) From Traditional Demographic Calculations to Projections by Microsimulations (André Cyr, Julien Bérard-Chagnon, Éric Caron Malenfant, and Dominic Grenier from Statistics Canada)

c) Using Administrative/Operating Systems to Strengthen Statistical Survey/Census Systems (Fritz Scheuren and Young Chun from National Opinion Research Center)

Jelke Bethlehem, Statistics Netherlands, as the keynote speaker on Wednesday, October 27th

Ivan Fellegi, Statistics Canada, as the Waksberg Award speaker on Thursday, October 28th

Following the symposium, a CD-ROM of the presented papers will be sent to all conference participants

The Symposium also anticipates a stimulating program of more than 90 invited and contributed presentations from Wednesday October 27th to Friday, October 29th, including various topics such as:

  • Databases
  • Sampling frames and use of multiple frames
  • Multi-mode data collection
  • Employment data, justice data, poverty data, health data
  • Complementary surveys
  • Traditional and administrative censuses
  • Record linkage methods
  • Treatment of non-response
  • Use of auxiliary data in weighting
  • Small area estimation
  • Microsimulations
  • Validation and reconciliation
  • Real-time access
  • Smart Sedition: Mastering a theory before rejecting it

    The following post was originally a response to a Facebook Wall post that I just saw in my Feed, by James David Lauckner.  It addressed the following unattributed quote, and did not at all consider addressing the link he associated with the quote.  See His Actual Post:

    Adversarial revolution against the ruling class will not work. It is up to those who want this shift to connect with others of like mind and begin actively creating networks of real cooperation. The old will crumble. The new period will dawn with its growing pains, the severity of which depends on our ability to accept what is happening and go with the flow. This requires evolving to unconditional love, with an open and simple heart, forgiveness, and cooperation with less ego competition.

    My response addressed only the quote, not the associated anti-fluoride link that accompanied it.  The anti-fluoride (and other) movement sentiment is one of those real-life case studies that a littleAlexander Pope knowledge is a dangerous thing; without appropriate theoretical framework and critical thinking (specifically needing only critical thinking, the lowest of the higher orders of reasoning, in my mind) and context with which to interpret scientific information.  The end result was the topic of http://robincheung.info/mbalog/2010/08/02/the-dogkins-delusion/

    It’s highly ironic, James, that whilst I believe that myself also, and try to align all of what I do with what I believe, that it’s often those same people that will advocate “change from within,” that but in the next breath, dismiss traditional mainstream science and academics, for any number of reasons.

    People will often, for example, reject both traditional scientific theory and hold that their alternate theory is more valid on the grounds that accepted scientific methodologies are, themselves, invalid.

    I’ve chosen a different approach. Originally because I largely hold alternative beliefs for many scientific (including social sciences) phenomena and chose to operate within established science as the only credible way to make any significant change that will be adopted to any degree for any length of time. But as I progressed in my studies, I began to realize that humanity’s search for the truth through research actually is served best ignorant of what my beliefs are. And that’s why, as a Catholic, I undertook a social problem of inequity against Muslims because of restriction on interest and the integral part of capital structure that loans play through application of financial engineering concepts to propose new derivative instruments. I believe that regardless of what my personal beliefs or biases are, I should demonstrate that I will put the same gusto and effort into any cause we undertake, whether it’s one I pesonally agree with or not, lest we be either doing–or even motivated by–a disservice by insulting and reducing the reliability and significance of what humanity knows, as a whole.

    Sake And Tekka Maki

    We already know that people aren’t going to be convinced by truth anyway (people still smoke even though they know it’s going to shorten their lives, don’t they?) so if these people with alternative

    beliefs choose not to pursue legitimizing them within everyone else’s rules, they’re either deluded or ignorant.

    And I don’t mean “ignorant” as a value judgement; it’s much the same as my daughter asserts, “Ew! I don’t like sushi!” before she’s ever tried a piece. And if she had tried a piece, she can’t claim that she definitively and categorically does not like sushi; sushi isn’t all raw fish. It does refer to the vinegared rice that is sometimes topped with fish, but there are many types of sushi that have no fish at all in them.

    They’re deluded if they believe that people are even responsible if they adopt as theory what anyone has derived without a methodology and analysis open for review. They’re ignorant if they think they can reject traditional theory without first demonstrating an actual mastery of it.

    Amazon’s Kindling 2 for Poor Research Habits in the New Generation of Young Researchers

    This entry is part 1 of 2 in the series Scholarly Research

    When I began work on my honours thesis in receptor-ligand kinetics during my biology and biotechnology degree, in 1998, electronic journals were not on the minds of legitimate mainstream research scientists.  At the time, Carleton University introduced an extremely-beneficial agreement it had reached with the National Research Council to allow fourth year honours students working on their theses access to the NRC CISTI Library Stacks–as a government agency, the NRC CISTI library did provide services to the public, but the actual stacks were out of bounds, public patrons could only access the extensive resources in their East Ottawa library

    004

    facilities by submitting reference lists on paper and waiting for library staff to retrieve them.  As fourth year honours thesis students, we benefitted from the more intimate time we got to spend with the references, and the ability to follow the chain of research articles much faster.  Remember, this was all during a time when there was no way to conduct research comprehensively in one pass;

    you simply had to look up a set of initial promising-looking references, find only about 75% of them are in the library collection to begin with, and a further 25% are misplaced, out for binding, or waiting to be returned from the photocopy room.  And even then, you had very little idea whether those articles were of any value at all until you actually read them.  Only then, could you begin to make a second generation of references to look for, based on that first pass.

    Normal research papers would take several passes of this process, and although the library was open every night until 23h (Walden University’s Librarians still provide personalized research reference services by telephone and email until 1am!).  This is one aspect of the rigorous research process that consumed the lion’s share of time it took to conduct research, and emphasized in us as developing researchers, the importance of the iterative critical evaluation process.

    The young students nowadays probably can’t even conceive of what tremendous effort this research process necessarily was, and that you couldn’t rush journals to come back from the bindery or being located misplaced on shelves.  Today’s generation of young students has not only the belief, but the expectation, that an entire legitimately-researched and supported scholarly paper can be–indeed, many of them even believe that it should be–researched defensibly in one pass.  Although databases like ProQuest, LexisNexis, and ScienceDirect do indeed facilitate and vastly improve research productivity.  But the new generation of computer-based journal databases and their reliance on keyword searches and abstracts undermines the significantly-more valid critical process of evaluating references for their actual findings and content before dismissing a reference, considering it further, or determining what articles to follow next in the chain.  I encourage Interested students to visit the following resources to on literature surveys and research skills:

    Research Resources

     
     

    Dear Robin Cheung,

    Thank you for taking part in our eBook survey at the Springer booth at Academy of Management 2010 in Montreal.kindle 2

    Your feedback was a valuable source in getting more information about the experiences with eBooks our readers already have. I am happy to announce that you are the winner of the Kindle 2. Congratulations!

    Please inform us about your shipping address so we can send it to you.

    You then will receive the Kindle within the next few weeks by mail. Enjoy reading Springer eBbooks and eJournals! More than 20.000 Springer eBooks are available in Kindle format at Amazon. Please make also sure you will have access to our eProducts through your library. You and your librarian can find more information here: http://www.springer.com/librarians/e-content/ebooks?SGWID=0-40791-0-0-0

    Best regards,

    Margit Dann, Springer Product Manager

    Sony E-ReaderAfter I had tried, for a few months, to use Sony’s PRS-505 eBook reader, the frustration of being unable to highlight research or add marginalia meant I was still printing out research and annotating by hand; the eBook reader’s ability to bring around myriad research papers to read whilst out of the home or office is entirely eclipsed by the inability to highlight or even recall later which reference had the interesting bit of information you wanted to remember.

    But the Amazon Kindle 2, which has wireless support here in Canada, does support highlighting, though by a slightly-annoying five-direction “joystick” that you can really only reliably manipulate by reoriented the edge of a fingernail to catch on. And it does have a keyboard, though the linear layout is quite uncomfortable to type much more than a few words, unlike the curved keyboard of the original 1990s Blackberries.

    All that remains now is for Mendeley to improve the core paradigm that it based its schema on, and someone to leverage the open API access they recently launched and write a value-added application to let us accomplish more than just reading and annotating on Kindle, but then due to the Kindle’s non-support of native PDF, manually re-annotating on Mendeley, where we might eventually be managing both the PDF and the citation. And for journal publishers, like Springer, to facilitate adoption of these devices into the research workflow; they allow much more ready-access, portability, and confidence in citations–everything that is research.

    The Kindle provides a way for established researchers to improve portability, availability, and accountability by facilitating the migration to electronic journals.  In my bachelors honours thesis days, I could legitimately get away with photocopying all the journal articles that supported my research (the rule of thumb most professors expected was approximately one scholarly reference cited directly for each  page your paper was in length), since I might have one or two 30-page (article-length) papers for a whole term, and only one thesis around 100 pages in length.  I could easily handle annotating in the margins by hand, putting a phrase or two in big letters on the first page of each so I could find each reference at a glance, and filed in file boxes.

    When I began working on my PhD, I began to find that my old system was too inefficient. It was simply taking too much time and to try to locate a single reference that I needed to support a single fact I needed to assert.  Even worse: when I tried to find a reference from which to synthesize and deduce a specific application of theory, requiring more than one paper to support and qualify restrictions on applicability, it become virtually impossible to locate all the references in a reasonable amount of time.  And managing the mountain of file-boxes in my spartan accommodations was more than my meagre Toronto basement rental could accommodate.

    (I think people have a bit of a misconception of what a doctorate is intended to do and what it involves.  Writing doctoral-level papers does not simply mean more complex; in fact, complexity is not a requirement for doctoral work–it’s more a symptom.  Doctoral work must be appropriately-specific so that a reasonable-length 200-page dissertation can be authoritative and comprehensive, but stay within scope. Doctoral work, in start opposition to my MBA work, requires not only every assertion you make to be supported with reliable references, but that you demonstrate that your assertion is supported by all relevant accepted theory. So when people believe that doctoral level work is simply the same as bachelors, undergraduate work, that is simply not the case.  Whilst your Bachelors degree aims to develop higher order reasoning with a certain known introduction to a body of knowledge, to earn a doctorate, candidates must develop rigorous research skills, develop rigorous scholarly reasoning to ensure research is maximally-valid, and apply research to produce a dissertation that must demonstrate a significant, scientifically-valid contribution to humanity’s body of knowledge that was not shown before.)

    .

    Lies, D*mn Lies, and Statistics Canada II: Internet Privacy & Security

    With Statistics Canada having been criticized in the news recently, it’s good to see some of the real applications that impact Canadian businesses and lives, such as the Canadian Internet Use Survey.  But I think practitioners–and the general public–still aren’t quite fulfilling “due diligence” in either citing the Statistics Canada information or in how they perceive and interpret it.  Even following Statistics Canada’s own perfectly-correct guidelines about whom the results do and do not represent or whether a significant correlation can or cannot imply causation, the data may still not be giving the answers we think they are.

    Statistics Canada’s Canadian Internet Use Survey is often cited by public interest groups, not-for-profit organizations, and marketers to support all manner of opinions.  What I am mostly concerned about this time is the portion of it concerning Internet Privacy and Security concerns.

    Although the mere five questions with only three possible levels of concern (None at all, Concerned, or Very concerned) may have been sufficient to determine that Privacy and Security is one of Canadians’ leading concerns, we know consider Privacy and Security a top concern.  Five questions with only three levels of concern is no longer responsibly-adequate to be meaningful.  (I am mostly-facetious when I propose that the number of Canadians actually concerned was severely overstated because anyone that wasn’t oblivious or reckless was considered at least “Concerned” in the first place).  Knowing how important Privacy and Security is, and knowing how often-cited those statistics are,  I think the Stats Can survey is doing a disservice to Canadians, their concerns, and the businesses that benefit from it.

    For example, if people take the time to examine the actual survey questions pertaining to Privacy and Security http://www.statcan.gc.ca/imdb-bmdi/instrument/4432_Q1_V8-eng.htm#a10

    Section: Privacy and security (PS)

    PS_BEG
    Beginning of Section

    PS_R01
    The next set of questions relate to privacy and security concerns on the Internet.

    PS_Q01
    In general, how concerned (are you/would you be) about privacy on the Internet? For example, people finding out what websites you have visited, others reading your e-mail?

    Interviewer: Read categories to respondent.

    1. Not at all concerned
    2. Concerned
    3. Very concerned
      DK, RF

    Coverage: All respondents

    PS_Q02
    How concerned (are you/would you be) about conducting banking transactions over the Internet?

    Interviewer: Read categories to respondent.

    1. Not at all concerned
    2. Concerned
    3. Very concerned
      DK, RF

    Coverage: All respondents

    PS_Q03
    How concerned (are you/would you be) about using your credit card over the Internet?

    Interviewer: Read categories to respondent.

    1. Not at all concerned
    2. Concerned
    3. Very concerned
      DK, RF

    Coverage: All respondents

    PS_Q04
    How concerned (are you/would you be) about providing personal financial information to government departments over the Internet? (e.g., applying for employment insurance or a student loan?)

    Interviewer: Read categories to respondent.

    1. Not at all concerned
    2. Concerned
    3. Very concerned
      DK, RF

    Coverage:  All respondents

    PS_Q05
    How concerned (are you/would you be) about giving personal, non financial information to a government official in Canada over the Internet?

    Interviewer: Read categories to respondent.

    1. Not at all concerned
    2. Concerned
    3. Very concerned
      DK, RF

    Coverage: All respondents

    PS_END
    End of Section

    they will note that there are a total of five questions. Those who have taken statistics will recognize that the meaningful options of “Not at all concerned,” “Concerned,” and “Very concerned” imply ordinal data (there is a consistent directionality in the variables).

    Those of you who have taken some survey and research design might be concerned, however, that the “centre” choice (sometimes questionnaire-designers purposely give an even number of choices to avoid a dead centre choice) does not at all imply middle of the road. In fact, if a respondent is not absolutely free of concern about privacy (ie. reckless), then any other choice will enumerate them amongst the concerned. There are many of us who have “appropriate” caution when we conduct business online (ie. would not describe ourselves as either apathetic or reckless) but are also would not consciously be concerned about privacy and security under normal conditions (ie. would not describe ourselves as neurotic or paranoid).

    Vote for Robin in the 2010 CIRA Board Elections!

    The 2008-2009 CIRA Annual Report demonstrates how significantly these data have impacted CIRA’s initiatives, ranging from DNSSEC to BIND10 to WHOIS privacy http://www.cira.ca/annual-reports/2009/en/c_dns_03_en.html. But the primary survey to be cited employs only five questions that will inherently bias responses towards overestimating the amount and degree of concern Canadians have because of its pecular scale.

    Highly-qualified statisticians and researchers at Statistics Canada go to a lot of trouble trying fastidiously to apply accepted theory in questionnaire, survey, and sampling design according to traditional principles of maximizing face validity, content validity, criterion validity, Likert scale best practices, stratified random sampling, and making sure that the report reflects accurate interpretation under the correct circumstances in the proper contexts.

    But used out of context or with varying lower degrees of external validity (generalizability), all that effort can be wasted–or worse, reinforce the popular notion that statistics are somehow worse than both lies and d*mn lies http://robincheung.info/mbalog/2010/07/21/lies-dmn-lies-and-statistics-statistics-is-actually-your-friend-when-not-misused/

    This time, I’m not blaming people for using statistics out of context to support their arguments; I’m suggesting that Statistics Canada should amend the survey.

    There is a mechanism for interested businesses, individuals, and Statistics Canada to understand each other and develop surveys that are more meaningful and accurate, by the way.  This October 26 to 29, 2010, Statistics Canada is hosting the 2010 International Methodology Symposium in Ottawa, ON.   If you can’t make it to that event, Statistics Canada maintains a web site about its training, conferences, and research events: http://www.statcan.gc.ca/services/workshop-atelier-eng.htm

    Research Design 102 Redesigning a Better CIRA survey

    Yvon, selon le commissariat aux langues officielles, ni CIRA ni les programmes fédéraux n'oublige qu'il ait besoin évident: http://www.ocol-clo.gc.ca/html/faq2_f.php#q4

    The following post was actually primarily a response to "Canadian Public Interest in Internet Policy and Decision Making" sent by CIRA in October, 2009. If it were a one-off survey conceived by someone at CIRA whose responsibility never before included surveys or questionnaire design, I could overlook the survey as a meaningless make-work project; however, the intent to find something out does seem genuine.

    And something as fundamental as the apparent intent of the survey to identify what issues concerned CIRA most and the apparently desire to understand more about these important issues from the consistent use of open-ended questions seems worth, if not hiring a marketing research consultant to design and execute the research, any researchers on the Board might be able to improve survey questions and internal validity, even if their specialization was not at all a social science.

    As a Canadian actively online since the late 80s I chose to participate in this year's CIRA board election because of my keen desire to make meaningful contributions that may not be voiced on their own or informed by my holistic understanding of the social, technological, and commercial factors that sometimes supports outcomes not anticipated by when considering them individually.

    Although I am confident the board would comprise individuals with stronger competencies than me in isolation, it was this unique understanding of the factors in combination that led me to launch a public online service to provide rudimentary international file- and echo-dissemination services using pre-Internet technologies to what was as clearly an eventuality as wireless data when I first adopted it in 1994. Social media stands poised to change the site-centric paradigm that even predated the Web in Gopher and even Archie extended but could not transcend. In much the same way, Mendeley is within reach to apply social media to change the rules of scientific research from one that reinforces scholarliness over prestige when it presents functionality that actually facilitates researchers' workflows and by design removes the practical limitation of knowing what every researcher in the world may have considered relevant to your own research that has legitimized Impact Factor (how often a journal is cited) as an indicator of quality of research.

    I emphasize the role social media will play in the parallel evolution of the Internet and research theory and design because it was the qualitative survey instrument featured above that at once caught my attention and concerned me. Having experience in both applied (marketing research) and scientific (ethnography, phenomenology, typography, and others) qualititative research–even qualitative research designed to inform subsequent quantitative research (sequential exploratory mixed methods). But I believe strongly that the research questions the survey attempts to investigate, along with the questions themselves were representative of the poor understanding even post-doctoral researchers often have of the nascent discipline of qualitative research.

    The biggest concern I have about the survey–and I expect any academic institution's Internal Review Board that must approve any research that involves human subjects–is that it both unloads the researcher's lack of clear research direction onto the respondents by expecting them to compensate for an arbitrary "fishing expedition" research design with no hope to probe any specific concerns (phenomenology) or give any meaningful insight into attitudes, concerns, behaviours, or perceptions CIRA members have (ethnography).

    Although concept mapping software designed to facilitate coding and interpretation of open-ended qualitative lines of questioning continue to evolve along with qualitative research as a discipline, it cannot turn a poor research design into a good one. Qualitative research is not merely the incorporation of non-numerical data into other-wise quantitative research projects. Qualitative research is appropriate to answer entirely-different research questions with entirely different objectives to quantitative. Open-ended questioning allowing respondents to answer using whatever words they feel appropriate, with as much detail as they please, both allows researchers to adjust questions dynamically and probe interesting responses.

    Thus, qualitative research does not aim to determine whether a theory governs a behaviour or phenomenon, which is the domain of quantitative research of various designs that test specific hypotheses that a theory predicts using deductive reasoning. Instead, when it is intended to inform theory construction, it is generally the abstraction of a theory from observations via inductive reasoning (such as Grounded Theory)–the precise opposite of quantitative research.

    Qualitative research that does not aim to abstract a theory from observations, such as ethnographic or phenomenologic research, is not at all interested in answering the question of whether a behaviour or phenomenon is representative of anything at all, but rather simply to explore the behaviour or phenomenon.

    One of Walden University's strengths, however, is its unique presentation of research theory and design as a logical workflow to provide context to select not only *an* appropriate research design for a given research question, but *the* most appropriate design for *the* most appropriate research question to ask.

    This necessarily means beginning every inquiry considering the epistemological and ontological foundations of the research in the first place. As I point out in a LinkedIn discussion response to Rick Anderson's two points asserting the importance of Canadian presence to .ca domain eligibility (in reality, one point and one rationale supporting it), although technological minds are well-prepared to come up with all sorts of innovative mousetraps: spring-loaded ones, biodegradable ones, fashionable ones, low-cost ones, decorative ones, ultrasonic ones, chemical ones–and many more than I would conceive.

    But sometimes going back to defining the real underlying question might change the research question from "What is the best mousetrap for our strategic positioning and target market?" entirely to "Is there an easily-repaired hole allowing mice into the house?"

    Without indulging the scenario, the first research question can be an extremely involved one, beginning with marketing research to characterize the target market segment that is characterized by shared buying preference but may transcend traditional demographic or psychographic categories. These characteristics can be reduced to a smaller set of more meaningful attributes using principal components analysis and then fed into a conjoint analysis model that would build "the perfect mousetrap" from the ground up with the most desirable combination of attributes identified by the marketing research and validated with expensive focus groups before investing even more money on a prototype and market testing.

    As presented, the CIRA survey attempts to determine what issues CIRA members consider important (a research question appropriate for a quantitative survey, such as rating or ranking on a set Likert scale) but allowing respondents the possibility to disqualify their responses with unclear or non-applicable responses and maximizing the validating, coding, and interpreting workload required to yield only limited insight–future qualitative research topics to probe, at best. Because I know that not everyone is interested in knowing any more than that [in their entire lives] about research design, but I have committed myself to the continued effort to help professionals and practitioners understand that many academic theories were derived from real-life stock prices and sometimes "too theoretical" is an excuse to avoid thinking; to show academics the real-life application and context for the theories they work hard to to generalize; and for the general public who feels neither academics nor executives consider them important enough to take a moment and explain anything not to think corporations are only set on exploiting them (without doing it by giving them what they want) or that academics purposely make theory incomprehensible to keep it from the masses, when in fact, the reason theory construction and scientific inquiry works the way they do, I believe would become clear to anyone who invests the time and effort to develop more structured, disciplined reasoning.

    Walden should encourage its students to present their research: My impressions of AOM 2010 so far

    I’m currently in the second last day of the Academy of Management 2010 annual meeting in Montréal

    http://annualmeeting.aomonline.org/2010/ , with over 8,000 primarily academics.

    This afternoon I had the opportunity to sit in on four paper presentations, two of which I had the opportunity to review and critique earlier this year as part

    of the blinded review process. Being able to

    interact with scholars from other institutions and evaluate their research increasingly shows me that whilst Walden’s quantitative requirements are probably less than most PhD programmes’, that their introduction to research theory and design in their newly-redesigned 8008 Foundations, RSCH 8100, and RSCH 8200 that I have completed so far, really allow us to make sure we’re asking the right questions when we get to the micro level.

    AOM2010

    Academy of Management Annual Meeting 2010

    [img src=http://robincheung.info/mbalog/wp-content/flagallery/aom2010/thumbs/thumbs_AOM2010Montreal 001 (1024x768).jpg]
    <b>Meta Data</b><br><b>Image Width</b> 1024<br><b>Image Height</b> 768<br><br> <b>Meta Data</b><br><b>Image Width</b> 1024<br><b>Image Height</b> 768<br>
    [img src=http://robincheung.info/mbalog/wp-content/flagallery/aom2010/thumbs/thumbs_AOM2010Montreal 002 (1024x768).jpg]
    <b>Meta Data</b><br><b>Image Width</b> 1024<br><b>Image Height</b> 768<br><br> <b>Meta Data</b><br><b>Image Width</b> 1024<br><b>Image Height</b> 768<br>
    [img src=http://robincheung.info/mbalog/wp-content/flagallery/aom2010/thumbs/thumbs_AOM2010Montreal 003 (768x1024).jpg]
    <b>Meta Data</b><br><b>Image Width</b> 768<br><b>Image Height</b> 1024<br><br> <b>Meta Data</b><br><b>Image Width</b> 768<br><b>Image Height</b> 1024<br>
    [img src=http://robincheung.info/mbalog/wp-content/flagallery/aom2010/thumbs/thumbs_AOM2010Montreal 004 (1024x768).jpg]
    <b>Meta Data</b><br><b>Image Width</b> 1024<br><b>Image Height</b> 768<br><br> <b>Meta Data</b><br><b>Image Width</b> 1024<br><b>Image Height</b> 768<br>
    [img src=http://robincheung.info/mbalog/wp-content/flagallery/aom2010/thumbs/thumbs_AOM2010Montreal 005 (1024x768).jpg]
    <b>Meta Data</b><br><b>Image Width</b> 1024<br><b>Image Height</b> 768<br><br> <b>Meta Data</b><br><b>Image Width</b> 1024<br><b>Image Height</b> 768<br>
    [img src=http://robincheung.info/mbalog/wp-content/flagallery/aom2010/thumbs/thumbs_AOM2010Montreal 006 (1024x768).jpg]
    <b>Meta Data</b><br><b>Image Width</b> 1024<br><b>Image Height</b> 768<br><br> <b>Meta Data</b><br><b>Image Width</b> 1024<br><b>Image Height</b> 768<br>
    [img src=http://robincheung.info/mbalog/wp-content/flagallery/aom2010/thumbs/thumbs_aomlogo (200x55).jpg]
    <b>Meta Data</b><br><b>Image Width</b> 200<br><b>Image Height</b> 55<br><br> <b>Meta Data</b><br><b>Image Width</b> 200<br><b>Image Height</b> 55<br>
    [img src=http://robincheung.info/mbalog/wp-content/flagallery/aom2010/thumbs/thumbs_daretocarelogo (143x100).jpg]
    <b>Meta Data</b><br><b>Image Width</b> 143<br><b>Image Height</b> 100<br><br> <b>Meta Data</b><br><b>Image Width</b> 143<br><b>Image Height</b> 100<br>
    [img src=http://robincheung.info/mbalog/wp-content/flagallery/aom2010/thumbs/thumbs_montreal-skyline (450x338).jpg]
    <b>Meta Data</b><br><b>Image Width</b> 450<br><b>Image Height</b> 338<br><br> <b>Meta Data</b><br><b>Image Width</b> 450<br><b>Image Height</b> 338<br>
    [img src=http://robincheung.info/mbalog/wp-content/flagallery/aom2010/thumbs/thumbs_n124705204222282_3177 (200x186).jpg]
    <b>Meta Data</b><br><b>Image Width</b> 200<br><b>Image Height</b> 186<br><br> <b>Meta Data</b><br><b>Image Width</b> 200<br><b>Image Height</b> 186<br>

    This afternoon, one of the questions posed to a presenter who is a PhD student and faculty-member at the University of Maryland, was about the epistemological foundations of his definition of “aggressiveness” in terms of competitive signalling (the four papers were themed on competitive signalling in the Business Policy and Strategy division), and he could not answer the question. Walden’s systematic approach to research design necessarily would have addressed the fundamental epistemological and ontological issues as a matter of necessity in refining the right research questions and selecting the right research designs and methodologies and analyses to address them with the most validity as well as remaining cognizant of social relevance–not forgetting why we’re doing any of this in the first place. Walden’s Scholar-Practitioner model tries to keep this issue front and centre, but must therefore caution that much more that academia cannot compromise on theory construction and compromise internal or external validity to encourage practitioners to see the value in theory and expend effort to adapt it rather than eschew theory altogether. I feel that much of the time that practitioners claim that theory has no value in the real world and dismiss it, they do not know the theory in the first place; just as I did not feel right asserting how much I didn’t like LOST until I’d watched the entire series, I don’t feel that rejecting a theory without first demonstrating some mastery of it and a true willingness to adopt it if you later find value in it, is an informed decision.

    Although I feel that abstracting a general theory from empirical data is already meeting practitioners halfway (and that to claim that they cannot apply theory–which was derived from data from the real world in the first place–and expect academics then to deduce back for them a specific application, when they are the ones getting paid the big bucks too, is to ask to meet us 3/4 of the way), sometimes academics do forget why we are doing any of this in the first place.

    This experience has also reinforced my belief that Walden should encourage its doctoral students much more strongly to participate and present their research at events such as these, not only for the benefit of the students’ academic careers, but to showcase these strengths Walden has and mitigate the uphill aspect of the battle to legitimize Walden despite the bad reputation of diploma mills that already handicap us ceteris paribus.  I wanted to note also that only Qiang Li’s presentation alluded that different cultures may also differentially reflect and value signalling behaviours.  In spite of the Academy of Management claiming a 43% non-US membership at last night’s New Member Orientation, I still feel that many American researchers tend to portray an ethnocentric approach to research, not by claiming that Western attitudes and values are the best or even that their research only considers that specific case (external validity, in research design terminology), but simply seems naive of any other views or value systems.

    The listing for this afternoon’s BPS division paper presentations was as follows:

    Paper Session
    Program Session #: 804 | Submission: 18163 | Sponsor(s): (BPS)
    Scheduled: Monday, Aug 9 2010 11:30AM – 1:00PM at Le Palais Des Congres in 513D

    Competitive Signaling
    Competitive Signaling

    View Map
    Chair: Dorota Piaskowska; U. College Dublin; 


    BPS: The Role of Competition and Incentives in Rating Markets
    Author: Paul Seaborn; U. of Toronto; In this paper I examine rating agencies, organizations that assign ratings to products based on an evaluation of product characteristics. I focus on rating markets with inter-agency competition and examine the role that a rating agency’s source of revenue has on their rating activity. I conduct my empirical evaluation in the US credit/bond rating market where some agencies derive their primary revenue from sellers (bond issuers) while others are paid by buyers (institutional investors) via subscription. Using a series of model specifications I quantify the importance of this revenue source as well as competitor actions on agency decisions of “who to rate” and “how to rate”. While I find that revenue source matters, so does market power, resulting in three distinct groups of competitors – issuer-paid market leaders (S&P and Moody’s), issuer-paid challengers and subscriber-paid challengers. I demonstrate how each group responds differently to the rating activities of competitors. The results of my research are relevant to both firm strategy and public policy in a variety of settings where information disclosure between sellers and buyers takes place.

    Search Terms: Incentives , Rating , Agency

    Paper is NOT Available: Please contact the author(s).


    BPS: Threat of Entry, Asymmetric Information and Pricing
    Author: Robert C. Seamans; New York U.; Empirical research on incumbent pricing response to entry has provided mixed results. Limit pricing theory shows that the use of low price to deter entry is an equilibrium strategy only when there are information asymmetries. Prior empirical studies have neglected the importance of asymmetric information when the incumbent determines its strategic response. I argue that variation in asymmetric information between the potential entrant and incumbent allow for identification of the incumbent’s use of limit pricing; limit pricing should only be used when there exist high levels of asymmetric information, not low levels of asymmetric information. I study a market, the US cable TV industry, in which the incumbent interacts with two types of potential entrants: telecom overbuilders and cable overbuilders. There are information asymmetries between the incumbent and potential telecom entrant, but fewer information asymmetries between the incumbent and potential cable entrant. As predicted by limit pricing theory, I find evidence that the incumbent firm uses low price when telecom overbuilders threaten entry, but not when cable overbuilders entry. Evidence of entry deterrence comes from non-monotonic price changes in response to changes in entry probability.

    Search Terms: entry , pricing , information

    Paper is NOT Available: Please contact the author(s).


    BPS: Do Signals Matter in Competition? The Relationship Between Signals and Reaction Intensity
    Author: Qiang Li; U. of Maryland – College Park; There have been lots of studies examining the effect of competitive actions on responses. Such studies help predict competitive responses from competitors when a firm initiates competitive actions. Observing the reality, what we find more frequently is competitive signals instead of real competitive actions. Do these signals matter in competition? This is the question this study attempts to answer. This study theorizes the relationship between competitive signals and competitive responses. Due to the time-consuming nature, data collection of this study is still in progress but according to the pace of data collection, we should be able to provide all the results by AOM conference in Montreal, Canada.

    Search Terms: signal , competition

    Paper is NOT Available: Please contact the author(s).


    BPS: Reputation, Altruism, and the Benefits of Seller Charity in an Online Marketplace
    Author: Daniel Walter Elfenbein; Washington U. in St. Louis; 
    Author: Raymond Fisman; Columbia U.; 
    Author: Brian McManus; U. of North Carolina, Chapel Hill; We analyze “natural experiments” on eBay where sellers offer identical products with and without charity donations. Charity-linked products are more likely to sell and attract higher prices. These benefits accrue primarily to sellers without extensive eBay histories, suggesting that consumers view charity as a signal of seller quality and a substitute for reputation. We do not find evidence that bundling products with charitable contributions is directly profitable.

    Search Terms: social responsibility , corporate philanthropy , reputation

    Paper is Available: View/Download

    Citing Discussions and Personal Communications in Scholarly Discourse in APA Style

    I contributed the following to the Walden University Writing Centre Facebook Discussion in response to a question pertaining to citing personal communications.  Even if you’re not a Walden University doctoral student, you can appreciate how the Foundations course (first course in all Walden doctoral programmes), RSCH 8100 (introductory Research Theory and Design course), and RSCH 8200 (continuation of research design, aligning quantitative designs with appropriate statistical analyses) develop and refine our academic writing skills.

    During the initial three months of Foundations, we struggle to find our academic voice, support arguments with scholarly material, and cite it appropriately.  During the second three months, in RSCH 8100,

    One thing that I found is that during Foundations, everyone is trying to find their–and their prof’s–comfort zones when it comes to citing personal communications or discussion posts. After Foundations, RSCH 8100, and RSCH 8200 discussions, I found that–perhaps due to the awkward URLs for eCollege posts or focusing more on developing the ideas in a response rather than quoting what material the response refers to–actual discussion post and “personal communications” citations were much more infrequent after nine months of posts and responses. (I still believe that more common discussion forum scripts, such as phpBB or vBulletin–which preserve font and formatting codes–would have facilitated learning and applying APA. Being able to format headers, block quotations, reference lists, and bold/italics would have reinforced their appropriate use.) Just to give you an idea of how awkward some Foundations discussion posts were, here’s a quote from an AMDS 8008 post in October, 2009:

    The KAM’s could provide the basis of what the student will like to use on the dissertation but since the dissertation is at least 3 years from now how do you know that the theme is still relevant or even if it still your area of interest (Korrapati, 2009). According to Dr. Korrapati (2009), the KAM will allow you to grow and find what is really what will be your research interest. Reference: Korrapati, R. (2009). Walden residency personal consultation. Jacksonville, Fl.

    Progressing through RSCH 8100 (Winter, 2010), I suspect that the same post would instead have presented a reference from our research design text (Creswell, in 8100; Frankfort-Nachmias & Nachmias–arguably a more useful text once the introductory material is out of the way, in 8200):

    Gagnon, Jansen, and Michael (2008) begin their article with a survey of previous research and use these findings, Creswell (2009) suggests, to propose a series of hypotheses: “Use the literature in a quantitative study deductively, as a basis for advancing research questions or hypotheses.” Whereas qualitative designs often use open-ended techniques to collect data to identify emergent themes, this study proposed a priori hypotheses, appropriate variables to test and model them, and structured surveys to collect these data.

    By RSCH 8200 (Spring, 2010), I had become more comfortable simply asserting my interpretation of a concept without relying on direct quotations, supported by citation:

    In cases of such extremely disparate distributions, even minimum sample sizes for valid analyses may not even exist; thus, disproportionate stratified sampling is occasionally the most appropriate sampling method (Chakrapani & Deal, 1992).

    References

    Chakrapani, C., & Deal, K. (1992). Marketing Research: Methods and Canadian Practice. Scarborough, ON: Prentice-Hall Canada, Inc.

    Creswell, J. W. (2009). Research Design: Qualitative, Quantitative, and Mixed Methods Approaches, 3rd Edition.Los Angeles: . Sage Publications/MBS, 082008.

    Gagnon, M. A., Jansen, K. J., & Michael, J. H. (2008). Employee alignment with strategic change: A study of strategy-supportive behaviour among blue-collar employees. Journal of Managerial Issues. XX(4): 425-43.