Using Internet Data for Economic Research

Edelman, Benjamin. “Using Internet Data for Economic Research.” Journal of Economic Perspectives 26, no. 2 (Spring 2012): 189-206.

The data used by economists can be broadly divided into two categories. First, structured datasets arise when a government agency, trade association, or company can justify the expense of assembling records. The Internet has transformed how economists interact with these datasets by lowering the cost of storing, updating, distributing, finding, and retrieving this information. Second, some economic researchers affirmatively collect data of interest. Historically, assembling a dataset might involve delving through annual reports or archives that had not previously been organized into a format ready for research: in some cases, surveying stores, factories, consumers, or workers, or in other cases, carrying out an experiment. For researcher-collected data, the Internet opens exceptional possibilities both by increasing the amount of information available for researchers to gather and by lowering researchers’ costs of collecting information. In this paper, I explore the Internet’s new datasets, present methods for harnessing their wealth, and survey a sampling of the research questions these data help to answer.

Advertising Disclosures: Measuring Labeling Alternatives in Internet Search Engines

Edelman, Benjamin, and Duncan S. Gilchrist. “Advertising Disclosures: Measuring Labeling Alternatives in Internet Search Engines.” Information Economics and Policy 24, no. 1 (March 2012): 75-89.

In an online experiment, we measure users’ interactions with search engines, both in standard configurations and in modified versions with clearer labels identifying search engine advertisements. In particular, for a random subset of users, we change “Sponsored links” or “Ads” labels to instead read “Paid Advertisements.” Relative to users receiving the “Sponsored link” or “Ad” labels, users receiving the “Paid Advertisement” label click 25% and 27% fewer advertisements, respectively. Users seeing “Paid Advertisement” labels also correctly report that they click fewer advertisements, controlling for the number of advertisements they actually click. Results are most pronounced for commercial searches and for vulnerable users with low education and little online experience.

Adverse Selection in Online ‘Trust’ Certifications and Search Results

Edelman, Benjamin. “Adverse Selection in Online ‘Trust’ Certifications and Search Results.” Electronic Commerce Research and Applications 10, no. 1 (January-February 2011): 17-25.

Widely used online “trust” authorities issue certifications without substantial verification of recipients’ actual trustworthiness. This lax approach gives rise to adverse selection: the sites that seek and obtain trust certifications are actually less trustworthy than others. Using an original dataset on web site safety, I demonstrate that sites certified by the best-known authority, TRUSTe, are more than twice as likely to be untrustworthy as uncertified sites. This difference remains statistically and economically significant when restricted to “complex” commercial sites. Meanwhile, search engines create an implied endorsement in their selection of ads for display, but I show that search engine advertisements tend to be less safe than the corresponding organic listings.

Least-Cost Avoiders in Online Fraud and Abuse

Edelman, Benjamin. “Least-Cost Avoiders in Online Fraud and Abuse.” IEEE Security & Privacy 8, no. 4 (July-August 2010): 78-81.

Web users face considerable fraud, malfeasance, and economic harm that system operators could prevent or mitigate. Although the legal system can respond, regulations have mixed results. I examine the applicable legal rules that constrain online fraud and the economic underpinnings to identify whether those rules assign responsibility to the parties best positioned to take action.

Optimal Auction Design and Equilibrium Selection in Sponsored Search Auctions

Edelman, Benjamin, and Michael Schwarz. “Optimal Auction Design and Equilibrium Selection in Sponsored Search Auctions.” American Economic Review 100, no. 2 (May 2010): 597-602. (First circulated in 2006 as Optimal Auction Design in a Multi-unit Environment: The Case of Sponsored Search Auctions. Reprinted in The Economics of E-Commerce, Michael Baye and John Morgan, editors, 2016.)

We characterize the optimal (revenue maximizing) auction for sponsored search advertising. We show that a search engine’s optimal reserve price is independent of the number of bidders and independent of the rate at which click-through rate declines over positions. We separate the effects of reserve price increases into direct effects (on the low bidder) and indirect effects (on others), and we show that most of the incremental revenue from setting reserve price optimally comes from indirect effects.

Red Light States: Who Buys Online Adult Entertainment?

Edelman, Benjamin. “Red Light States: Who Buys Online Adult Entertainment?” Journal of Economic Perspectives 23, no. 1 (Winter 2009): 209-220.

This paper studies the adult online entertainment industry, particularly the consumption side of the market. In particular, it focuses on the demographics and consumption patterns of those who subscribe to adult entertainment websites. On the surface, this business would seem to face a number of obstacles. Regulatory and legal barriers have already been mentioned. In addition, those charging for access to adult entertainment face competition from similar content available without a fee. In the context of adult entertainment, free access offers consumers an extra benefit: online payments tend to create records documenting the fact of a customer’s purchase; consumers of free content may feel more confident that their purchases will remain confidential. More broadly, measured levels of religiosity in America are high. On the other hand, social critics often argue that the rise of Internet pornography is contributing to a coarsening of American culture. Do consumption patterns of online adult entertainment reveal two separate Americas? Or is the consumption of online adult entertainment widespread, regardless of legal barriers, potential for embarrassment, and even religious conviction?

Deterring Online Advertising Fraud Through Optimal Payment in Arrears

Edelman, Benjamin. “Deterring Online Advertising Fraud Through Optimal Payment in Arrears.” Financial Cryptography and Data Security: Proceedings of the International Conference (September 2009). (Springer-Verlag Lecture Notes in Computer Science.) (Featured in Working Knowledge: Reducing Risk with Online Advertising.)

Online advertisers face substantial difficulty in selecting and supervising small advertising partners. Fraud can be well hidden, and limited reputation systems reduce accountability. But partners are not paid until after their work is complete, and advertisers can extend this delay both to improve detection of improper partner practices and to punish partners who turn out to be rule-breakers. I capture these relationships in a screening model with delayed payments and probabilistic delayed observation of agents’ types. I derive conditions in which an advertising principal can set its payment delay to deter rogue agents and to attract solely or primarily good-type agents. Through the savings from excluding rogue agents, the principal can increase its profits while offering increased payments to good-type agents. I estimate that a leading affiliate network could have invoked an optimal payment delay to eliminate 71% of fraud without decreasing profit.

Priced and Unpriced Online Markets

Edelman, Benjamin. “Priced and Unpriced Online Markets.” Journal of Economic Perspectives 23, no. 3 (Summer 2009): 21-36.

With forces both supporting and opposing zero prices, typical Internet-related activities–like surfing the web, web searches, and e-mail, along with behind-the-scenes practices like domain names and the allocation of IP (Internet Protocol) addresses–present a natural context to reevaluate our sense of the tradeoffs that arise between free and a positive price. In this piece, I offer a series of specific examples of resources offered without charge, for a positive price, or for a flat fee (“all-you-can-eat”). I conclude by assessing the characteristics that shape pricing structure for these resources.

Adverse Selection in Online ‘Trust’ Certifications

Edelman, Benjamin. “Adverse Selection in Online ‘Trust’ Certifications.” Proceedings of the International Conference on Electronic Commerce (2009): 205-212. (ACM International Conference Proceeding Series.)

Widely used online “trust” authorities issue certifications without substantial verification of recipients’ actual trustworthiness. This lax approach gives rise to adverse selection: the sites that seek and obtain trust certifications are actually less trustworthy than others. Using a new dataset on web site safety, I demonstrate that sites certified by the best-known authority, TRUSTe, are more than twice as likely to be untrustworthy as uncertified sites. This difference remains statistically and economically significant when restricted to “complex” commercial sites. In contrast, competing certification system BBBOnline imposes somewhat stricter requirements and appears to provide a certification of positive, albeit limited, value.

Running Out of Numbers? The Impending Scarcity of IP Addresses and What To Do About It

Edelman, Benjamin. “Running Out of Numbers: Scarcity of IP Addresses and What To Do About It.” Auctions, Market Mechanisms and Their Applications 14 (2009): 95-106. (Springer-Verlag Lecture Notes of the Institute for Computer Science.) (Featured in Working Knowledge: When the Internet Runs Out of IP Addresses) (Circulated in 2008 as Running Out of Numbers? The Impending Scarcity of IP Addresses and What To Do About It.)

The Internet’s current numbering system is nearing exhaustion: Existing protocols allow only a finite set of computer numbers (“IP addresses”), and central authorities will soon deplete their supply. I evaluate a series of possible responses to this shortage: Sharing addresses impedes new Internet applications and does not seem to be scalable. A new numbering system (“IPv6”) offers greater capacity, but network incentives impede transition. Paid transfers of IP addresses would better allocate resources to those who need them most, but unrestricted transfers might threaten the Internet’s routing system. I suggest policies to create an IP address “market” while avoiding major negative externalities–mitigating the worst effects of v4 scarcity, while obtaining price discovery and allocative efficiency benefits of market transactions.

Disclosure: I provide advice to ARIN’s counsel on matters pertaining to v6 transition, v4 exhaustion, and possible revisions to ARIN’s v4 transfer policy. But this paper expresses only my own views – not the views of ARIN, its Board, or its staff. I write on my own behalf, not for ARIN, nor at ARIN’s instruction or request.