Slashdot effect

"Flash crowd" redirects here. For the short story by Larry Niven, see Flash Crowd. For the social gathering in the real world, see flash mob.

The Slashdot effect, also known as slashdotting, occurs when a popular website links to a smaller site, causing a massive increase in traffic. This overloads the smaller site, causing it to slow down or even temporarily become unavailable. The name stems from the huge influx of web traffic that would result from the technology news site Slashdot linking to websites. However the name is somewhat dated as flash crowds from Slashdot were reported to be diminishing as of 2005 due to competition from similar sites.[1] The effect has been associated with other websites or metablogs such as Fark, Digg, Drudge Report, Imgur, Reddit, and Twitter, leading to terms such as being Farked or Drudged, being under the Reddit effect, or receiving a "hug of death" from the site in question.[2][3] Google Doodles, which link to search results on the doodle topic, also result in high increases of traffic from the search results page.[4] Typically, less robust sites are unable to cope with the huge increase in traffic and become unavailable – common causes are lack of sufficient data bandwidth, servers that fail to cope with the high number of requests, and traffic quotas. Sites that are maintained on shared hosting services often fail when confronted with the Slashdot effect.

A flash crowd is a more generic term without using any specific name that describes a network phenomenon where a network or host suddenly receives a lot of traffic. This is sometimes due to the appearance of a website on a blog or news column.[5][6][7]

Terminology

According to the Jargon File, the term "Slashdot effect" refers to phenomenon of a website becoming virtually unreachable because too many people are hitting it after the site was mentioned in an interesting article on the popular Slashdot news service. It was later extended to describe any similar effect from being listed on a popular site, similar to the more generic term, flash crowd, which is a more appropriate term.[8]

The term "flash crowd" was coined in 1973 by Larry Niven in his science fiction short story, Flash Crowd. It predicted that a consequence of inexpensive teleportation would be huge crowds materializing almost instantly at the sites of interesting news stories. Twenty years later, the term became commonly used on the Internet to describe exponential spikes in website or server usage when it passes a certain threshold of popular interest. This effect was anticipated years earlier in 1956 in Alfred Bester's novel The Stars My Destination.[9]

The Reddit effect has also been used to describe viral crowd fundraising efforts in addition to the surge in web traffic.[2]

Cause

Sites such as Slashdot, Digg, Reddit, StumbleUpon and Fark consist of brief submitted stories and a self-moderated discussion on each story. The typical submission introduces a news item or website of interest by linking to it. In response, large masses of readers tend to simultaneously rush to view the referenced sites. The ensuing flood of page requests from readers can exceed the site's available bandwidth or the ability of its servers to respond, and render the site temporarily unreachable.

Extent

MRTG Graph from a web server statistics generator showing a moderate Slashdot effect in action in 2005

Major news sites or corporate websites are typically engineered to serve large numbers of requests and therefore do not normally exhibit this effect. Websites that fall victim may be hosted on home servers, offer large images or movie files or have inefficiently generated dynamic content (e.g. many database hits for every web hit even if all web hits are requesting the same page). These websites often became unavailable within a few minutes of a story's appearance, even before any comments had been posted. Occasionally, paying Slashdot subscribers (who have access to stories before non-paying users) rendered a site unavailable even before the story was posted for the general readership.

Few definitive numbers exist regarding the precise magnitude of the Slashdot effect, but estimates put the peak of the mass influx of page requests at anywhere from several hundred to several thousand hits per minute.[10][11][12] The flood usually peaked when the article was at the top of the site's front page and gradually subsided as the story was superseded by newer items. Traffic usually remained at elevated levels until the article was pushed off the front page, which could take from 12 to 18 hours after its initial posting. However, some articles had significantly longer lifetimes due to the popularity, newsworthiness, or interest in the linked article.

By 2005, reporters were commenting that the Slashdot effect had been diminishing.[1] However, the effect has been seen involving Twitter when some popular users mention a website.[13]

Communities

When the targeted website has a community-based structure, the term can also refer to the secondary effect of having a large group of new users suddenly set up accounts and start to participate in the community. While in some cases this has been considered a good thing, in others it is viewed with disdain by the prior members, as quite often the sheer number of new people brings many of the unwanted aspects of Slashdot along with it, such as trolling, vandalism, and newbie-like behavior. This bears some similarity to the 1990s Usenet concept of Eternal September.

Assistance and prevention

Many solutions have been proposed for sites to deal with the Slashdot effect.[14]

There are several systems that automatically mirror any Slashdot-linked pages to ensure that the content remains available even if the original site becomes unresponsive.[15] Sites in the process of being Slashdotted may be able to mitigate the effect by temporarily redirecting requests for the targeted pages to one of these mirrors. Slashdot does not mirror the sites it links to on its own servers, nor does it endorse a third party solution. Mirroring of content may constitute a breach of copyright and, in many cases, cause ad revenue to be lost for the targeted site.

See also

Notes and references

  1. 1 2 Olga Kharif , Less Impact from the "Slashdot Effect", Bloomberg Business Week, March 2, 2005
  2. 1 2 Wilhelm, Alex (17 January 2012). "How Reddit turned one congressional candidate’s campaign upside down". The Next Web. Retrieved 24 October 2012.
  3. ↑ "The Reddit effect". ABC News. August 31, 2012. Retrieved 24 October 2012.
  4. ↑ Williams, David E. "Google's unknown artist has huge following." CNN. July 19, 2006. Retrieved on July 19, 2006.
  5. ↑ Ismail Ari, Bo Hong, Ethan L. Miller, Scott A. Brandt, Darrell and D. E. Long (October 2003). "Managing Flash Crowds on the Internet" (PDF). University of California Santa Cruz Storage Systems Research Center. Retrieved 15 March 2010.
  6. ↑ Chenyu Pan; Merdan Atajanov; Mohammad Belayet Hossain; Toshihiko Shimokawa; Norihiko Yoshida (April 2006). "FCAN: Flash Crowds Alleviation Network Using Adaptive P2P Overlay of Cash Proxies" (PDF). The Institute of Electronics, Information and Communication Engineers. Archived from the original (PDF) on 2 February 2010. Retrieved 15 March 2010.
  7. ↑ Xuan Chen; John Heidemann (July 2004). "Flash Crowd Mitigation via Adaptive Admission Control Based on Application-Level Observations" (PDF). University of Colorado Colorado Springs College of Engineering & Applied Science. Retrieved 25 May 2012.
  8. ↑ Eric S. Raymond. "slashdot effect". The Jargon File, version 4.4.8. Retrieved 21 May 2012.
  9. ↑ Eric S. Raymond. "flash crowd". The Jargon File (version 4.4.7). Retrieved 25 May 2012.
  10. ↑ Stephen Adler. "The Slashdot Effect: An Analysis of Three Internet Publications". Archived from the original on 2 December 2008. Retrieved 19 April 2003. (mirror)
  11. ↑ "Slashdotting graphs". Princeton University Department of Astrophysical Sciences. Archived from the original on 27 February 2009. Retrieved 13 January 2004.
  12. ↑ Aaron Benoy. "Ruins in ASCII". Retrieved 27 September 2004.
  13. ↑ Paul Douglas, How Stephen Fry takes down entire websites with a single tweet, Tech Radar, March 3, 2010
  14. ↑ Jeremy Elson; Jon Howell (2008), Handling Flash Crowds from your Garage (PDF), Microsoft Research – A research paper describing strategies for handling flash crowds
  15. ↑ Daniel Terdiman (1 October 2004). "Solution for Slashdot Effect?". Retrieved 2011-07-06.

External links

This article is issued from Wikipedia - version of the Saturday, December 05, 2015. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.