|
|
|
|
Internet Archive
|
| |
|
| |
The Internet Archive (IA) is a nonprofit organization dedicated to building and maintaining a free and openly accessible online digital library, including an archive of the Web. With offices located in the Presidio in San Francisco, California, and data centers in San Francisco, Redwood City, and Mountain View, CA, the archive includes "snapshots of the World Wide Web" (archived copies of pages, taken at various points in time), software, movies, books, and audio recordings.
Discussion
Ask a question about 'Internet Archive' Start a new discussion about 'Internet Archive' Answer questions from other users |
Encyclopedia
The Internet Archive (IA) is a nonprofit organization dedicated to building and maintaining a free and openly accessible online digital library, including an archive of the Web. With offices located in the Presidio in San Francisco, California, and data centers in San Francisco, Redwood City, and Mountain View, CA, the archive includes "snapshots of the World Wide Web" (archived copies of pages, taken at various points in time), software, movies, books, and audio recordings. To ensure the stability and endurance of the Internet Archive, its collection is mirrored at the Bibliotheca Alexandrina in Egypt, so far the only library in the world with a mirror. The IA makes its collections available at no cost to researchers, historians, and scholars. It is a member of the American Library Association and is officially recognized by the State of California as a library.
History
The Internet Archive was founded by Brewster Kahle in 1996.
According to its website:
- Most societies place importance on preserving artifacts of their culture and heritage. Without such artifacts, civilization has no memory and no mechanism to learn from its successes and failures. Our culture now produces more and more artifacts in digital form. The Archive's mission is to help preserve those artifacts and create an Internet library for researchers, historians, and scholars.
Wayback Machine
The Wayback Machine () is a digital time capsule created by the Internet Archive. It is maintained with content from Alexa Internet. This service allows users to see archived versions of web pages across time—what the Archive calls a "three dimensional index."
Snapshots become available 6 to 12 months after they are archived. The frequency of snapshots is variable, so not all updates to tracked web sites are recorded, and intervals of several weeks sometimes occur.
the Wayback Machine contained almost 2 petabytes of data and was growing at a rate of 20 terabytes per month, a two-thirds increase over the 12 terabytes/month growth rate reported in 2003. Its growth rate eclipses the amount of text contained in the world's largest libraries, including the Library of Congress. The data is stored on Petabox rack systems manufactured by Capricorn Technologies.
The name Wayback Machine is a reference to a segment from The Rocky and Bullwinkle Show in which Mr. Peabody, a bow tie-wearing dog with a professorial air, and his human "pet boy" assistant Sherman use a time machine called the "WABAC machine" to witness, participate in, and more often than not alter famous events in history.
Archive-It
Users who want to archive material permanently and immediately cite an archived version can use the , a for-fee subscription service. Data collected with Archive-It is periodically indexed into the general Wayback Machine. As of February 2009, Archive-It had created over 724 million URLs for 746 public collections, including government bodies, universities, and cultural institutions. Some of the organizations participating in Archive-It include the Electronic Literature Organization, the State Archives of North Carolina, the Texas State Library and Archives Commission, Stanford University, the National Library of Australia, the Research Libraries Group (RLG), and .
Media collections
In addition to web archives, the Internet Archive maintains extensive collections of digital media that are either public domain or licensed under a license that allows redistribution, such as Creative Commons licenses. The media are organized into collections by media type (moving images, audio, text, etc.), and into sub-collections by various criteria. Each of the main collections includes an "Open Source" sub-collection where general contributions by the public can be stored.
Moving image collection
Aside from feature films, IA's Moving Image collection includes: newsreels; classic cartoons; pro- and anti-war propaganda; Skip Elsheimer's "A.V. Geeks" collection; and ephemeral material from Prelinger Archives, such as advertising, educational and industrial films and amateur and home movie collections.
IA's Brick Films collection contains stop-motion animation filmed with LEGO bricks, some of which are 'remakes' of feature films. The Election 2004 collection is a non-partisan public resource for sharing video materials related to the 2004 United States Presidential Election. The Independent News collection includes sub-collections such as the Internet Archive's World At War competition from 2001, in which contestants created short films demonstrating "why access to history matters." Among their most-downloaded video files are eyewitness recordings of the devastating 2004 Indian Ocean earthquake. The contains archival footage from the world's major television networks of the terrorist attacks of September 11th, 2001 as they unfolded on live television.
Some of the films available on the Internet Archive are:
Audio collection
The audio collection includes music, audio books, news broadcasts, old time radio shows and a wide variety of other audio files.
The Live Music Archive sub-collection includes over 50,000 concert recordings from independent artists, as well as more established artists and musical ensembles with permissive rules about recording their concerts such as the Grateful Dead, and more recently, The Smashing Pumpkins.
Texts collection
The texts collection includes digitized books from various libraries around the world as well as many special collections. As of October 2008, the Internet Archive operated 18 scanning centers in five countries, digitizing about 1,000 books a day, financially supported by libraries and foundations. As of November 2008, when there were about 1 million texts, the entire collection was over 0.5 petabytes, which includes raw camera images, cropped and skewed images, PDFs, and raw OCR data.
Between about 2006 and 2008 Microsoft Corporation had a special relationship with Internet Archive texts through its Live Search Books project, scanning over 300,000 books which were contributed to the collection, as well as financial support and scanning equipment. On May 23, 2008 Microsoft announced it would be ending the Live Book Search project and no longer scanning books. Microsoft will be making its scanned books available without contractual restriction and making the scanning equipment available to its digitization partners and libraries to continue digitization programs.
Around October 2007 Internet Archive began importing book scans made by Google Books which are in the public domain. As of November 2008 there are over half a million such imports representing almost half of the total books on Internet Archive. The books are identical to the copies found on Google, except without the Google watermarks.
Open Library
The Open Library is another project of the Internet Archive. The site, still in beta, seeks to include a web page database for every book ever published, a sort of Open Source version of WorldCat. It holds the catalog records of nearly 20 million books, in addition to the full texts of about 400,000 public domain books, which are fully searchable. Open Library is a free/open source software project, with its source code freely available on the Open Library site.
Controversies
Scientology sites
In late 2002, the Internet Archive removed various sites critical of Scientology from the Wayback Machine. The error message stated that this was in response to a "request by the site owner." It was later clarified that lawyers from the Church of Scientology had demanded the removal and that the actual site owners did not want their material removed.
Archived web pages as evidence
United States civil litigation
Telewizja Polska
In an October 2004 case called "Telewizja Polska SA v. Echostar Satellite", a litigant attempted to use the Wayback Machine archives as a source of admissible evidence, perhaps for the first time. Telewizja Polska is the provider of TVP Polonia and EchoStar operates the Dish Network. Prior to the trial proceedings, EchoStar indicated that it intended to offer Wayback Machine snapshots as proof of the past content of Telewizja Polska’s website. Telewizja Polska brought a motion in limine to suppress the snapshots on the grounds of hearsay and unauthenticated source, but Magistrate Judge Arlander Keys rejected Telewizja Polska’s assertion of hearsay and denied TVP's motion in limine to exclude the evidence at trial. However, at the actual trial, district Court Judge Ronald Guzman, the trial judge, overruled Magistrate Keys' findings, and held that neither the affidavit of the Internet Archive employee nor the underlying pages (i.e., the Telewizja Polska website) were admissible as evidence. Judge Guzman reasoned that the employee's affidavit contained both hearsay and inconclusive supporting statements, and the purported webpage printouts themselves were not self-authenticating.
Healthcare Advocates, Inc.
In 2003, Healthcare Advocates, Inc. were defendants in a trademark violation lawsuit wherein the prosecution attempted to use archived web material accessed via the Internet Archive. When they lost that suit, the company turned around and attempted to sue the Internet Archive for violating the Digital Millennium Copyright Act (DMCA) and the Computer Fraud and Abuse Act. They claimed that since they had installed a robots.txt file on their website, it should have been avoided by the Internet Archive’s web crawlers but was not. The initial lawsuit was filed on June 26, 2003, and they added the robots.txt file on July 8, 2003, so pages should have been removed retroactively. The lawsuit with Healthcare Advocates was settled out of court.
Robots.txt is used as part of the Robots Exclusion Standard, a voluntary protocol the Internet Archive respects that disallows bots from indexing certain pages delineated by the creator as off-limits. As a result, the Internet Archive has removed a number of websites that are now inaccessible through the Wayback Machine. This is sometimes due to a new domain owner placing a robots.txt file that disallows indexing of the site. The administrators claim to be working on a system that will allow access to that previous material while excluding material created after the point the domain switched hands. Currently, the Internet Archive applies robots.txt rules retroactively; if a site blocks the Internet Archive, like Healthcare Advocates, any previously archived pages from the domain are also removed. In cases of blocked sites, only the robots.txt file is archived. This practice would appear to be detrimental to researchers looking for information that was available in the past.
However, the Internet Archive also states that, "sometimes a web site owner will contact us directly and ask us to stop crawling or archiving a site. We comply with these requests." They also say, "The Internet Archive is not interested in preserving or offering access to Web sites or other Internet documents of persons who do not want their materials in the collection."
htpCompany.com
In October 2005, htpCompany was a defendant in a U.S. small claims case. The plaintiff of the case had purchased online advertising from the defendant and claimed that the ads had been pulled prior to the end of the paid-for advertising period whereas the defendant claimed in court that the ads had stayed up for the full period. The plaintiff produced printouts of archive.org showing that the ads had gone up and then had disappeared before their expiration. The judge allowed the printouts as evidence and decided the case in favor of the plaintiff. However, because this is a small claims case and because the evidentiary rules are not as strict, it is unlikely that this would set any precedent for civil cases in Supreme Court.
Patent law
The United States patent office and, provided some additional requirements are met (e.g. providing an authoritative statement of the archivist), the European Patent Office will accept date stamps from the Internet Archive as evidence of when a given web page was accessible to the public. These dates are used to determine if a web page is available as prior art for instance in examining a patent application.
Misuse Of Results
There are technical limitations to archiving a website, and as a consequence, it is possible for opposing parties in litigation to misuse the results provided by website archives. This problem can be exacerbated by the practice of submitting screen shots of web pages in complaints, answers or expert witness reports; when the underlying links are not exposed and therefore can contain errors. For example; archives like the Wayback Machine do not fill out forms and therefore do not include the contents of e-commerce databases in their archives..
Grateful Dead
In November 2005, free downloads of Grateful Dead concerts were removed from the site. John Perry Barlow identified Bob Weir, Mickey Hart, and Bill Kreutzmann as the instigators of the change, according to a New York Times article. Phil Lesh commented on the change in a November 30, 2005, posting to his personal website:
-
It was brought to my attention that all of the Grateful Dead shows were taken down from Archive.org right before Thanksgiving. I was not part of this decision making process and was not notified that the shows were to be pulled. I do feel that the music is the Grateful Dead's legacy and I hope that one way or another all of it is available for those who want it.
A November 30 forum post from Brewster Kahle summarized what appeared to be the compromise reached among the band members. Audience recordings could be downloaded or streamed, but soundboard recordings were to be available for streaming only. Concerts have since been re-added.
Automatically entered contracts
On December 12, 2005, activist Suzanne Shell demanded Internet Archive pay her US$100,000 for archiving her website profane-justice.org between 1999 and 2004. Internet Archive filed a declaratory judgment action in the United States District Court for the Northern District of California on January 20, 2006, seeking a judicial determination that Internet Archive did not violate Shell’s copyright. Shell responded and brought a countersuit against Internet Archive for archiving her site, which she alleges is in violation of her terms of service. On February 13, 2007, a judge for the United States District Court for the District of Colorado dismissed all counterclaims except breach of contract. The Internet Archive did not move to dismiss copyright infringement claims Shell asserted arising out of its copying activities, which will also go forward. On April 25, 2007, Internet Archive and Suzanne Shell jointly announced the settlement of their lawsuit. The Internet Archive said, “Internet Archive has no interest in including materials in the Wayback Machine of persons who do not wish to have their Web content archived. We recognize that Ms. Shell has a valid and enforceable copyright in her Web site and we regret that the inclusion of her Web site in the Wayback Machine resulted in this litigation. We are happy to have this case behind us.” Ms. Shell said, “I respect the historical value of Internet Archive’s goal. I never intended to interfere with that goal nor cause it any harm.”
Copyright situation in Europe
In Europe the Wayback Machine can sometimes violate copyright laws. Only the creator can decide where his content is published or duplicated, so the Archive would have to delete pages from its system upon request of the creator. The exclusion policies for the Wayback Machine can be found in the FAQ section of the site. The Wayback Machine also retroactively respects robots.txt files.
Rescission of FBI National Security Letter
On May 8, 2008 it was revealed that the Internet Archive successfully challenged an FBI National Security Letter asking for logs on an undisclosed user.
See also
Similar projects
Other
External links
- – New Music Resource from radiOM.org
- Erik Ringmar, ","
Times Higher Education Supplement, 10 April 2008.
|
| |
|
|
