Topsite (warez)
Encyclopedia
Topsite is a term used by the warez scene to refer to high-speed FTP
servers used by release groups and couriers for distribution, storage and archiving of warez
releases.
Topsites have very high-bandwidth Internet connections, commonly supporting transfer speeds of hundreds to thousands of megabits per second; enough to transfer a full DVD
in seconds. Topsites also have very high storage capacity; a total of many terabytes is typical.
scene, topsites aren't advertised broadly. With the increased threat of police raids, topsites have been forced to employ elaborate security precautions in order to stay hidden from authorities.
A typical topsite configuration will only allow users to login from a certain ident
and host (or IP range for users with dynamic IPs), with SSL encapsulation on all FTP sessions. FTP bouncers
are commonly used to hide the topsite's real IP address
, and to share network load
.
Along with an "official name", most topsites are also known in the warez scene by an abbreviation that is two or three letters long. Knowledge of the abbreviation as well as the official name is not shared, even between different scene members. For example, a topsite with the hypothetical name "Blackbox" could be abbreviated as "BBX" and subsequently referred to as "B**" during an IRC conversation between those with knowledge of the site.
server is announced by a Sitebot in a private IRC
channel which is usually invite-only. To receive an invite, users need to issue a command to the FTP server after logging in the site. This ensures that only those with accounts on the FTP have access to the channel. Sitebots typically run Eggdrop
IRC bot software.
musical genre
names (for MP3
releases), sections, and nuke (release rejection) details.
Release databases are maintained to provide release groups with a service for checking existing release titles (i.e., to avoid duping another group). Some databases contain historical release records dating back to the BBS
era. Note that such databases are uncommon, due to a completely different release naming method (based on the ZIP
file descriptor FILE ID.DIZ
, as opposed to a directory
name), and lack of information from this period.
Release databases are usually updated by automatic processes that either recurse selected topsites searching for new releases (spidering
), or catch pre-release announcements from site channels.
Release databases used by topsites are private, but a number of public websites exist with similar information.
. Nuke multiplier affects the amount of lost credits. Nukes can be either site nukes (local) or scene nukes (global). Site nukes are issued when a release that is uploaded to the topsite violates site rules, such as 'No VLS' for the MP3 section. Another common site nuke is for backfilling, which is uploading something after a specific amount of time has elapsed from the time of release, usually 5 to 15 minutes. Typically the nuke multiplier for a site nuke is at least 3x, where all couriers responsible for racing the bad release will lose 3x the credits they gained uploading. These nukes will not be echoed out to pre channels, as they only affect the local site. Scene nukes are nukes which are echoed out to pre channels. Scene nukes usually occur when a release violates scene rules, such as wrong encoder, or when the release is outright bad, such as out of sync. The nuke multiplier for scene nuke on topsites is usually 1x; all the couriers lose all credits gained uploading the release and break even.
may gain access to a topsite as an affiliate (or "affil"), thus making the site among the group's primary distribution points. Affiliation benefits the warez group as the site will grant a certain number of leech accounts to the group (the number usually depending on the reputation of the group), and the site benefits by becoming one of a collection of sites that has first access to the releases of the group, thus improving its own reputation. Typically, groups will affiliate with several topsites, in order to maximize efficient distribution by couriers to other (non-affiliated) topsites. A group will choose topsites based on geographical location, mostly by country but sometimes by region, such as Northern Europe or Western US. Barring extraordinary circumstances, a group selects just one site for each location.
Topsites may have any number of affiliates, and commonly advertise them in the welcome message to indicate to its users the quality of the site. The most exclusive topsites will avoid affiliating with an excessive number of groups for security purposes and also to maintain adequate network resources. Topsites may also remove (or "drop") affiliates for a variety of reasons, including the lack of productivity of the release group, conflict between the site operator and the group, and the group's decision to affiliate with another topsite in the same geographical region.
Each affiliate has access to a private, hidden directory on the topsite. This directory is used for uploading new releases before they are made available to other users. When a new release has finished uploading on each of the group's sites, a command is executed to simultaneously copy it into a directory accessible by other users, and trigger an announcement in the topsite IRC channel. This event is known as a pre-release (or "pre"), and must occur at the same time on every affiliated site.
The warez scene relies on strict release standards
, or rules, which are written and signed by various warez groups.
Couriers compete (race) against each other for respect, credits, access to other topsites, and fun. Private couriers often operate as independent (iND) couriers. Some couriers band together to form courier groups which provide support and friendship through camaraderie. Couriers/Racers are looked down upon more than ever by affiliates and topsite staff with the increase of scripts that perform the couriers tasks automatically; while some couriers call this efficient, others call it lazy.
) is in charge of the day-to-day operation of a topsite. They have full (root
) access to the server and are able to manage users, groups, and topsite scripts and daemons
installed on server. They decide on site rules, and site sections (e.g. TV Rips, XviD
movies, MP3
music, etc.). Site operators are also in charge of managing the site channel, and sitebot.
A group administrator ('gadmin') is a member of an affiliated group or courier group with user management rights over the group. Each group has a pre-negotiated number of leech and ratio users, or slots.
(December 2001) and Operation Fastlink
(April 2004) have been able to gain access and shut down sites by infiltrating the pirate groups that operate on them. Operation Site Down
(June 2005) was the latest significant law-enforcement attack on the warez scene. There were also busts in June 2006, with one US.biz site being busted, and several colocated servers being seized.
Hong Kong Customs uncovered a case when "copyright industry representatives" tipped them off in June 2009, resulting in the first case in Asia. Apparently, an international piracy syndicate used a topsite to download and then distribute copyright-infringing items such as movies, music, computer programs and videogame software.
Not all takedowns are successful. Operation Bahnhof (March 2005) failed when the officials entered an area that their warrant didn't include. Although they found several dedicated servers with terabytes of illegal material, they ended up being sued for illegal trespassing and harassment, and were accused of planting evidence, since one of the Antipiratbyrån
(Swedish anti-piracy group) employees was trying to infiltrate the scene to gather evidence, and in doing so violated Swedish laws against entrapment
.
File Transfer Protocol
File Transfer Protocol is a standard network protocol used to transfer files from one host to another host over a TCP-based network, such as the Internet. FTP is built on a client-server architecture and utilizes separate control and data connections between the client and server...
servers used by release groups and couriers for distribution, storage and archiving of warez
Warez
Warez refers primarily to copyrighted works distributed without fees or royalties, and may be traded, in general violation of copyright law. The term generally refers to unauthorized releases by organized groups, as opposed to file sharing between friends or large groups of people with similar...
releases.
Topsites have very high-bandwidth Internet connections, commonly supporting transfer speeds of hundreds to thousands of megabits per second; enough to transfer a full DVD
DVD
A DVD is an optical disc storage media format, invented and developed by Philips, Sony, Toshiba, and Panasonic in 1995. DVDs offer higher storage capacity than Compact Discs while having the same dimensions....
in seconds. Topsites also have very high storage capacity; a total of many terabytes is typical.
Security
Unlike their predecessors in the Bulletin board system (BBS)Bulletin board system
A Bulletin Board System, or BBS, is a computer system running software that allows users to connect and log in to the system using a terminal program. Once logged in, a user can perform functions such as uploading and downloading software and data, reading news and bulletins, and exchanging...
scene, topsites aren't advertised broadly. With the increased threat of police raids, topsites have been forced to employ elaborate security precautions in order to stay hidden from authorities.
A typical topsite configuration will only allow users to login from a certain ident
Ident
The Ident Protocol, specified in RFC 1413, is an Internet protocol that helps identify the user of a particular TCP connection. One popular daemon program for providing the ident service is identd.-How ident works:...
and host (or IP range for users with dynamic IPs), with SSL encapsulation on all FTP sessions. FTP bouncers
Bounce (network)
A BNC is a piece of software that is used to relay traffic and connections in computer networks, much like a proxy. Using a BNC allows a user to hide the original source of the user's connection, providing privacy as well as the ability to route traffic through a specific location...
are commonly used to hide the topsite's real IP address
IP address
An Internet Protocol address is a numerical label assigned to each device participating in a computer network that uses the Internet Protocol for communication. An IP address serves two principal functions: host or network interface identification and location addressing...
, and to share network load
Network Load Balancing
Network load balancing is the ability to balance traffic across two WAN links without using complex routing protocols like BGP.This capability balances network sessions like Web, email, etc...
.
Along with an "official name", most topsites are also known in the warez scene by an abbreviation that is two or three letters long. Knowledge of the abbreviation as well as the official name is not shared, even between different scene members. For example, a topsite with the hypothetical name "Blackbox" could be abbreviated as "BBX" and subsequently referred to as "B**" during an IRC conversation between those with knowledge of the site.
Site channels
Activity on the FTPFile Transfer Protocol
File Transfer Protocol is a standard network protocol used to transfer files from one host to another host over a TCP-based network, such as the Internet. FTP is built on a client-server architecture and utilizes separate control and data connections between the client and server...
server is announced by a Sitebot in a private IRC
Internet Relay Chat
Internet Relay Chat is a protocol for real-time Internet text messaging or synchronous conferencing. It is mainly designed for group communication in discussion forums, called channels, but also allows one-to-one communication via private message as well as chat and data transfer, including file...
channel which is usually invite-only. To receive an invite, users need to issue a command to the FTP server after logging in the site. This ensures that only those with accounts on the FTP have access to the channel. Sitebots typically run Eggdrop
Eggdrop
Eggdrop is a popular IRC bot and the oldest still in active development.- Development History :It was originally written by Robey Pointer in December 1993 to help manage and protect the EFnet channel #gayteen....
IRC bot software.
Dupe (duplicate) check
Release databases record release names and their release date & time, although fields vary from database to database. Examples of other common fields include ID3ID3
ID3 is a metadata container most often used in conjunction with the MP3 audio file format. It allows information such as the title, artist, album, track number, and other information about the file to be stored in the file itself....
musical genre
Music genre
A music genre is a categorical and typological construct that identifies musical sounds as belonging to a particular category and type of music that can be distinguished from other types of music...
names (for MP3
MP3
MPEG-1 or MPEG-2 Audio Layer III, more commonly referred to as MP3, is a patented digital audio encoding format using a form of lossy data compression...
releases), sections, and nuke (release rejection) details.
Release databases are maintained to provide release groups with a service for checking existing release titles (i.e., to avoid duping another group). Some databases contain historical release records dating back to the BBS
Bulletin board system
A Bulletin Board System, or BBS, is a computer system running software that allows users to connect and log in to the system using a terminal program. Once logged in, a user can perform functions such as uploading and downloading software and data, reading news and bulletins, and exchanging...
era. Note that such databases are uncommon, due to a completely different release naming method (based on the ZIP
ZIP (file format)
Zip is a file format used for data compression and archiving. A zip file contains one or more files that have been compressed, to reduce file size, or stored as is...
file descriptor FILE ID.DIZ
FILE ID.DIZ
FILE_ID.DIZ is a plain text file containing a brief contentdescription of the archive in which it is included.It was originally used in archives distributed through bulletin board systems ....
, as opposed to a directory
Directory (file systems)
In computing, a folder, directory, catalog, or drawer, is a virtual container originally derived from an earlier Object-oriented programming concept by the same name within a digital file system, in which groups of computer files and other folders can be kept and organized.A typical file system may...
name), and lack of information from this period.
Release databases are usually updated by automatic processes that either recurse selected topsites searching for new releases (spidering
Data scraping
Data scraping is a technique in which a computer program extracts data from human-readable output coming from another program.-Description:Normally, data transfer between programs is accomplished using data structures suited for automated processing by computers, not people...
), or catch pre-release announcements from site channels.
Release databases used by topsites are private, but a number of public websites exist with similar information.
Credit system
Credit system controls the amount of data that users can download. Most sites operate by using an automated credit system. When a user uploads a file, their account is credited for an amount based on the uploaded file size, commonly multiplied three times. For example, when a user uploads a 15MB file, they may receive 45MB credits in return. Credits can be later used to download files from the site. Credits can be lost by uploading a bad release that gets nukedNuke (warez)
In the warez scene, nuke refers to labeling content as "bad", for reasons which might include unusable software, bad video/audio quality, virus-infected content, deceptively labeled content or not following the rules. Also duplicates and stolen releases from other pirates that do not attribute the...
. Nuke multiplier affects the amount of lost credits. Nukes can be either site nukes (local) or scene nukes (global). Site nukes are issued when a release that is uploaded to the topsite violates site rules, such as 'No VLS' for the MP3 section. Another common site nuke is for backfilling, which is uploading something after a specific amount of time has elapsed from the time of release, usually 5 to 15 minutes. Typically the nuke multiplier for a site nuke is at least 3x, where all couriers responsible for racing the bad release will lose 3x the credits they gained uploading. These nukes will not be echoed out to pre channels, as they only affect the local site. Scene nukes are nukes which are echoed out to pre channels. Scene nukes usually occur when a release violates scene rules, such as wrong encoder, or when the release is outright bad, such as out of sync. The nuke multiplier for scene nuke on topsites is usually 1x; all the couriers lose all credits gained uploading the release and break even.
Affiliates
A warez groupWarez group
There are many types of groups such as release groups and courier groups. Groups often compete about being the first out with a new quality release. Being the first to release a new quality release brings status and respect....
may gain access to a topsite as an affiliate (or "affil"), thus making the site among the group's primary distribution points. Affiliation benefits the warez group as the site will grant a certain number of leech accounts to the group (the number usually depending on the reputation of the group), and the site benefits by becoming one of a collection of sites that has first access to the releases of the group, thus improving its own reputation. Typically, groups will affiliate with several topsites, in order to maximize efficient distribution by couriers to other (non-affiliated) topsites. A group will choose topsites based on geographical location, mostly by country but sometimes by region, such as Northern Europe or Western US. Barring extraordinary circumstances, a group selects just one site for each location.
Topsites may have any number of affiliates, and commonly advertise them in the welcome message to indicate to its users the quality of the site. The most exclusive topsites will avoid affiliating with an excessive number of groups for security purposes and also to maintain adequate network resources. Topsites may also remove (or "drop") affiliates for a variety of reasons, including the lack of productivity of the release group, conflict between the site operator and the group, and the group's decision to affiliate with another topsite in the same geographical region.
Each affiliate has access to a private, hidden directory on the topsite. This directory is used for uploading new releases before they are made available to other users. When a new release has finished uploading on each of the group's sites, a command is executed to simultaneously copy it into a directory accessible by other users, and trigger an announcement in the topsite IRC channel. This event is known as a pre-release (or "pre"), and must occur at the same time on every affiliated site.
The warez scene relies on strict release standards
Standard (warez)
Standards in the warez scene are defined by groups of people who have been involved in its activities for several years and have established connections to large groups. These people form a committee, which creates drafts for approval of the large groups. The first ruleset for the DivX/Xvid scene...
, or rules, which are written and signed by various warez groups.
Couriers
Couriers are a specific class of topsite users who earn their access by uploading new releases and filling requests. When a courier gains access to a topsite, they are often required to pass a trial test such as uploading a certain amount in a short period of time.Couriers compete (race) against each other for respect, credits, access to other topsites, and fun. Private couriers often operate as independent (iND) couriers. Some couriers band together to form courier groups which provide support and friendship through camaraderie. Couriers/Racers are looked down upon more than ever by affiliates and topsite staff with the increase of scripts that perform the couriers tasks automatically; while some couriers call this efficient, others call it lazy.
Site operator
A site or system operator (siteop/sysopSysOp
A sysop is an administrator of a multi-user computer system, such as a bulletin board system or an online service virtual community. It may also be used to refer to administrators of other Internet-based network services....
) is in charge of the day-to-day operation of a topsite. They have full (root
Superuser
On many computer operating systems, the superuser is a special user account used for system administration. Depending on the operating system, the actual name of this account might be: root, administrator or supervisor....
) access to the server and are able to manage users, groups, and topsite scripts and daemons
Daemon (computer software)
In Unix and other multitasking computer operating systems, a daemon is a computer program that runs as a background process, rather than being under the direct control of an interactive user...
installed on server. They decide on site rules, and site sections (e.g. TV Rips, XviD
XviD
Xvid is a video codec library following the MPEG-4 standard, specifically MPEG-4 Part 2 Advanced Simple Profile . It uses ASP features such as b-frames, global and quarter pixel motion compensation, lumi masking, trellis quantization, and H.263, MPEG and custom quantization matrices.Xvid is a...
movies, MP3
MP3
MPEG-1 or MPEG-2 Audio Layer III, more commonly referred to as MP3, is a patented digital audio encoding format using a form of lossy data compression...
music, etc.). Site operators are also in charge of managing the site channel, and sitebot.
Group administrator
A group administrator ('gadmin') is a member of an affiliated group or courier group with user management rights over the group. Each group has a pre-negotiated number of leech and ratio users, or slots.
Takedowns
While these sites are protected with technologically advanced schemes, law enforcement operations such as Operation BuccaneerOperation Buccaneer
On December 11, 2001, in an international operation known as Operation Buccaneer, law enforcement agents in six countries targeted 62 people suspected of software piracy, with leads in twenty other countries.U.S...
(December 2001) and Operation Fastlink
Operation Fastlink
Operation FastLink is a coordination of four separate, simultaneous undercover investigations by the FBI, the FBI Cyber Division, the U.S. Department of Justice, the Computer Crimes and Intellectual Property Section of the Criminal Division and Interpol. The four different investigations have not...
(April 2004) have been able to gain access and shut down sites by infiltrating the pirate groups that operate on them. Operation Site Down
Operation Site Down
Operation Site Down is the umbrella name for a law enforcement initiative conducted by the FBI and law enforcement agents from ten other countries which resulted in a raid on targets on June 29, 2005. Three separate undercover investigations were involved, based in Chicago , Charlotte and San Jose...
(June 2005) was the latest significant law-enforcement attack on the warez scene. There were also busts in June 2006, with one US.biz site being busted, and several colocated servers being seized.
Hong Kong Customs uncovered a case when "copyright industry representatives" tipped them off in June 2009, resulting in the first case in Asia. Apparently, an international piracy syndicate used a topsite to download and then distribute copyright-infringing items such as movies, music, computer programs and videogame software.
Not all takedowns are successful. Operation Bahnhof (March 2005) failed when the officials entered an area that their warrant didn't include. Although they found several dedicated servers with terabytes of illegal material, they ended up being sued for illegal trespassing and harassment, and were accused of planting evidence, since one of the Antipiratbyrån
Svenska antipiratbyrån
Svenska antipiratbyrån is a Swedish lobby group representing companies and organisations within the Swedish film and computer game industry. Its activities involve promoting copyright issues and fighting copyright infringement...
(Swedish anti-piracy group) employees was trying to infiltrate the scene to gather evidence, and in doing so violated Swedish laws against entrapment
Entrapment
In criminal law, entrapment is conduct by a law enforcement agent inducing a person to commit an offense that the person would otherwise have been unlikely to commit. In many jurisdictions, entrapment is a possible defense against criminal liability...
.
External links
- Wired magazine article about the phenomenon: The shadow internet
- NetMonkey Weekend Report (NWR) article on topsite FTP daemons