Torrent file


In the BitTorrent file distribution system, a torrent file or meta-info file is a computer file that contains metadata about files and folders to be distributed, and usually also a list of the network locations of trackers, which are computers that help participants in the system find each other and form efficient distribution groups called swarms. Torrent files are normally named with the extension .torrent.
A torrent file acts like a table of contents that allows computers to find information through the use of a torrent client. With the help of a torrent file, one can download small parts of the original file from computers that have already downloaded it. These "peers" allow for downloading of the file in addition to, or in place of, the primary server. A torrent file does not contain the content to be distributed; it only contains information about those files, such as their names, folder structure, sizes, and cryptographic hash values for verifying file integrity.
The torrent system has been created to ease the load on central servers, as instead of having individual clients fetch files from the server, torrent can crowd-source the bandwidth needed for the file transfer and reduce the time needed to download large files. Many free/freeware programs and operating systems, such as the various Linux distributions offer a torrent download option for users seeking the aforementioned benefits. Other large downloads, such as media files, are often torrented as well.

Background

Typically, Internet access is asymmetrical, supporting greater download speeds than upload speeds, limiting the bandwidth of each download, and sometimes enforcing bandwidth caps and periods where systems are not accessible. This creates inefficiency when many people want to obtain the same set of files from a single source; the source must always be online and must have massive outbound bandwidth. The torrent protocol addresses this by decentralizing the distribution, leveraging the ability of people to network "peer-to-peer", among themselves.
Each file to be distributed is divided into small information chunks called pieces. Downloading peers achieve high download speeds by requesting multiple pieces from different computers simultaneously in the swarm. Once obtained, these pieces are usually immediately made available for download by others in the swarm. In this way, the burden on the network is spread among the downloaders, rather than concentrating at a central distribution hub or cluster. As long as all the pieces are available, peers can come and go; no one peer needs to have all the chunks or to even stay connected to the swarm in order for distribution to continue among the other peers.
A small torrent file is created to represent a file or folder to be shared. The torrent file acts as the key to initiating downloading of the actual content. Someone interested in receiving the shared file or folder first obtains the corresponding torrent file, either by directly downloading it or by using a magnet link. The user then opens that file in a torrent client, which automates the rest of the process. In order to learn the internet locations of peers who may be sharing pieces, the client connects to the trackers named in the torrent file, and/or achieves a similar result through the use of distributed hash tables. Then the client connects directly to the peers in order to request pieces and otherwise participate in a swarm. The client may also report progress to trackers, to help the tracker with its peer recommendations.
When the client has all the pieces, the torrent client assembles them into a usable form. They may also continue sharing the pieces, elevating their status to that of seeder rather than an ordinary peer.

File structure

A torrent file contains a list of files and integrity metadata about all the pieces, and optionally contains a large list of trackers.
A torrent file is a bencoded dictionary with the following keys :
  • —the URL of the tracker
  • —this maps to a dictionary whose keys are very dependent on whether one or more files are being shared:
  • * —a list of dictionaries each corresponding to a file. Each dictionary has the following keys:
  • ** —size of the file in bytes.
  • ** —a list of strings corresponding to subdirectory names, the last of which is the actual file name
  • * —size of the file in bytes
  • * —suggested filename where the file is to be saved /suggested directory name where the files are to be saved
  • * —number of bytes per piece. This is commonly 28 KiB = 256 KiB = 262,144 B.
  • * —a hash list, i.e., a concatenation of each piece's SHA-1 hash. As SHA-1 returns a 160-bit hash, will be a string whose length is a multiple of 20 bytes. If the torrent contains multiple files, the pieces are formed by concatenating the files in the order they appear in the dictionary.
All strings must be UTF-8 encoded, except for, which contains binary data.
A torrent is uniquely identified by an infohash, a SHA-1 hash calculated over the contents of the dictionary in bencode form. Changes to other portions of the torrent do not affect the hash. This hash is used to identify the torrent to other peers via DHT and to the tracker. It is also used in magnet links.

BitTorrent v2

The BitTorrent v2 protocol introduces a new definition of the torrent file. The basic structure is:
  • —the URL of the tracker
  • —this maps to a dictionary whose keys are dependent on whether one or more files are being shared:
  • * —suggested directory name where the files are to be saved
  • * —number of bytes per piece. This is commonly 28 KiB = 256 KiB = 262,144 B. In v2, it must be a power of 2.
  • * —number, "2".
  • * —a tree of dictionaries. Each key represents a directory name or a file name. The file is
  • ** —size of the file in bytes
  • ** —For non-empty files this is the root hash of a merkle tree with a branching factor of 2, constructed from 16KiB blocks of the file.
  • —A dictionary of strings, containing the new type of merkle root hashes for each piece.
The new format uses SHA-256 in both the piece-hashing and the infohash, replacing the broken SHA-1 hash. The "btmh" magnet link would contain the full 32-byte hash, while communication with trackers and on the DHT uses the 20-byte truncated version to fit into the old message structure. It is possible to construct a torrent file with only updated new fields for a "v2" torrent, or with both the old and new fields for a "hybrid" format. However, as a torrent would have different infohashes in v1 and v2 networks, two swarms would form, requiring special handling by the client to merge the two.
A core feature of the new format is its application of merkle trees, allowing for 16KiB blocks of a piece to be individually verified and re-downloaded. Each file now always occupy whole piece sizes and have an independent merkle root hash, so that it's possible to find duplicate files across unrelated torrent files of any piece length. The file size is not reduced, but the dictionary required for magnet links are.

Extensions

A torrent file can also contain additional metadata defined in extensions to the BitTorrent specification. These are known as "BitTorrent Enhancement Proposals." Examples of such proposals include metadata for stating who created the torrent, and when.

Accepted extensions

These extensions have been deployed in one or more implementations as well as having been proven useful through consistent and widespread use. While they may require minor revisions, they are largely considered to be complete, only awaiting the blessing of Bram Cohen in order to be elevated to the status of Final/Active Process.

Distributed hash tables

BEP-0005 extends BitTorrent to support distributed hash tables, specifically Mainline DHT.
A trackerless torrent dictionary does not have an key. Instead, a trackerless torrent has a key:


For example,

'nodes': "127.0.0.1", 6881], "your.router.node", 4804,

The specification recommends that "should be set to the K closest nodes in the torrent generating client's [routing table. Alternatively, the key could be set to a known good node such as one operated by the person generating the torrent."

Multiple trackers

BEP-0012 extends BitTorrent to support multiple trackers.
A new key,, is placed in the top-most dictionary

HTTP seeds

BEP-0019 is one of two extensions allowing HTTP seeds to be used in BitTorrent.
In BEP-0019, a new key, is placed in the top-most list. The client uses the links to assemble ordinary HTTP URLs - no server-side support is required. This feature is very commonly used by open source projects offering software downloads. Web seeds allow smart selection and simultaneous use of mirror sites, P2P or HTTP, by the client. Doing so reducing the load on the project's servers while maximizing download speed. automatically generates torrents with web seeds.

Private torrents

BEP-0027 extends BitTorrent to support private torrents.
A new key,, is placed in the dictionary. This key's value is 1 if the torrent is private:


Private torrents are to be used with a private tracker. Such a tracker restricts access to torrents it tracks by checking the peer's IP, refusing to provide a peer list if the IP is unknown. The peer itself is usually registered to the tracker via a gated online community; the private tracker typically also keep statistics of data transfer for use in the community.
Decentralized methods like DHT, PeX, are disabled to maintain the centralized control. A private torrent can be manually edited to remove the private flag, but doing so will change the info-hash, forming a separate "swarm" of peers. On the other hand, changing the tracker list will not change the hash. The flag does not offer true privacy, instead operating as a gentlemen's agreement.