From ARPANET to the Internet: The Birth and Evolutionary Journey of Technology
Doğa Aydın
Posted on September 19, 2024
The Space Race and Technological Transformation: The Road to the Internet
October 29, 1969, Los Angeles. In the laboratory of the University of California, Los Angeles (UCLA), this historic moment carried out by Computer Science Professor Leonard Kleinrock and graduate student Charley Kline marked the birth of the modern internet. The experiment aimed to transmit data between a computer at UCLA and another at the Stanford Research Institute (SRI). Initially, the plan was to send a simple "LO" (LOG IN) message between these two computers. However, due to the complexity and novelty of the system, the connection was lost and the system crashed during this initial attempt. Shortly thereafter, with the system restarted, the fundamental goal of the experiment was successfully achieved: the first data transmission between two distant computers was completed.
This simple message went down in history as one of the first steps in laying the foundations of the internet. This experiment became a significant milestone for future data communication and network technologies. It was a harbinger of how not only technology but also computer networks would evolve.
The Effects of the Cold War and the Space Race
Leonard Kleinrock developed the idea of communication as part of the space race triggered by the Soviet Union's launch of the Sputnik satellite. During the Cold War, the Soviets' efforts to gain superiority over the Americans and the West demonstrated to the world that the USSR was not technologically lagging behind the United States. As George E. Reedy remarked,
"It took the Russians four years to catch up with our atomic bomb and nine months to catch up with our hydrogen bomb. Now we are trying to catch up with their satellite."
These words vividly capture the tension and competition of the era.
Image: Sputnik satellitea.jpg by Carlos Moreno Rekondo, It is licensed CC BY-SA 4.0.
The launch of Sputnik opened a new front in the Cold War, prompting the United States into action. Americans viewed the Soviet emphasis on science and technology as a great achievement, which increased the Soviets' potential to lead in the Space Race. This development sparked a surge of interest in science and technology. New science courses were added to schools and universities and the private sector began to invest more heavily in scientific research.
ARPA: Innovative Steps Laying the Foundation for the Internet in the Aftermath of the Cold War
In the race for technology and science spurred by the Cold War, the United States took radical steps to catch up with the Soviet Union. As part of this effort, President Dwight D. Eisenhower transferred the coordination of defense research and development projects to the Advanced Research Projects Agency (ARPA). During this period, ARPA spearheaded crucial projects aimed at ensuring the nation's military and technological superiority.
However, the U.S. efforts to quickly catch up with the Soviets in the space race led to the creation of NASA. With NASA's establishment, ARPA's space and rocket projects were transferred to the new agency. This shift prompted ARPA to seek innovations in new areas and sectors.
Under the leadership of Joseph Carl R. Licklider, ARPA shifted its focus to computer science. Licklider developed groundbreaking ideas in the field of computer science, which began laying the foundation for modern computer networks and internet technology. His visionary approach greatly contributed not only to the advancement of computer technologies but also to the evolution of information sharing and communication.
Licklider's Vision and Time-Sharing Systems
When J.C.R. Licklider joined ARPA, he realized that existing computers were mostly single-task hardware that sat idle most of the time. This was limiting their efficiency. Licklider thought time-sharing systems could solve this problem. These systems allowed multiple users to connect to a mainframe simultaneously, sharing processor time and interacting with the computer.
Licklider's first step was to encourage universities to purchase time-sharing systems. The massive and expensive mainframes of that era could only perform a limited number of tasks and were typically configured according to the specific needs of their owners. More complex experiments and multitasking required the use of multiple computers, but because hardware costs were high, many research centers could only afford one computer. This situation created a need for a computer network that could enable resource sharing. Licklider wanted to expand these systems to allow access to remote resources via a network.
Security Vulnerabilities and Challenges in Data Transmission: Technological Obstacles of the Cold War Era
During the Cold War, remote computing faced various risks. The analog circuits of telephone networks could not guarantee reliable connections and remained continuously open. This increased the potential for an attack on the phone system to disrupt all communication. Scientists and military experts were concerned about possible Soviet attacks on the telephone infrastructure; a missile could wipe out the entire communication network, leading to a strategic disaster.
At that time, data transmission was commonly carried out using the "circuit switching" method. This method transmitted data as a complete packet and sent it to only one computer at a time. While suitable for telephone calls, this approach was inefficient for computer data transfer because it required a continuously open circuit between two devices. This led to inefficiencies and security issues in data transmission, as the connection remained open even when not in use, leaving it vulnerable to potential attacks.
The Road to the Internet: The Intergalactic Network and Human-Computer Symbiosis
In the early 1960s, J.C.R. Licklider sought solutions to potential Soviet attacks on telephone systems. In this context, he developed the innovative idea of an "intergalactic network" that would facilitate information sharing between computers. Licklider's vision was to create a network that would allow government officials to maintain uninterrupted communication, even if the Soviets managed to damage the phone system. This network aimed to provide a reliable communication infrastructure to ensure the flow of information during crises.
Licklider's concept was based on the idea of "human-computer symbiosis," which aimed to establish a strong collaboration between humans and computers. In his article "Human-Computer Symbiosis" published in 1960, he predicted that the human brain and computers would work in close integration. This symbiotic relationship would enhance the human brain's cognitive abilities while enabling computers to process data more efficiently. Licklider argued that computers should assist humans in solving complex problems through flexible programming. The ultimate goal was to improve the quality of life and make human-computer interaction more efficient.
Licklider proposed that humans and computers could complement each other, creating a stronger cognitive capacity. However, to achieve this, he emphasized the need to overcome the time and space barriers between humans and computers and to accelerate feedback loops. In doing so, humans and computers could effectively coexist in a mutually beneficial relationship. Licklider believed that this symbiotic relationship would eventually create what he called the "intergalactic network," a perfect human-computer harmony.
The 'global network' idea proposed by Licklider in the early 1960s laid the foundations of the modern internet. However, this idea could only come to life if different systems overcame language barriers and integrated into a broader network. Although Licklider left ARPA a few years before ARPANET was created, his ideas and vision laid the foundation for the internet and helped build the digital world we know today.
Paul Baran and the Distributed Network
Paul Baran, a young electrical engineer at RAND Corporation in the 1960s, was working on resilient communication networks for the U.S. Air Force. During this time, Baran developed a concept that allowed data to be broken into small pieces and transmitted independently. This concept is now known as "packet switching." However, Baran referred to this technique as "distributed communications" or a "distributed network."
The system Baran proposed was designed to ensure the network was highly resilient and flexible. Splitting data into small packets and transmitting, these packets independently allowed data transmission over alternative paths in the event of network outages or damage. Baran's design was structured in a way that it could maintain end-to-end communication even if most of its components were destroyed, without requiring central control or management.
The concept that Baran presented to the Air Force in the summer of 1961 was thoroughly elaborated in his 1964 papers titled "On Distributed Communications." Baran's network was designed to maintain end-to-end communication even if most of its components were destroyed, and proposed a structure that would operate without central control or management.
Baran's work convinced U.S. military officials of the potential of wide-area digital computer networks and helped lay the foundations for the TCP/IP protocol.
Image: Donald Davies
Source: Living Internet
It is licensed CC BY-SA 4.0.
Donald Davies and the Spread of Packet Switching
The concept of packet switching, based on similar principles to Paul Baran's work, was also independently developed by Donald Davies. In 1965, at the National Physical Laboratory in the UK, Davies refined this method and introduced the term "packet switching." Davies' work systematically addressed the idea of breaking data into small pieces and transmitting these pieces independently. This term more clearly expressed the technical and practical aspects of packet switching and brought the technology wide international acceptance.
Although both scientists developed this technology based on similar principles, Baran's concept of "distributed communications" and Davies' term "packet switching" significantly contributed to the widespread adoption of packet switching. This technology became one of the foundational building blocks of the modern internet, laying the groundwork for today's digital world.
Step by Step Toward ARPANET
In 1962, ARPA's Command and Control Research Division was renamed the Information Processing Techniques Office (IPTO). The IPTO played a crucial role in the development of computer science. In 1965, Robert Taylor recognized the communication problems among the research centers and emphasized the need for better organization of these centers supported by the IPTO. Following J.C.R. Licklider's vision, Taylor began to understand how computers with different hardware could work efficiently within a network.
In 1966, Larry Roberts and Thomas Merrill connected the Q-32 supercomputer in Santa Monica with the TX-2 supercomputer in Massachusetts using a Western Union telephone line in a time-sharing environment. This experiment demonstrated that packet-switching technology was essential to improving the speed and reliability of the network. By enabling effective communication between computers in two different geographical locations, it provided flexibility and resilience in data transmission. Roberts and Kleinrock's use of such connections and packet-switching principles laid the foundation for ARPANET.
ARPANET was designed as a network to facilitate information sharing and communication between various research centers in the United States. By leveraging the advantages of packet switching, it aimed to provide a more efficient and reliable method of data transmission. These stages led ARPANET to evolve into a communication network that laid the groundwork for the modern internet.
The Development of ARPANET and the Role of Larry Roberts
When Larry Roberts took on the role of ARPANET Program Manager, he quickly focused on the design and development of the network. Drawing on his previous experience connecting the Q-32 and TX-2 computers, he began contemplating how the network should be structured. Roberts met with experts in the field to determine both the functional and technical requirements of the network. Among these experts were J.C.R. Licklider, Leonard Kleinrock, Donald Davies, Roger Scantlebury, and Paul Baran. From these discussions, two key requirements for the network were identified:
- Computer Interface Protocol: A standard had to be developed that could be accepted and used collaboratively by the research groups.
- Data Traffic Management: A system capable of managing the daily traffic of 500,000 data packets across 35 computers connected to 16 mainframes had to be created.
Baran's Ideas and the Role of IMPs in ARPANET
Baran had proposed key ideas for making data transmission in networks more resilient and efficient. Roberts, in planning ARPANET, incorporated these ideas by suggesting the use of small routers at each network node, known as Interface Message Processors (IMPs).
Roberts planned for IMPs to be used at each node of the network, just as Paul Baran had suggested. The IMPs would fulfill four main tasks to ensure the network operated efficiently:
1. Receiving Data Packets: IMPs would accept data packets from the connected computers, a fundamental step in enabling communication between the machines.
2. Splitting Packets: It transmitted incoming data by splitting it into smaller pieces (128-byte packets). This approach allowed data to be moved more easily and quickly over the network.
3. Adding Address Information: IMPs would attach sender and receiver addresses to each data packet, an “address labeling” process that ensured data reached the correct destination.
4. Dynamic Routing: IMPs used dynamic routing tables to transmit data packets through the most efficient and quickest routes. This system was continuously updated to select the best paths based on the network’s current traffic conditions.
These measures made ARPANET a more efficient and effective communication network. The functionality provided by the IMPs allowed data to be transmitted securely and in an organized manner across the network. Ultimately, the IMPs formed the cornerstone of ARPANET’s success, laying the foundation for the modern internet.
Proposal Process for IMPs
On July 29, 1968, ARPA issued a call for proposals for the construction of Interface Message Processors (IMPs). This call garnered significant attention from major tech companies. However, some large corporations, notably IBM and Control Data Corporation, declined the offer, as they did not believe in the effectiveness of packet switching. To them, this technology seemed unreliable at the time.
On the other hand, smaller yet innovative companies like Bolt, Beranek, and Newman (BBN) and Raytheon submitted detailed and bold proposals to meet ARPA's needs. While Raytheon was often favored for large projects, ARPA’s visionary and innovative approach led BBN to win a $1 million contract in January 1969 to build a four-node network. This development demonstrated that in the early days of the internet, innovative ideas could prevail, despite bureaucratic obstacles.
The Success of BBN and ARPANET
Despite being a small research company, BBN played a key role in innovation. Led by Frank Heart, the team garnered attention with its detailed 200-page proposal for ARPANET. Two major factors contributed to the success of this proposal:
- Relationships and Communication: Larry Roberts' effective personal connections with researchers at BBN provided a significant advantage in the early stages of the project. Roberts' reluctance to work with large bureaucratic organizations made BBN’s smaller, more agile structure an attractive choice. The BBN team could communicate directly with Roberts and quickly resolve issues.
- Technical Implementation and Innovation: BBN’s proposal focused heavily on technical details and innovative solutions, providing a strong foundation to meet ARPANET's requirements. The novel approaches presented by BBN successfully addressed ARPANET's technical needs, playing a critical role in their proposal being selected.
These factors allowed BBN to play a crucial role in the success of the ARPANET project and helped lay the foundation for the development of the internet.
Initial Connections and Early Nodes of ARPANET
The early development of Leonard Kleinrock's packet-switching theory enabled the first ARPANET node to be established at UCLA. In September 1969, with the installation of the first IMP at UCLA and the connection of the first host computer, ARPANET's first four nodes were identified:
- The University of California, Los Angeles (UCLA),
- Santa Barbara (UCSB),
- The University of Utah,
- The Stanford Research Institute (SRI).
These four nodes laid the foundation for ARPANET, marking the initial steps toward the modern internet.
Initial Connections and Expansion (1969–1972)
In 1970, after two years of work by the Network Working Group (NWG), the first protocol for inter-computer communication, the Network Control Protocol (NCP), was developed. By the end of the year, ARPANET had expanded to 10 nodes and 19 computers and soon grew to 15 nodes and 23 computers. Between 1971 and 1972, sites across the network began implementing this protocol, and users started developing applications. But, there was still a lack of knowledge and configuration needed for computers to fully harness the network’s potential.
Image: ARPANET Map (1972)
Source: UCLA and BBN, Wikimedia Commons
It is licensed CC BY-SA 4.0.
ARPANET's First Demonstration and Email (1972)
In 1972, ARPANET was publicly introduced on a large scale. In October, Robert Kahn organized a major and successful public demonstration of ARPANET at the International Computer Communication Conference (ICCC). This event showcased the network’s potential to a broad audience.
That same year, the first significant application for ARPANET, email, emerged. In March, Ray Tomlinson, in response to the need for coordination among ARPANET developers, developed basic email-sending and reading software at BBN. Email quickly became the first widely used application on ARPANET.
In July, Larry Roberts further developed this email system. He created the first utility program allowing users to list, selectively read, file, forward, and reply to emails. Email quickly became the most widely used network application and held that position for over a decade. This development was an early indicator of the massive growth in people-to-people communication traffic on today’s World Wide Web.
ARPANET’s Expansion and Security Concerns (1975–1980)
In 1975, ARPANET had expanded rapidly to 57 nodes. However, this rapid growth has made it difficult to control the network's users. Defense Communications Agency (DCA)_ warned that this expansion posed national security risks and raised concerns about unauthorized access. Unfortunately, many nodes had weak or nonexistent access control mechanisms, and these warnings were largely ignored. As a result, by the early 1980s, the network was almost entirely open to both authorized and unauthorized users.
New Protocols and the Development of the Internet (1973–1985)
In 1973, international nodes in the UK and Norway joined ARPANET, and independent packet-switching networks began to form worldwide. At this time, the existing NCP (Network Control Protocol) could only manage communication between computers within the same network. However, there was a growing need for a more comprehensive protocol to provide reliable and dynamic connections between different networks worldwide. To address this, Robert Kahn and Vint Cerf developed the Transmission Control Protocol/Internet Protocol (TCP/IP) in 1978.
The development of ARPANET laid the groundwork for the internet, promoting the idea of an "open architecture network" that would allow various independent networks to work together. This approach enabled different network technologies to be chosen without architectural restrictions and integrated through a high-level "internetworking architecture." Previously, network integration was done through circuit-switching methods, but packet-switching, as proven by Leonard Kleinrock in 1961, was understood to be far more efficient.
Bob Kahn and the Development of TCP/IP (1972)
In 1972, Bob Kahn joined DARPA and introduced the concept of open network architecture within the packet radio program. However, the existing communication protocol, NCP, was inadequate for data transmission between different networks. To solve this issue, Kahn and Vint Cerf began working on a new protocol, eventually developing TCP/IP. This protocol became a cornerstone for the expansion and development of the Internet.
The Spread of Internet Technology (1985–1990)
By the mid-1980s, internet technology was being used experimentally by computer scientists. The successes achieved by DARPA/ARPA on ARPANET by the late 1970s, especially with the benefits of email, supported the spread of computer networks across various disciplines.
In 1972, the Advanced Research Projects Agency (ARPA) was renamed the Defense Advanced Research Projects Agency (DARPA), with the "D" reflecting its defense orientation. This name was briefly reverted to ARPA in 1993, only for the "D" to be restored in 1996.
During this period, networks such as MFENet, established by the US Department of Energy, followed by HEPNet, and NASA's SPAN network were developed. In 1981, networks such as CSNET and BITNET began to become widespread in the academic world. These networks were not compatible with each other because they were developed for specific purposes and served closed communities.
In the commercial sector, alternative technologies like Xerox's XNS, DECNet, and IBM's SNA were explored. Notably, in 1984 the UK developed JANET, and in 1985 the U.S. launched*_ NSFNET_*, a network designed to serve educational institutions. NSFNET connected all users on campus to the internet.
Throughout this period, internet technology became increasingly widespread, laying the groundwork for widespread communication and information sharing across various institutions and sectors.
The Rise of NSFNET and TCP/IP (1985–1990)
In 1985, Dennis Jennings led the NSFNET program and mandated the use of TCP/IP as its standard protocol, marking the beginning of TCP/IP’s establishment as a foundational protocol for the internet. In 1986, Steve Wolff emphasized the need for a comprehensive network infrastructure that could serve the academic community and advocated for developing a strategy independent of federal funding, accelerating efforts to build an infrastructure that could meet the internet’s growing demands.
NSF decided to support DARPA's existing Internet organizational structure, and the RFC 985 document, prepared collaboratively by NSF and DARPA, ensured that the Internet parts were compatible. This document established a standard for seamless communication across networks. As a result, TCP/IP became the backbone of NSFNET, setting the stage for today’s internet. These efforts laid the groundwork for a vast interconnected network, enabling computers worldwide to communicate with one another.
Growth and Commercialization (1990–1995)
In the early 1990s, federal agencies helped expand the Internet by sharing infrastructure costs and encouraging regional networks to begin serving commercial customers, which reduced costs and led to the growth of commercial networks. Although NSFNET's national backbone initially supported only research and education, this eventually spurred the growth of commercial networks and the increased commercial use of the internet.
In 1988, the National Research Council's report "Towards a National Research Network" was one of the key documents that laid the foundation for high-speed networks in the United States. This report provided a framework for the development of broadband internet infrastructure. In 1994, the report "Realizing the Information Future: The Internet and Beyond" provided a roadmap for the evolution of the internet, offering insight into future developments. These reports helped guide the internet's transformation into a fundamental part of modern life.
In 1995, with the end of NSFNET's backbone funding, the control of the internet infrastructure largely shifted to commercial networks. This shift enabled the internet to reach over 50,000 networks worldwide and solidified the TCP/IP protocol as the cornerstone of global information infrastructure. The combination of commercial and public networks formed the backbone of modern information and communication systems.
The Evolutionary Journey of the Internet: The Saga of the Digital Age
In the late 1960s, a group of visionary scientists and engineers came together to lay the foundation of digital communication. This early project, called ARPANET, represented the first steps in creating what would become the heart of the future internet. At the time, this communication network seemed like an unexplored void. However, over time, this quiet beginning laid the building blocks for a vast network that spanned the globe by the 1990s.
In 1992, during the internet's early stages of widespread adoption, global networks were exchanging only 100 gigabytes of data per day. This figure soon saw an immense increase. Tim Berners-Lee's introduction of the World Wide Web in 1989 accelerated this growth, and by 2005, the impact of social media turned data traffic into a rollercoaster ride. Today, internet traffic reaches 16,000 gigabytes per second, with predictions that this figure will quadruple over the next decade.
These numbers might seem complex; however, the first "hello" message sent from UCLA on October 29, 1969—an early communication between two computers—was just the beginning of this revolutionary process. In less than five decades, the internet has integrated itself into the lives of more than three billion people worldwide. Every minute, 165,000 hours of video are watched, 10 million ads are shown, 32,000 hours of music are streamed, and 200 million emails are sent and received.
More than half of the world's population now lives under the expanding influence of the internet. Expressions like "I'm online," "Check the internet," and "It's on the internet" are part of everyday life. This realm has become a place where people connect with God, follow old flames, and experience an almost infinite list of possibilities.
However, the story of the internet is not limited to this broad spectrum of activities. It has also had a profound impact on the political arena. As people stepped into this new age of communication, our political will and relationship with power transformed as well. Barack Obama's victory in 2008, the Spanish Indignados movement in 2011, Italy's Five Star Movement in 2013, Julian Assange's WikiLeaks, and Edward Snowden's revelations about the NSA's secret surveillance system are just a few examples of how the internet has influenced politics. Snowden's documents also brought to light the darker side of the internet; with increased connectivity comes increased exposure to data and the risk of surveillance.
Years later, we have yet to fully realize the potential of the "Galactic Network" that Licklider envisioned in the early 1960s. However, the near-perfect harmony between humans and computers that we experience today—albeit with its shadows—is seen as one of humanity's greatest achievements. This saga, as a captivating story of the digital universe, continues to serve as a source of inspiration for all of humanity.
🐛I hope that by the end of this article, you have gained a deeper understanding of how the digital world works. If you want to follow the developments in the world of technology and software, see more content, or reach me, you can reach me on the following platforms:
🐞Medium
🦋GitHub
🐣LinkedIn
Let's discover more together by following my posts!
Sources:
- Internet Society. (n.d.). Brief history of the Internet. Retrieved from Internet Society
- Living Internet. (n.d.). The invention of packet switching. Retrieved from Living Internet
- Lemelson-MIT Program. (n.d.). Paul Baran. Retrieved from Lemelson-MIT Program
- InformationQ. (n.d.). About the Internet. Retrieved from InformationQ
- Explain That Stuff. (n.d.). How the Internet works. Retrieved from Explain That Stuff
- The Conversation. (2016, September 2). How the Internet was born: A stuttered hello. Retrieved from The Conversation
- History.com. (2020, September 1). Invention of the Internet. Retrieved from History.com
- FreeCodeCamp. (2021, April 22). A brief history of the Internet. Retrieved from FreeCodeCamp
- IEEE Spectrum. (2024, May 15). ICRA 2024 Conference. Retrieved from IEEE Spectrum
- Samueli School of Engineering. (n.d.). The Internet at 50: Celebrating a half-century of innovation. Retrieved from Samueli School of Engineering
- SMPL Digital Archive. (n.d.). Document on the early development of the Internet. Retrieved from SMPL Digital Archive
- RAND Corporation. (2018, October 22). Paul Baran and the origins of the Internet. Retrieved from RAND Corporation
Resources For Images
- NPR. "Lo and Behold: A Communication Revolution." Retrieved from NPR
- Wikimedia Commons. Sputnik Satellite. Retrieved from Wikimedia Commons
- Wikimedia Commons. J. C. R. Licklider. Retrieved from Wikimedia Commons
- RAND Corporation. (2018, October 22). Image of Paul Baran. Retrieved from RAND Corporation
- SMPL Digital Archive. (n.d.). Image from the early development of the Internet. Retrieved from SMPL Digital Archive
- Living Internet. NPL and the Development of Networked Computers. Retrieved from Living Internet
- Wikipedia. Interface Message Processor Front Panel. Retrieved from Wikipedia
- Living Internet. Interface Message Processor. Retrieved from Living Internet
- Samueli School of Engineering. (n.d.). Image from The Internet at 50: Celebrating a half-century of innovation. Retrieved from Samueli School of Engineering
- IEEE Spectrum. Image related to ARPANET-era protocol. Retrieved from IEEE Spectrum
- Wikimedia Commons. ARPANET 1972 Map. Retrieved from Wikimedia Commons
- Wikimedia Commons. Cerf and Kahn Medal of Freedom. Retrieved from Wikimedia Commons
Wikimedia Commons. NSFNET Backbone T3 Update. Retrieved from Wikimedia Commons
Posted on September 19, 2024
Join Our Newsletter. No Spam, Only the good stuff.
Sign up to receive the latest update from our blog.
Related
November 29, 2024