Archives
-
Network Protocols Run the Internet
Network Protocols Run the Internet
Open in app or online This is a sneak peek of today’s paid newsletter for our premium subscribers. Get access to this issue and all future issues - by subscribing today.
Latest articles
If you’re not a subscriber, here’s what you missed this month:
To receive all the full articles and support ByteByteGo, consider subscribing:
In distributed systems, data is sent over the network using various network protocols. As an application developer, this often seems like a block box until an issue arises.
In this issue, we’ll explain how common network protocols work, where they are used in distributed systems, and how we troubleshoot common problems. We’ll cover some popular interview questions as well. For example:
What happens when we type a URL in a web browser?
What is the TCP 3-way handshake?
What is TCP time_wait?
What are HTTP 1/2/3?
Why does HTTP 3 use UDP?
How does HTTPS work?
Why is UDP considered “unreliable”?
Let’s first look at where the network protocols are used.
Internet and the OSI Model
The Internet links a wide range of computing devices around the world. We can get a rough idea from the diagram below. Suppose we access a website from a smartphone or laptop, which connects to a cellular tower. The tower connects to a router, which then accesses the internet via Internet Service Providers (ISPs). Packets are forwarded to a local ISP, then to the network hosting the website. Once the packets reach the company network, they go through a link-layer switch and reach the appropriate server.
Both routers and link-layer switches are packet switches, and their job is to forward packets. The difference is that routers are usually used in the network core to connect multiple networks, while link-layer switches are used in access networks (the network that physically connects an end system to an edge router), connecting several devices in a single network.
Why do we need network protocols? Internet-connected devices need to communicate in a language that they can understand. Various computer systems communicate with each other using a standard specified by the OSI (Open Systems Interconnection) model. The OSI model has seven abstract layers, each with distinct responsibilities and protocols.
The diagram below shows what each layer does in the OSI model. Each intermediate layer serves a class of functionality to the layer above it and is served by the layer below it. Let’s review them.
Application Layer
The application layer is the closest to the end users. Most applications reside in this layer. We request data from a backend server without needing to understand data transmission specifics. Protocols in this layer include HTTP, SMTP, FTP, DNS, etc. We will cover them later.
Presentation Layer
This layer handles data encoding, encryption, and compression, preparing data for the application layer. For example, HTTPS leverages TLS (Transport Layer Security) for secure communications between clients and servers.
Session Layer
This layer opens and closes the communications between two devices. If the data size is large, the session layer sets a checkpoint to avoid resending from the beginning.
Transport Layer
This layer handles end-to-end communication between the two devices. It breaks data into segments at the sender’s side and reassembles them at the receiver’s. There is flow control in this layer to prevent congestion. Key protocols in this layer are TCP and UDP, which we’ll discuss later.
Network Layer
This layer enables data transfer between different networks. It further breaks down segments or datagrams into smaller packets and finds the optimal route to the final destination using IP addresses. This process is known as routing.
Data Link Layer
This layer allows data transfer between devices on the same network. Packets are broken down into frames, which are confined to a local area network.
Physical Layer
This layer sends bitstreams over cables and switches, making it closely associated with the physical connection between devices.
Compared to the OSI model, the TCP/IP model only has 4 layers. When discussing layers, it’s important to specify the context.
Now that we understand the responsibilities of each layer, let’s summarize the data transfer process using the following diagram. This is called encapsulation and decapsulation. Encapsulation involves adding headers to the data as it travels towards its destination. Decapsulation removes these headers to retrieve the original data.
Step 1: When Device A sends data to Device B over the network using HTTP, an HTTP header is initially added at the application layer.
Step 2: A TCP or a UDP header is added to the data. It is encapsulated into TCP segments at the transport layer. The header contains the source port, destination port, and sequence number.
Step 3: The segments are then encapsulated with an IP header at the network layer. The IP header contains the source and destination IP addresses.
Step 4: An MAC header is added to the IP datagram at the data link layer, containing the source and destination MAC addresses.
Step 5: The encapsulated frames are sent to the physical layer and sent over the network as bitstreams.
Steps 6-10: When Device B receives the bits from the network, it initiates the de-encapsulation process, which is the reverse of the encapsulation process. Headers are removed layer by layer, until Device B can access the original data.
Note that each layer uses the headers for processing instructions and does not need to unpack the data from the previous layer.
How do the OSI model layers map to a Linux server implementation? The diagram below provides more detail. The Linux network protocol stack aligns closely with the 4-layer TCP/IP model. The application sends data to the socket via system calls. The socket serves an abstraction for the communication endpoint. The socket layer accepts the data and passes it to the transport and network layer. The data eventually reaches the Network Interface Card (NIC) and is sent over the network.
In the next section, we will explore the common network protocols used when visiting an eCommerce website...
Keep reading with a 7-day free trial
Subscribe to ByteByteGo Newsletter to keep reading this post and get 7 days of free access to the full post archives.
A subscription gets you:
An extra deep dive on Thursdays Full archive Many expense it with team's learning budget Like
Comment
Restack
© 2023 ByteByteGo
548 Market Street PMB 72296, San Francisco, CA 94104
Unsubscribe
by "ByteByteGo" <bytebytego@substack.com> - 11:41 - 15 Jun 2023 -
[Customer Story] From 10 monitoring tools to 1 with plentymarkets.
New Relic
For plentymarkets, real-time monitoring is essential to ensure high website performance, especially during peak seasons. Learn how New Relic helps plentymarkets process millions of orders, optimise their user experience and increase employee happiness through observability.
In our blog " From 10 monitoring tools to 1 with plentymarkets", Lukas Wöhrl, Area Engineering Manager Cloud Platform at plentymarkets will go through his three key takeaways on alerts, troubleshooting, and APM.Read Blog Need help? Let's get in touch. 
This email is sent from an account used for sending messages only. Please do not reply to this email to contact us—we will not get your response.
by "New Relic" <emeamarketing@newrelic.com> - 05:36 - 15 Jun 2023 -
Can auto incumbents think more like start-ups?
On Point
by "McKinsey On Point" <publishing@email.mckinsey.com> - 12:34 - 15 Jun 2023 -
Expense Management Awareness
Expense Management Awareness
.png?width=1200&upscale=true&name=Expense%20management123%20(1).png)
Gain Complete Visibility and Control Over Your Fleet Expenses. Simplify the Billing and Reimbursement Process.
Find Out What Makes Our Software Stand Out from the Crowd
Expense Categorization
Categorize expenses as fixed or variable and track them in detail with our software. Manage indirect costs and stay ahead of the competition.
Insightful Reports
Gain a comprehensive understanding of their expenses, with detailed breakdown of individual expenses, including date, vendor, amount, expense category, etc.
Informative Charts
Get visual representations of expense data, allowing users to identify trends, patterns, and areas for improvement.
Empower your clients with expense management and help them save on costs
Uffizio Technologies Pvt. Ltd., 4th Floor, Metropolis, Opp. S.T Workshop, Valsad, Gujarat, 396001, India
by "Sunny Thakur" <sunny.thakur@uffizio.com> - 12:30 - 15 Jun 2023 -
เชิญเข้าร่วมงาน Innovation Summit Bangkok 2023
Schneider Electric
Innovation Summit Bangkok 2023 วันที่ 5-6 กรกฎาคม ไบเทค บางนาห้ามพลาด! งานสัมมนาเทคโนโลยีและนวัตกรรมครั้งยิ่งใหญ่จาก ชไนเดอร์ อิเล็คทริค
งานสัมมนาด้านเทคโนโลยีและโซลูชันการจัดการพลังงานและระบบอัตโนมัติ งานที่รวมผู้เชี่ยวชาญจาก ชไนเดอร์ อิเล็คทริค และผู้นำทางความคิดในโลกอุตสาหกรรม เพื่อร่วมกันแชร์มุมมองเชิงลึกและแนวคิดใหม่ๆ บนโอกาสและความท้าทายในปัจจุบัน เพื่อเพิ่มขุมพลังขับเคลื่อนสู่เศรษฐกิจดิจิทัลและความยั่งยืน
ท่านจะได้พบกับ นวัตกรรมใหม่ล่าสุด ซอฟต์แวร์ เทคโนโลยีด้าน IoT และ EcoStruxure Solutions จาก ชไนเดอร์ อิเล็คทริค โซลูชั่นที่ครอบคลุมทุกอุตสาหกรรม ทั้งอาคาร โรงงาน ระบบกริด ดาต้าเซ็นเตอร์ และที่อยู่อาศัย
สัมมนาฟรี! ลงทะเบียนได้แล้ววันนี้!
When?July 5 -6, 2023
08:00 - 16:30
Where?Bangkok International Trade & Exhibition Centre: BITEC, Bangna
Grand Halls, 2 Floor
© 2023 Schneider Electric. All Rights Reserved. Schneider Electric is a trademark and the property of Schneider Electric SE, its subsidiaries and affiliated companies. All other trademarks are the property of their respective owners.
by "Schneider Electric" <reply@se.com> - 11:01 - 14 Jun 2023 -
Getting Started With ByteByteGo Newsletter
It’s good to have you here! To complete your signup:
Reply 'OK' to this email.
As a thank you for doing the above, we've compiled a Free System Design PDF (158 pages). It covers 75 topics and has 158 pages! You can access the PDF here.
As of now, you’re on the free edition of the newsletter. You’ll get an email like this every Saturday to level up your system design skills.
However, if you’d like the FULL experience of this newsletter, consider subscribing to the weekly paid edition. Many readers expense it out of their learning budget - use the template on About Page to expense it.
Premium members receive:
✍️ An extra deep dive on Thursdays
🎁 Full archive
💬 Suggest topics and shape what we write
If you are preparing for system design interviews, you may find our text-based System Design Interview course helpful. It is trusted by over 100,000 engineers from top tech companies.
by "ByteByteGo" <bytebytego@substack.com> - 10:05 - 14 Jun 2023 -
You're invited! Join us for a live discussion on the future of wealth and growth
Share this email
New from McKinsey Global Institute
Current tremors in the financial system may signal a lasting shift in how the world borrows, lends, and creates wealth. Businesses need to prepare for an economic, banking, and investment landscape that in the next ten years may look materially different from the past 20. Join us on Wednesday, June 28, 10:00–11:00 AM ET / 4:00–5:00 PM CET, for a virtual conversation with authors Olivia White and Jan Mischke, as well as leading voices from the financial sector, who will discuss the findings of the McKinsey Global Institute’s latest global balance sheet report, The future of wealth and growth hangs in the balance. The report explores four scenarios for inflation, interest rates, and growth to 2030, and considers their implications for real estate, equity, and debt.
Share these insights
Did you enjoy this email? Forward it to colleagues and friends so they can subscribe too. Was this alert forwarded to you? Sign up for it and sample our 40+ other free email subscriptions here.
This email contains information about McKinsey's research, insights, services, or events. By opening our emails or clicking on links, you agree to our use of cookies and web tracking technology. For more information on how we use and protect your information, please review our privacy policy.
You received this email because you subscribed to our McKinsey Global Institute alert list.
Copyright © 2023 | McKinsey & Company, 3 World Trade Center, 175 Greenwich Street, New York, NY 10007
by "McKinsey Global Institute" <publishing@email.mckinsey.com> - 12:33 - 14 Jun 2023 -
Retail media networks are reshaping advertising. What does our research on the US market reveal?
On Point
Brought to you by Liz Hilton Segel, chief client officer and managing partner, global industry practices, & Homayoun Hatami, managing partner, global client capabilities
• RMNs take the reins. The US retail media market has grown into a $45 billion industry in recent years. Even amid economic uncertainty, RMNs now represent an increasingly large share of companies’ marketing budgets. Our research finds 73% of advertisers anticipate spending more on RMNs in the next 12 months, with RMNs capturing an estimated 10 to 15% of total media spend. Many retailers use multiple RMNs and are willing to invest more in RMNs that offer extra features, like more timely data reporting, according to McKinsey senior partner Marc Brodherson and colleagues.
• Meeting advertisers’ needs. Advertisers want to invest in channels with the highest rate of return on their investment, like on- and off-site display and video advertising. To continue growing and capturing a larger share of marketing spend, RMNs can focus on scaling these channels while also addressing advertisers’ pain points, such as a lack of data sharing, poor reporting, and limited customer insights. Explore six secrets that underpin successful RMNs.
— Edited by Gwyn Herbein, editor, Atlanta
This email contains information about McKinsey's research, insights, services, or events. By opening our emails or clicking on links, you agree to our use of cookies and web tracking technology. For more information on how we use and protect your information, please review our privacy policy.
You received this email because you subscribed to the On Point newsletter.
Copyright © 2023 | McKinsey & Company, 3 World Trade Center, 175 Greenwich Street, New York, NY 10007
by "McKinsey On Point" <publishing@email.mckinsey.com> - 12:42 - 14 Jun 2023 -
Registration closing - OpenVINO Toolkit 2023.0: See What’s New
OpenVINO DevCon is back
OpenVINO™ 2023.0 – See What’s New
June 20th, 2023, 9:00AM – 10:00AM IST
Register now 
Md Abul,
Join us for OpenVINO™ DevCon 2023, a series of monthly workshops designed to enhance your experience as an AI application developer. Through hands-on demos, you'll learn valuable skills to streamline your deployment process. Our first session will feature a deep dive into our most significant release of the year, OpenVINO™ toolkit 2023.0.
Attendees will:
- Hear from the head of OpenVINO architecture.
- Look under the hood of the latest release which offers expanded model support including Segment Anything, GPT-J & YOLOv8, more integrations like TensorFlow and Pytorch Frontends, and efficiencies on CPU with thread scheduling.
- Discuss the rapid advancements in language processing and what this means for the industry along with the impact on the open-source community.
Register today
Anisha Udayakumar
AI Evangelist, Intel
Anisha has a passion for the OpenVINO™ toolkit that she brings to leveraging AI, Augmented Reality, Virtual Reality, Robotics, and XR to build rapid prototypes and vision-based retail solutions.
Zhuo Wu
AI Software Evangelist, Intel
Zhuo’s work ranges from deep learning technologies to 5G wireless communication technologies.Upcoming DevCon Webinars
Jul
12
How to Leverage OpenVINO’s Acceleration in Generative AI
7PM-8PM IST
Aug
9
Beyond the Continuum: The Importance of Quantization in Deep Learning
7PM-8PM IST
Sept
5
How To Build a Smart Queue Management System Step by Step? From Zero to Hero
7PM-8PM IST
Register early 
If you forward this email, your contact information will appear in any auto-populated form connected to links in this email.
This was sent to info@learn.odoo.com because you are subscribed to Webinars. To view and manage your marketing-related email preferences with Intel, please click here.
© 2023 Intel Corporation
Intel Corporation, 2200 Mission College Blvd., M/S RNB4-145, Santa Clara, CA 95054 USA. www.intel.com
Privacy | Cookies | *Trademarks | Unsubscribe | Manage Preferences
by "Intel Developer Zone" <intel.developer.zone@plan.intel.com> - 03:06 - 13 Jun 2023 -
Tomorrow: Tray.io Unveils the First iPaaS with Generative AI
Hi Md Abul,
Secure your spot now for tomorrow's Tray Megacast and see Tray Merlin AI in action – our groundbreaking natural language automation capability for business users. With Merlin, anyone can obtain instant answers to business questions and build powerful automated workflows effortlessly using only natural language instructions. Simply ask it questions, like you would a colleague, and watch as it gets to work saving you weeks and months of time compared to doing things the old way.
Join us June 14th at 10am PT / 1pm ET to witness the future of automation.
© Tray.io Inc. 25 Stillman Street, San Francisco, CA 94107, United States
Connectors | Blog | Careers
by "The Tray.io Team" <team@tray.io> - 11:07 - 13 Jun 2023 -
Effortless Vehicle Inspection Across Different Industries
Effortless Vehicle Inspection Across Different Industries
.png?width=1200&upscale=true&name=Vehicle%20inspection%20usecases%20(1).png)
Minimize downtime and reduce costs across industries.
Use Cases Across Industries
Chemical Transportation Fleets
Manual vehicle inspections in chemical transportation posed challenges, including time constraints, compliance issues, and limited real-time insights.
Construction Fleets
Construction fleets face challenges with manual inspections, human error in documentation, and compliance management.
Passenger Transportation Fleets
Streamline pre-trip inspections and maintenance schedules for passenger transportation fleets, ensuring compliance with safety regulations
Discuss your use-case to get your business growing
Uffizio Technologies Pvt. Ltd., 4th Floor, Metropolis, Opp. S.T Workshop, Valsad, Gujarat, 396001, India
by "Sunny Thakur" <sunny.thakur@uffizio.com> - 12:30 - 13 Jun 2023 -
What’s next for the global beauty market?
On Point
Brought to you by Liz Hilton Segel, chief client officer and managing partner, global industry practices, & Homayoun Hatami, managing partner, global client capabilities
• Buoyant beauty. The beauty market is on the up and up despite a turbulent world economy, McKinsey senior partner Kristi Klitsch Weaver and coauthors reveal. Following a solid recovery since the height of the COVID-19 pandemic, the beauty market is expected to reach roughly $580 billion by 2027, growing by a projected 6% a year, finds The State of Fashion: Beauty, a new report from The Business of Fashion and McKinsey. Among other factors, the rise of social selling in Asia, including live streaming, is fueling rapid growth in e-commerce.
• Two big markets. As the beauty landscape grows ever-more competitive, geographic diversification is becoming more essential than ever. China and the US, the beauty industry’s two top countries, will remain mighty forces. By 2027, the beauty market could reach $96 billion in China and $114 billion in North America, our analysis shows. At the same time, other countries and regions, including India and the Middle East, are also emerging as hot spots. See five big ways that the beauty industry is changing, including what Gen Z values in brands.
— Edited by Belinda Yu, editor, Atlanta
This email contains information about McKinsey's research, insights, services, or events. By opening our emails or clicking on links, you agree to our use of cookies and web tracking technology. For more information on how we use and protect your information, please review our privacy policy.
You received this email because you subscribed to the On Point newsletter.
Copyright © 2023 | McKinsey & Company, 3 World Trade Center, 175 Greenwich Street, New York, NY 10007
by "McKinsey On Point" <publishing@email.mckinsey.com> - 12:19 - 13 Jun 2023 -
ตามทันโลกยุคใหม่! กับคู่มือการออกแบบดาต้าเซ็นเตอร์อย่างยั่งยืน
Schneider Electric
by "Schneider Electric" <reply@se.com> - 12:00 - 13 Jun 2023
